말하기 평가 시행 도구 기술과 문항 유형간의 관계성 연구 = The relationship between speaking test administration tools and item types

다국어 초록 (Multilingual Abstract)

This article examines the relationship between test administration tools and item types. It firstly examines the difference in the test administration tools such as paper-based test, computer-based test, and web-based test, in particular, dealing with speaking test. The difference is relevant to item or task types. Based on the considerations of Bachman and Palmer (1996) and Chapelle and Douglas (2006) on test development, and Weir`s (2005) definition of context validity, the application of computer technologies to test administration needs to be considered an important construct affecting test takers` performance. To investigate the item type difference among current speaking tests and its relationship with computer technology in administrating the tests, twelve test takers, five proctors, and two computer lab administrator participated in the phone interview and e-mail survey. Six popular speaking tests (TSE, PELT, IELTS, MATE, iBT TOEFL, ESPT) were selected to be analyzed. The data were analyzed in terms of item types, computer technology use, and test-takers perceptions. The implication is suggested for students, teachers, and language testers.

참고문헌 (Reference)

1 해커스, "토플Q&A게시판. 해커스홈페이지"

2 최수영, "멀티미디어기반 영어교육" 한국문화사 2003

3 Roever, C., "Web-Based Language Testing" 5 (5): 88-94, 2001

4 Messick, S., "Validity in : Educational Measurement" American Council on Education 3-104, 1989

5 Chapelle, C. A., "Validation of a web-based ESL test" 20 (20): 409-439, 2003

6 Kim, J. T., "Validation of a test screen design. Multimedia-Assisted Language Learning" 10 (10): 62-80, 2007

7 Hansen, E. G., "Toward accessible computer-based tests: Prototypes for visual and other disabilities" ETS 2004

8 Kim, J. T., "The effectiveness of test-takers’ participation in development of an innovative web-based speaking test for international teaching assistants at American colleges. Doctoral dissertation" University of Illinois at Urbana-Champaign 2006

9 Cohen, Y., "The effect of specific language features on the complexity of systems for automated essay scoring" 2003

10 Hughes, A., "Testing for language teachers" Cambridge University Press 2003

11 Lazaraton, A., "Teaching oral skills in : Teaching English as a second or foreign language" Heinle & Heinle 103-115, 2001

12 Nation, I. S. P., "Teaching ESL/EFL listening and speaking" Routledge 2009

13 Fulcher, G., "Second language testing" Pearson Education Limited 2005

14 Lee, H., "Measuring plagiarism in the second language essay-writing context" 12 (12): 221-228, 2005

15 숙명여대, "MATE 개요"

16 O'Malley, J. M., "Learning strategy applicatons with studetns of English as a second language" 19 : 557-584, 1985

17 Bachman, L. F., "Language testing in practice" Oxford University Press 1996

18 Weir, C. J., "Language testing and validation: an evidence-based approach" Palgrave Macmillan 2005

19 Fulcher, G., "Interface design in computer-based language testing" 20 (20): 384-408, 2003

20 Craig, D., "Handwriting legibility and word-processing in assessing rater reliability" University of Illinois at Urbana-Champaign 2001

21 Taylor, C., "Examining the relationship between computer familiarity and performance on computer-based language tasks" 49 (49): 219-274, 1999

22 Bridgeman, B., "Effects of screen size, screen resolution, and display rate on computer-based test performance" Educational Testing Service 2002

23 Jamieson, J., "Design and evaluation of a computer-based TOEFL tutorial" Educational Testing Service 1998

24 Kelly, A., "Computerized scoring of essays for analytical writing assessments: Evaluating score validity" 2001

25 Chapelle, C. A., "Computer applications in Second Language Acquisition: Foundations for teaching, testing and research" Cambridge University Press 2001

26 Choi, I., "Comparability of a paper-based language test and a computer-based language test" 20 (20): 295-320, 2003

27 Breland, H., "Comparability of TOEFL CBT writing prompts: Response mode analyses" Educational Testing Service 2004

28 Chapelle, C. A., "Assessing language through computer technology" Cambridge University Press 2006

29 Chapelle, C. A., "Are c-tests valid measures for L2 vocabulary research?" 10 (10): 157-187, 1994

30 ETS, "About the test. TSE Overview. Retrieved September 15, 2008 from the World Wide"

31 Lee, H. K., "A comparative study of ESL writers’ performance in a paper-based and a computer-delivered writing test" 9 : 4-26, 2004