SEPT 채점 신뢰도와 타당도 연구

다국어 초록 (Multilingual Abstract)

The purpose of this study is to explore the rater reliability and test validity of SEPT (Spoken English Proficiency Test) developed by YBM Sisa-Yong-A-Sa in Korea. For this purpose. the performance of 47 test-takers was rated and analyzed using Rasch modelled FACETS (Linacre & Wright. 1993), Speaking performance in SEPT was also compared with candidates' TOEIC sub-scores. After exploring the psychometric extent to which the test criteria and tasks of the SEPT are valid. it was concluded that the testing scheme partially met the theoretical and empirical consideration behind the test specification and rater training. Implications for further revision of the SEPT are discussed.

목차 (Table of Contents)

• Abstract
• 1. 연구의 필요성 및 목적
• 2. 연구자료 분석방법
• 3. 연구 기획
• 4. 연구결과 및 분석
• 5. 결론
• 참고문헌

참고문헌 (Reference)

1 신동일, "한국의 영어평가학 1: 시험개발편." 한국문화사 2003

2 신동일, "채점경향 분석을 위한 Rasch 측정모형 적용연구" 8 (8): 249-272, 2001b

3 Weigle,S.W, "Using FACETS to model rater training effects" 15 : 263-287, 1998

4 North, "The development of descriptors on scales of language proficiency National Foreign Language Center at the Johns Hopkins University" 1993

5 North, B., "Scaling descriptors for language proficiency scales" 15 (15): 217-262, 1998

6 Lumley, T.,, "Rater characteristics and rater bias: Implications for training." 12 : 54-71, 1995

7 McNamara,T.F, "Measuring second language performance" Longman 1996

8 Linacre,J.M, "Many-facet Rasch measurement" MESA Press 1989

9 Pollitt,A, "Calibrating graded assessments:Rasch partial credit analysis of performance in writing" 4 (4): 72-79, 1987

10 Woodford, "An introduction to TOEIC" Princeton 1982

11 신동일, "ACTFL-SOPI 체제의 영어 말하기평가 현장연구:한국에서의 문제점과 현실적 대안" 56 (56): 309-331, 2001a

12 & Wright, "A user’s guide to FACETS" MESA Press -2, 1993