언어영역 하부검사(Testlet)의 지역의존성과 모수추정모형의 탐색 = Investigations of Local Item Dependence and Estimation Method in the Testlets of the Language test

국문 초록 (Abstract)

본 연구는 하부검사가 가장 활발하게 사용되고 있는 언어영역에서 지역의존성을 확인하고 이것이 문항모수 추정에 어떠한 영향을 미치는지 탐색하고, 적합한 문항모수추정모형을 탐색하였다. 이 때 하부검사 측정모형은 측정의 기본가정인 지역독립성을 유지할 수 있도록 하기 위하여 하위 문항 점수를 합산하여 하나의 다분문항으로 간주하는 일반적인 방법을 사용하였다. 연구결과 언어영역 하부검사에서의 지역의존성이 크지는 않지만 어느 정도는 존재하며, 이것이 모수 추정치에 영향을 끼치는 것을 발견할 수 있다. 또한 언어영역 하부검사의 범주에서 서열성을 확인할 수 있기 때문에, 반응 범주의 서열성을 가정하는 일반화부분점수모형을 사용하여 분석하는 것이 타당하다.

다국어 초록 (Multilingual Abstract)

The purposes of this study are to measure the degree of local item dependence(LID) within the testlets of language test, to investigate the effects of LID empirically and to investigate a proper measurement model. To measure testlet, it is used testlet scoring which is scoring each testlet as if it were a single polytomous item. LID within testlet was present but the degree of LID was not large. And then, testlets were treat as single polytomous item because of LID. At first nominal response model(NRM) was used to estimate item parameters for unordered response. As ordered categories was verified, generalized partial credit model(GPCM) was used to estimate item parameters for ordered response. Based on the results, it was investigated the effects of LID. Intercept parameters and step difficulty were affected by LID, but discrimination parameters were not. If testlet scoring is used to manage LID, GPCM is more proper than NRM to estimate item parameter because testlet has ordered categories and GPCM is for ordered response.

목차 (Table of Contents)

• 초록
• Ⅰ. 서론
• Ⅱ. 이론적 배경
• Ⅲ. 연구 방법
• Ⅳ. 연구 결과
• Ⅴ. 결론 및 논의
• 참고문헌
• ABSTRACT

참고문헌 (Reference)

1 "문항반응이론의 이해와 적용" 교육과학사 2001

2 "대학수학능력시험(언어영역)의 현황과 개선 방안" 20 : 85-120, 2004

3 "대학수학능력시험 출제 매뉴얼 언어영역" 한국교육과정평가원 2004

4 "단위검사 개념의 적용-일반화가능도 이론을 중심으로" 16 (16): 53-70, 2003

5 "strategies for managing local item dependence Journal of Educational Measurement" 1993187-213

6 "Trace lines for testlets A use of multiple-categorical- response models Journal of Educational Measurement" 247-260, 1989

7 "The use of application test a novel type of problem-solving exercise as a tool of teaching and assessment of competence in medical biology" 73-82, 1987

8 "On the reliability of testlet-based tests Journal of Education Measurement" 237-247, 1991

9 "MULTILOG 7.0 [Computer program]" Scientific Software, Inc. 0-7, 2003

10 "Local dependence indexes for item pairs using item response theory" 22 (22): 265-289, 1997

11 "Journal of Educational Measurement" 1991197-219

12 "Items bundles" 53 (53): 349-359, 1988

13 "Item response theory for item scored in more than two categories" Lawrence Erlbaum Associates 2001

14 "Item Response Theory for Psychologists" Lawrence Erlbaum Associates 2000

15 "Incorporating the testlet concept in test score analysis" Educational Measurement 19 (19): 9-15, 2000

16 "Identification and evaluation of local item dependencies in the Medical College Admissions Test" 39 (39): 291-309, 2002

17 "IRTNEW: A Computer program for the detection of LID" University of North Carolina at Chapel Hill. 1998

18 "How is reliability related to the quality of test scores? What is the effect of local dependence on reliability?" Educational Measurement 15 : 22-29, 1996

19 "Examining passage-related local item dependence(LID) and measurement construct using Q₃statistics in an EFL reading comprehension test" 21 (21): 74-100, 2004

20 "Examining local item dependence effects in a large-scale science assessment by a Rasch partial credit model" Michigan State University 1996

21 "Estimating item parameters and latent ability when response are scored in two or more nominal categories" 37 (37): 29-51, 1972

22 "Effect of local item dependence on the fit and equating performance of the three parameter logistic model" 8 (8): 125-145, 1984

23 "Contextual explanations of local dependence in item clusters in a large scale hands-on science performance assessment" 36 (36): 119-140, 1999

24 "An introduction to polytomous item response theory models" Measurement & Evaluation in Counseling & Development 25 (25): 172-189, 1993

25 "A taxanomy of item response theory" 567-577, 1986

26 "A generalized partial credit model:Application of an EM algorithm" 16 : 159-176, 1992

27 "A comparison of testlet reliability for polytomous scoring methods" 1993

28 "A case for testlets Journal of Educational Measurement" 1987185-201

29 "2000년 OECD 학업성취도 국제비교 연구: 읽기, 수학, 과학 영역을 중심으로" 한국교육과정평가원 2000