Empirical Evaluation of the Effect of Speededness Using IRT

국문 초록 (Abstract)

  검사가 일정수준 이상의 속도성(test speededness)을 띠게 되면 문항반응이론(item response theory)의 일차원성(unidimensionality) 가정과 지역독립성(local dependence) 가정의 위배를 초래한다. 이러한 가정들이 위배된 상황에서 문항반응이론을 적용하면 정확하지 못한 분석결과를 얻게 되고, 따라서 문항반응이론을 이용한 검사동등화 방법이나 컴퓨터 능력적응 검사의 개발 등에도 영향을 미치게 된다. 본 연구는 속도성이 문항반응이론을 이용한 데이터 분석에 실제로 어떠한 영향을 미치는지 조사하였다. 검사가 속도성을 띠는 경우 문항변별도, 문항난이도, 문항정보함수, 측정의 표준오차 등이 속도성의 영향을 받았다. 특히 낮거나 중간 능력 수준의 피험자들이 속도성으로 인해 불리한 영향을 받는 것이 드러났다. 본 연구는 속도성의 영향을 받으면 문항반응이론을 이용한 검사 분석이 전반적으로 왜곡될 수 있음을 실증적 연구를 통하여 보이고, 앞으로 속도성의 영향을 제거할 수 있는 방법을 모색해야함을 강조하였다.

다국어 초록 (Multilingual Abstract)

  Test speededness introduces local dependence and multidimensionality into the test so that the application of a unidimensional IRT model to a speeded test can result in inaccurate estimates of IRT parameters. This study empirically showed that item parameter estimates, characteristic curves, expected raw and scale scores, information functions, and conditional standard errors of measurement were affected by speededness. The findings indicated that especially the low and medium ability students were disadvantaged when the test was speeded. This study stressed the growing need for understanding and making an effort for eliminating the effect of speededness on IRT.

목차 (Table of Contents)

• Ⅰ. Introduction
  Ⅱ. Psychometric Properties using IRT
  Ⅲ. Method
  Ⅳ. Results
  Ⅳ. Conclusion and Discussion
  References
  저자소개
  〈요약〉
  

참고문헌 (Reference)

1 "The effect of different testing conditions on item parameter estimates" Iowa City, IA 2001

2 "Test equating, scaling, and linking: methods and practices. (2nd ed.)" New York: Springer-Verlag 2004

3 "ST: a computer program for IRT scale transformation, version 1.0" Iowa City, IA: ACT 1995

4 "Modeling the mixture of IRT and pattern responses by a modified HYBRID model(RR9516)" Princeton, NJ: Educational Testing Service 1995

5 "Modeling item response times with a two-state mixture model A new method of measuring speededness" 34 : 213-232, 1997

6 "Item parameter estimation under conditions of test speededness: Application of a mixture Rasch model with ordinal constraints" 39 : 331-348, 2002

7 "IRTEST (Computer program)" Iowa City, IA: Author 2001

8 "How contaminated by guessing are item parameter estimates and what can be done about it?" New York, NY. 1996

9 "Examining the sources and effects of local dependence" New York, NY 1996

10 "Estimators of conditional scale-score standard errors of measurement A simulation study" 37 : 1-20, 2000

11 "Development and calibration of an item response model that incorporates response time" 29 : 323339-, 2005

12 "BILOG-MG: Multiple-group IRT analysis and test maintenance for binary items" Chicago: Scientific Software International 1996

13 ". The Effect of Speededness on Parameter Estimation in Item Response Theory. Journal of Educational Measurement. 31" 1994200-219.

14 ". Developing a common metric in item response theory. Applied Psychological Measurement" 201-210, 1983

15 ". Comparison of IRT true-score and equipercentile observed- score" 453-461, 1984

16 ". Applications of Item Response Theory to Practical Testing Problems. Hillsdale" 1980