고등학교 수리영역 시험의 난이도 예측 요인 분석 = Factors of Predicting Difficulty of Mathematics Test Items in College Scholastic Ability Test

다국어 초록 (Multilingual Abstract)

This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

참고문헌 (Reference)

1 "대학수학능력시험 외국어(영어)영역 읽기 난이도 예측 모형 개발" 11 (11): 111-130, 2005

2 "대학수학능력시험 문항난이도 추정모형개발-언어 영역 영어 영역을 중심으로" 16 (16): 1-23, 2003

3 "고3연합학력평가(6월) 결과분석-수리 영역" 서울 2002

4 "고3연합학력평가(10월) 결과분석-수리 영역" 서울 2003

5 "고3연합학력평가(10월) 결과분석-수리 영역" 서울 2005

6 "고3연합학력평가(10월) 결과분석-수리 영역" 서울 2006

7 "고3연합학력평가(10월) 결과분석-수리 영역" 서울 2004

8 "고3연합학력평가(10월) 결과분석-수리" 서울 2002

9 "고2연합학력평가(9월) 결과분석-수리 영역" 서울 2006

10 "고2연합학력평가(6월) 결과분석-수리 영역" 서울 2006

11 "고2연합학력평가(6월) 결과분석-수리 영역" 서울 2005

12 "고2연합학력평가(6월) 결과분석-수리 영역" 서울 2004

13 "고2연합학력평가(6월) 결과분석-수리 영역" 서울 2003

14 "고2연합학력평가(6월) 결과분석-수리 영역" 서울 2002

15 "고1연합학력평가(9월) 결과분석-수리 영역" 서울 2006

16 "고1연합학력평가(9월) 결과분석-수리 영역" 서울 2004

17 "고1연합학력평가(6월) 결과분석-수리 영역" 서울 2005

18 "고1연합학력평가(6월) 결과분석-수리 영역" 서울 2002

19 "고1연합학력평가(6월) 결과분석-수리 영역" 서울 2006

20 "고1연합학력평가(6월) 결과분석-수리 영역" 서울 2003

21 "고1연합학력평가(6월) 결과분석-수리 영역" 서울 2004

22 "고1연합학력평가(12월) 결과분석-수리 영역" 서울 2003

23 "고1연합학력평가(11월) 결과분석-수리 영역" 서울 2002

24 "The prediction of TOEFL reading comprehension item difficulty for expository prose passages for three item types" Princeton 1993

25 "The prediction of SAT reading comprehension item difficulty for expository prose passages" Princeton 1991

26 "The frequency and placement of main ideas in children’s social studies textbooks A modified replication of Braddock’s research on topic sentences Journal of Reading Behavior" 27-40, 1984

27 "Factors related to the difficulty of college scholastic ability test English items" 60 (60): 17-25, 2005

28 "Exploring items characteristics that are related to the difficulty of TOEFL dialogue items" Princeton, NJ: Educational Testing Service 2004

29 "Effects of Prose Complexity on Achievement Test Item Difficulty" Scheuneman Princeton -43, 1991

30 "Assessing reading" Cambridge: Cambridge University Press 2000

31 "Analyzing the minority gap in achievement scores Issues for states and federal government" 22 (22): 30-36, 2003

32 "An exploratory study on reading comprehension test-taking processes and strategies in the EFL context" 57 (57): 177-195, 2002