‘잘 모르겠음’ 답지와 차별점수화가 검사의 측정학적 특성에 미치는 영향 = The effect of ‘don't know’ option and different weight on the quality of item and test.

국문 초록 (Abstract)

선다형 문항은 피험자가 추측에 이하여 문항의 답을 맞힐 확률이 있다는 단점이 있으며, 추측에 의한 응답은 추정의 오차를 증가시켜 피험자의 능력을 정확하게 추정하지 못하여 검사의 신뢰도를 저하시킬 수 있다. 본 연구에서는 ‘잘 모르겠음’ 답지를 포함하는 것과 ‘잘 모르겠음’ 답지를 포함하고 이 답지를 선택한 경우 가중치를 부여함으로써 추측에 의해 응답한 경우와 추측하지 않고 모른다고 응답한 경우를 차별 점수화하는 방안이 문항 특성과 검사특성에 긍정적인 영향을 미치는지를 확인하였다. 연구 결과 ‘잘 모르겠음’ 답지가 포함됨으로써 피험자가 추측하여 답하는 확률이 낮아져 피험자의 능력을 변별하는 정도가 향상되고 보다 정확히 피험자의 능력을 추정하는 효과가 나타났다. ‘잘 모르겠음’ 답지가 포함되고, 그 답지에 가중치가 부여되는 경우는 양호도가 향상되는 효과가 있기는 하지만 ‘잘 모르겠음’ 답지만 포함시켰을 때에 비해 그 효과가 감소하거나 거의 유사하여 ‘잘 모르겠음’ 답지를 포함한 후 가중치를 부여함으로써 ‘잘 모르겠음’ 답지와 틀린 답지를 선택한 문항을 차별하여 점수화하는 방법이 피험자의 능력을 정확히 추정하는데 영향을 주지 못함을 확인할 수 있었다.

다국어 초록 (Multilingual Abstract)

The primary purpose of this study is to investigate the effects of don't know response option and different weight for wrong response and don't know response on the quality of multiple-choice format item. Three forms of each test unit were prepared. The group 1 took forms containing items with five responses and the group 2 took forms which had an additional response of I don't know, while the group 3 took forms with don't know response option and weight of ‘1/number of alternative’ for don't know response.
As a results, addition of a ‘don't know option’ reduced guessing and increased the accuracy of measuring ability more than addition of a ‘don't know response option’ and weight of ‘1/number of alternative’ for don't know response.

목차 (Table of Contents)

• 초록
• Ⅰ. 서론
• Ⅱ. 이론적 배경
• Ⅲ. 연구방법
• Ⅳ. 연구결과
• Ⅴ. 결론 및 논의
• 참고문헌
• 저자소개
• ABSTRACT

참고문헌 (Reference)

1 "중립반응범주 유무에 따른 Likert형 척도의 양호도 비교" 2001

2 "문항제작 및 분석의 이론과 실제" 학지사 2004

3 "문항작성방법론" 교육과학사 2000

4 "문항반응이론의 이해와 적용" 교육과학사 2001

5 "교육평가 용어사전" 학지사 2004

6 "for an answer? Public Opinion Quarterly" don't k (don't k): -357, 1993

7 "Use of the facts on aging quiz in New Zealand" 27 (27): 409-416, 2001

8 "To guess or not to guess A decision-theoretic view of formula scoring Journal of Educational Measurement" -291, 1993

9 "The reliability of survey attitude measurement The influence of question and respondent attributes" -128, 1991

10 & Schuman, "The management of a middle position in attitude surveys" Presser -123, 1989

11 "The knowledge of memory aging questionnaire" 29 (29): 427-446, 2003

12 "The effects of a response on palmore's facts on aging quizzes" don't k (don't k): -181, 1985

13 Muijtiens, A M M, "The effect of a ‘don't know’ option on test scores" 33 : 267-275, 1999

14 "Testing with multiple-choice items Journal of Research and Development in Education" -58, 1987

15 Thissen D, "Test Scoring. NJ" Mahwah Lawrence Erlbaum Associates 2001

16 "Statistical modelling of multiple-choice and true/false tests" 24 (24): 399-411, 1999

17 "Reducing spurious response in a field survey Journal of Social Psychology" -212, 1989

18 "Quantifying the effect of chance in multiple choice and true/false tests" 26 (26): 41-50, 2001

19 "Principles of Educational and Psychological Measurement and Evaluation" 1989

20 Popham, W. J, "Modern Educational Measurement, 3rd ed." Allyn and Bacon. 2000

21 "Measurement and Assessment in Teaching" Prentice-Hall, INC. 1995

22 Schnipke, D. L, "How contaminated by guessing are item-parameter estimates and what can be done about it?" 1996

23 "Essentials of Educational Measurement" Prentice Hall 1991

24 "Effects of item grouping and position of the ‘don't know’ option on questionnaire response" 14 (14): 418-422, 2002

25 "Effects of instruction for guessing on multiple-choice test performance" -9, 1989

26 "Educational Research, Methodology, and Measurement" Pergamon 1997

27 Kerwin, P, "Don't know responses in surveys" is what I know what you want to know and do I want you to know it?Memory" 6 (6): 407-426, 1998

28 Lorence, D. P, "Don't know responses in environmental surveys" 27 (27): 13-17, 1996

29 "Does guessing really help? Journal of Educational Measurement" -336, 1989

30 "Critical values of guessing on true-false and multiple-choice tests" san francisco : 1995

31 "Assessing guessing behavior using the three-parameter logistic model" chicago : 1985

32 Lord, "Applications of Item Response Theory to Practical Testing Problems" Lawrence Erlbaum Associates Publishers 1980

33 Lee, "A study of the I don't know response in Multiple-choice tests" 1974

34 Kurz, T. B., "A review of scoring algorithms for multiple-choice test" San Antonio. 1999

35 "A new look at the influence of guessing on the reliability of multiple-choice tests" 27 (27): 357-371, 2003

36 "A comparison of multiple-choice and constructed figural response items" 1990