MH 방법과 SIBTEST 방법을 이용한 문항 유형에 따른 차별기능문항의 탐색 = An Exploratory Study on Item-format Related DIF with MH and SIBTEST techniques

국문 초록 (Abstract)

이 연구에서는 선다형과 단답형의 문항 유형에 따라 차별적으로 기능하는 문항들이 있는지 추출하고, 문항 유형의 차이가 집단에 따라 어떻게 작용하는지 알아보고, 문항 유형이 차별기능을 유발하는 하나의 원인으로 인식될 수 있는지 탐색하였다. 이를 위해 서울시에 소재하고 있는 초등학교 6학년 245명을 대상으로 수학 교과에서 출제한 동일한 내용을 측정하는 선다형과 단답형 검사를 시행하였다. 이 자료를 이용하여 일반화된 Mantel-Haenszel(MH) 방법과 Simultaneous Item Bias Tes(SIBTEST) 방법으로 차별기능문항을 추출하였다. 그 결과, 문항 유형에 따라 차별적으로 기능하는 8개의 문항들이 두 방법에 의해 동일하게 추출되었다. 또한 차별기능문항으로 추출된 문항들의 남학생 집단과 여학생 집단의 난이도 차이를 분석한 결과, 선다형이 여학생보다 남학생에게 더 유리하게 기능하는 경향성을 확인할 수 있었다. 이러한 결과는 문항 유형이 차별기능문항의 한 요인으로 작용할 수 있다는 것을 의미한다.

다국어 초록 (Multilingual Abstract)

The primary purpose of this study is to examine an item-format related differential item functioning (DIF), to detect a gender-related DIF in each format, and to investigate the causes of DIF with the generalized Mantel-Haenszel(MH) procedure and the simultaneous item bias test(SIBTEST) procedure. This study targeted 122 male and 123 female students and they were responded a multiple-choice test and an open-ended test containing the same 20 items of mathematics for elementary 6th grade mathematics.
The MH and SIBTEST detected the same eight items as item-format related DIF and results suggested a significant effect of item format across items. Also, male students, compared to matched female students, were favored by the multiple-choice format. These results meant item-format was regarded as a DIF factor.
In conclusion, this study was proposed to examine the cause of DIF beyond detecting DIF. It would be useful to compare the results of various methods and analyze the cause of DIF through meta analysis. These studies would help to provide useful information to change in curricula and instructional methods.

목차 (Table of Contents)

• 초 록
• Ⅰ. 서 론
• Ⅱ. 차별기능문항의 원인에 대한 연구
• Ⅲ. 차별기능문항 추출방법
• Ⅳ. 연구방법
• Ⅴ. 연구결과
• Ⅵ. 결론 및 논의
• 참고문헌
• ABSTRACT

참고문헌 (Reference)

1 "차별기능문항 기법의 응용: 교육 및 심리검사의 번안과정에서" 15 (15): 207-225, 2002

2 "종합진로적성검사 수리영역의 성 차별기능문항 추출" 2000

3 "문항의 형태와 배점에 따른 검사정보의 비교" 14 (14): 173-191, 2001

4 "문항의 형태에 따른 피험자의 인지적정의적 반응의 차이에 관한 연구" 13 (13): 181-194, 2000

5 "교육 측정평가연구통계 용어사전" 중앙교육진흥연구소 1995

6 "Using Statistical and Judgmental Reviews to identify and Interpret Translation DIF" 1999

7 "Unfactor latent trait models applied to multifactor test Journal of Edcational Statistics" 207-230, 1979

8 "The Subject matters" University of Chicago Press 1988

9 "Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel type I error performance" 33 (33): 215-230, 1996

10 "Sex differnces in problem-solving strategies used by high-scoring examinees on the SAT-M" 92-33, 1992

11 "SIBTEST Manual" University of Illinois 1996

12 "Performance of Mantel-Haenszel and simultaneous item bias procedure for detecting differential item functioning" 315-328, 1994

13 "Patterns of gender differences on mathematics items on the Scholastic Aptitude Test Applied Measurement in Education" 137-151, 1993

14 "Meta-analytic contributions to the study of gender differences in mathematics-The relationship of mathematical and spatial skills International Journal of Educational Research" 361-371, 1994

15 "Mantel-Haenszel 방법을 이용한 차별기능문항 추출 컴퓨터 프로그램과 매뉴얼" 이화여자대학교 교육학과 1993

16 "Logistic Discriminant Function Analysis for DIF Identification of Polytomously Scored Items Journal of Educational Measurement" 107-122, 1993

17 "Item bundle DIF hypothesis testing: Identifying suspect bundles and assessing their DIF" 33 (33): 465-484, 1996

18 "Item and test characteristics that are associated with differential item functioning" 255-276, 1993

19 "Item Characteristics and Gender Differences on the SAT-M for Mathematically Able Youths" 65-87, 1990

20 "International Journal of Educational Research" & Fennema 373-384, 1994

21 "Influence of item characteristics on male and female performance on SAT-Math" City University of New York 1984

22 "How have the changes in SAT affected women's mathematics performance?" 15 (15): 5-9, 1996

23 "Handbook of research on mathematics teaching and learning" Macmillan 420-464, 1992

24 "Gender-based differential item performance in mathematics achievement items Journal of Educational Measurement" 157-166, 1987

25 "Gender-Related Differential Item Functioning on a Middle-School Mathematics Performance Assessment" 21-27, 1996

26 "Gender Differences in Performance on Multiple-Choice and Constructed Response Mathematics Items" 12 (12): 29-51, 1999

27 "Examining Gender DIF on a Multiple-Choice Test of Mathematics: A Confirmatory Approach" 15-20, 1996

28 "Effects of item arrangement knowledge of arrangement and sex on test performance Journal of Educational Measurement" 49-58, 1982

29 "Content factors in sex differences on test questions" Princeton 1973

30 "Bilog-MG: Multiple-Group IRT Analysis and Test Maintenance for Binary Items" SSI Inc 1996

31 "An Item Response Model for Test Bias and Differential Test Functioning" 1993197-239

32 "An Examination of Item Context Effects, DIF, and Gender DIF" 14 (14): 73-90, 2001

33 "A new perspective on women's math achievement" 1989198-214

34 "A meta-analysis of recent studies on sex differences in mathematics tasks Review of Educational Research" 1989185-214

35 "A SIBTEST Approach to Testing DIF Hypotheses Using Experimentally Designed Test Items" 37 (37): 307-327, 2000