인지진단모형에 의한 TIMSS 2015 수학 문항의 성별 차별기능문항 탐색 = Exploring Differential Item Functioning of TIMSS 2015 Mathematics Items by Gender, Based on the Cognitive Diagnosis Models

다국어 초록 (Multilingual Abstract)

The DIF exploration can be used as a mean, in developing and studying the cognitive diagnosis models, to improve each item’s equitability and validity. By the suggestion of the ‘CDM-Wald test’ and the ‘LCDM-DIF method’, it became possible recently to analyze the DIF that is found at the attribute level, but the study that utilizes actual materials is nearly absent. This study used 18 item responses of TIMSS 2015’s 8 th Grade Mathematics and extracted DIFs by gender, and explored the occurrence of differential functioning at the attribute level. As a result, a total of three items were categorized as DIF. Gathering the opinions of content experts, it was found that the attribute’s utilization and route that are necessary for solving the items categorized as DIF may not work identically due to gender characteristics. This result can be used as a material for modifying the Q-Matrix and improving items in the future, and this indicates that it is possible to collect the information for inferring differences of the attributes’ occurrence that are found between groups.

참고문헌 (Reference)

1 설현수, "학교급 및 성별에 따른 컴퓨터용 청소년적성검사의 차별기능문항 탐색" 한국교육평가학회 18 (18): 79-100, 2005

2 고상숙, "컴퓨터를 이용한 기하 변환학습에서 남녀성차에 따른 연구" 한국학교수학회 9 (9): 539-556, 2006

3 이대식, "수학학습에서의 성차에 대한 초등학교 학생 및 교사의 인식조사" 한국초등교육학회 16 (16): 297-316, 2003

4 Plummer, M., "rjags: Bayesian Graphical Models using MCMC"

5 Plummer, M., "coda: Output Analysis and Diagnostics for MCMC"

6 Clauser, B. E., "Using statistical procedures to identify differentially functioning test items" 17 (17): 31-44, 1998

7 Rupp, A. A., "Unique characteristics of diagnostic classification models: A comprehensive review of the current state-of-the-art" 6 (6): 219-262, 2008

8 Galeshi, R., "Understanding student’s mathematical skills: A formative approach" 7 (7): 77-89, 2016

9 Coleman, J., "The concept of equality of educational opportunity" 38 (38): 7-22, 1968

10 윤지영, "TIMSS(2007) 수학 검사의 차별문항기능에 관한 연구 -한국, 미국, 싱가폴 학생을 대상으로" 한국교육평가학회 26 (26): 415-439, 2013

11 Chiu, C. Y., "Statistical refinement of the Q-matrix in cognitive diagnosis" 37 (37): 598-618, 2013

12 Benbow, C. P., "Sex differences in mathematical ability: Fact or artifact?" 210 (210): 1262-1264, 1980

13 R Core Team, "R: A Language and EnvironRobitzschment for Statistical Computing" R Foundation for Statisical Computing 2016

14 George, A. C., "Multiple group cognitive diagnosis models, with an emphasis on differential item functioning" 56 (56): 405-432, 2014

15 Camilli, G., "Methods for identifying biased test items" Sage Publications 1994

16 Martiniello, M., "Linguistic complexity, schematic representations, and differential item functioning for english language learners in math tests" 14 (14): 160-179, 2009

17 Becker, B. J., "Item characteristics and gender differences on the SAT-M for mathematically able youths" 27 (27): 65-87, 1990

18 Lee, K. H., "Investigation of gender differences in college school ability test(CSAT) mathematics section by using differential bundle functioning method" Ewha Womans University 2004

19 Klieme, E., "Identifying national cultures of mathematics education:Analysis of cognitive demands and differential item functioning in TIMSS" 16 (16): 385-, 2001

20 Jensen, A., "How much can we boost IQ and scholastic achievement" 39 (39): 1-123, 1969

21 Clements, D. H., "Handbook of research on mathematics teaching and learning: A project of the national council of teachers of mathematics" Macmillan 420-464, 1992

22 Lane, S., "Gender related differential item functioning on a middle‐school mathematics performance assessment" 15 (15): 21-27, 1996

23 Gamer, M., "Gender differences in performance on multiple-choice and constructed response mathematics items" 12 (12): 29-51, 1999

24 Engelhard, G., "Gender differences in performance on mathematics items: Evidence from the United States and Thailand" 15 (15): 13-26, 1990

25 Leahey, E., "Gender differences in mathematical trajectories" 80 (80): 713-732, 2001

26 Calvert, T., "Exploring differential item functioning(DIF) with the Rasch model: A comparison of gender differences on eighth-grade science items in the United States and Spain" Emory University 2002

27 Scherbaum, C. A., "Examining the relationship between race-based differential item functioning and item difficulty" 68 (68): 537-553, 2008

28 Kulick, E., "Examining the relationship between differential item functioning and item difficulty" ETS 1989

29 Hou, L., "Differential item functioning assessment in cognitive diagnostic modeling: Application of the Wald test to investigate DIF in the DINA model" 51 (51): 98-125, 2014

30 Angoff, W. H., "Differential item functioning" Lawrence Erlbaum 3-24, 1993

31 Boughton, K. A., "Differential bundle functioning on mathematics and science achievement tests: A small step toward understanding differential performance" Canadian Society for Studies in Education 24-27, 2000

32 Rupp, A. A., "Diagnostic measurement: Theory, methods, and applications" Guilford Press 2010

33 Zhang, W., "Detecting differential item functioning using the DINA model" University of North Carolina 2006

34 Gierl, M. J., "Defining characteristics of diagnostic classification models and the problem of retrofitting in cognitive diagnostic assessment" 6 (6): 263-275, 2008

35 Choi, Y., "DIF analysis using a mixture 3PL model with a covariate on the TIMSS 2007 mathematics test" 1 (1): 4-14, 2014

36 Robitzsch, A., "CDM: Cognitive Diagnosis Modeling"

37 Li, X., "Assessment of differential item functioning under cognitive diagnosis models: The DINA model example" 52 (52): 28-54, 2015

38 Jun, H. J., "An integrated approach to detecting and assessing potential causes of differential functioning at the item and test level" Ewha Womans University 2010