한국어능력시험의 성별에 따른 차별기능문항 분석 = Detecting the Differently Functioned Items by Gender on the Test of Proficiency in Korean

다국어 초록 (Multilingual Abstract)

Chang EunaYang Kilsoek. 2006. 10. 30. Detecting the Differently Functioned Items by Gender on the Test of Proficiency in Korean. Bilingual Research 32, 291-324. The main purposes of this paper are to investigate Differently Functioned Items according to gender and to identify the characteristics of each item. In order to achieve the above goals, the results of three Tests(7th, 8th, and 9th test) of Proficiency in Korean are used. SIBTEST based on The Item Response Theory is applied to extract Differently Functioned Items from the tests. The major results of this study is two-folded: First, there are several Differently Functioned Items influenced by gender for area of vocabularygrammar, writing, listening, and reading, respectively. Second, there are distinctive difference between men and women in terms of item contents, item pattern, answer sheet pattern, and text type. From the results, it is recommended for the more fair and reliable test to consider the characteristics and causes of Differently Functioned Items by in-depth analysis.(Language Education Institute of Seoul National UniversityKorea Institute of Curriculum and Evaluation)

참고문헌 (Reference)

1 김왕규, "한국어능력시험의 평가기준개발연구" 한국교육과정평가원 2002

2 조인옥, "한국어능력시험의 언어권별 수험자 반응분포에 대한 연구" 연세대학교 2000

3 우혜령, "한국어능력시험의 문항에 대한 연구-제2회 한국어능력시험 1급 읽기 영역 문항분석을 중심으로-" 이화여자대학교 2000

4 김정숙, "한국어능력시험의 등급별 합격 점수 및 채점 기준 설정 방안 연구" 한국교육과정평가원 2005

5 이해영, "한국어능력시험 문항 유형 개발을 위한 기초 연구-문항 개발을 위한 지침서-" 한국교육과정평가원 2006

6 진수정, "차별기능문항에 대한 연구" 이화여자대학교 2003

7 성태제, "차별기능문항 추출을 위한 Raju 방법과 Mantel-Haenszel 방법의 비교 연구" 6 (6): 91-120, 1993

8 송미영, "수행평가도구의 성별에 따른 차별기능문항 추출 및 추출방법 비교" 이화여자대학교 2000

9 김석우, "성별 및 전공 계열에 따른 차별기능문항에 관한 연구" (7) : 45-64, 1994

10 한국교육학회 교육평가연구회, "교육 측정 평가․연구․통계 용어사전" 서울: 중앙교육진흥연구소 1995

11 Scheuneman, J. D, "Using differential Item Functioning procedure to explore sources of item difficulty and group performance characteristics" 27 (27): 109-131, 1990

12 Raju, N. S, "The area between two item characteristic curves" (53) : 495-502, 1988

13 Harris, A. M, "Patterns of gender differences on mathematics items on the Scholastic Aptitude Test" 6 (6): 137-151, 1993

14 추정아, "Mantel-Haenszel 방법과 Raju 방법에 의한 제4차, 제5차 대학수학능력시험 실험평가의 성별에 따른 차별기능문항 추출" 6 (6): 259-286, 1993

15 O Neil, K, "Item and test characteristics that are associated with differential item functioning : Differential item functioning" Hillsdale, NJ: Erlbaum 255-276, 1993

16 Altenhof, J. C, "Influenced of item characteristics on male and female performance on SAT-Math" City University of New York 1984

17 Jensen, A. R, "How much can we boost IQ and scholastic achievement?" (39) : 81-83, 1969

18 Clements, D. H, "Geometry and spatial reasoning : Handbook of research on mathematics teaching and learning" New York: Macmillan 420-464, 1992

19 Doolittle, A. E, "Gender-based differential item performance in mathematics achievement items" 24 (24): 157-166, 1987

20 Lane, S, "Gender-Related Differential Item Functioning on Middle-School Mathematics Performance Assessment : Educational Measurement: Issues and Practice" 21-27, 1996

21 Ryan, K. E, "Examining Gender DIF on a Multiple-Choice Test of Mathematics: A Confirmatory Approach" 15 (15): 15-20, 1996

22 Holland, P. W, "Differential Item Performance and the Mantel-Haenszel Procedure : Test Validity" Hillsdale NJ: Erlbaum 129-145, 1998

23 Raju, N. S, "Determining the significance of estimated signed and unsigned areas between two item response functions" (14) : 197-207, 1990

24 Swaminathan, H, "Detecting differential item function using logistic regression procedures" (27) : 361-370, 1990

25 Dolon, T. F, "Content factors in sex differences on test questions : Research Memorandum" Princeton, NJ: Educational Testing Service 73-78, 1973

26 Camilli, G, "A critic of the chi-square method assessing item bias"

27 성태제, "1994학년도 제1차 대학수학능력시험의 성별에 따른 차별기능문항 추출" 7 (7): 87-101, 1994