한국과 미국 국가수준 학업성취도 평가의 성취수준 비교 = Validity of NAEA Achievement Levels compared with NAEP and TIMSS

다국어 초록 (Multilingual Abstract)

The purpose of this study was to evaluate validity of achievement levels in National Assessment of Educational Achievement (NAEA) compared with NAEP and TIMSS.Even though each testing program had unique purpose and framework, the results of NAEA for 9th grades were analyzed in terms of definitions of achievement levels and relative locations of cut-off scores (z scores). As results, the percentage of NAEA ``advanced level`` was too high and the percentage of ``below basic`` was too low by considering the results of NAEP. NAEA reported that Korean students made positive changes in terms of knowledge and skills, while no progress was found in the Korean data of TIMSS. These inconsistent results were rooted in variations of the definitions of achievement levels and location of cut-off scores. Also, it seemed to be related to knowledge focused achievement level descriptions, relatively high cut-off scores of ``advanced level``, and lower cut-off scores of ``basic level`` in NAEA compared with NAEP and TIMSS. So periodical validation studies on achievement levels should be conducted by considering changes of test contents, formats and scale scores of NAEA. In addition, the limitations of the current study and suggestions for further research were provided.

참고문헌 (Reference)

1 이화진, "기초학력 미달 여부에 영향을 미치는 요인 분석 - 학력향상 중점학교 유형별 비교" 한국교육과정평가원 14 (14): 151-176, 2011

2 조지민, "국가수준 학업성취도 평가연구 - 2003∼2006년 변화 추이" 한국교육과정평가원 2007

3 김경희, "국가수준 학업성취도 평가에 나타난 우리나라 학력 향상의 특성 분석" 한국교육과정평가원 2011

4 박정, "국가수준 학업성취도 평가 변화 추이 (2003-2005년) -중학교 3학년" 한국교육과정평가원 2006

5 김성숙, "국가수준 학업성취도 평가 개선 연구" 한국교육과정평가원 2009

6 김경희, "교육정보 공시 위한 향상도 산출 모형 탐색과 향후 전망" 한국교육과정평가원 2011

7 CELE, "Uncommon Measures: Equivalent and Linkage among educational Tests" National Academy 1999

8 NCES, "The National Report Card: Mathematics 2009" NCES 2010

9 Martin, M. O., "TIMSS 2007 International Science Report: Findings from IEA;s Trends in International Mathematics and Science Study at the Fourth and Eighth Grade" Boston College 2008

10 Mullis, I. V. S, "TIMSS 2007 International Mathematics Report: Findings from IEA;s Trends in International Mathematics and Science Study at the Fourth and Eighth Grade" Boston College 2008

11 McLaughlin, D., "Study of the linkage of 1996 NAEP and State Mathematics assessment in four states" American Institute for Research 1998

12 Cizek, G. J., "Standard Setting" Sage 2007

13 Angoff, W. H., "Scales, norms, and equivalent scores, In Educational Measurement" American Council on Education 508-600, 1971

14 U.S. Department of Education, "Grade 4, 8, 12 National Reports"

15 Linn, R. L., "Educational accountability systems. In The Future of Test-Based Educational Accountability" Routledge 3-24, 2008

16 Hong, W-P., "Does high-stakes testing increase cultural capital among low-income and racial minority students" 16 (16): 2007

17 National Assessment Governing Board, "Developing student performance levels for the national assessment of educational progress policy statement" Author 1995

18 Linn, R. L., "Conflicting demands of No Childe Left Behind and State Systems: Mixed Messages about school performance" 13 (13): 2005

19 McCombs, J. S, "Achieving state and national literacy goals, a long uphill road. TR-180" Rand 2004

20 Linn, R. L., "Accountability: Responsibility and reasonable expectations" 32 (32): 3-13, 2003

21 Bourque, M. L., "A history of NAEP achievement levels: Issues, implementation, and impact 1989-2009" 2009

22 교육과학기술부, "2010 교과부 업무보고: 교육과학기술 선진화로 세계인류국가 도약" 교육과학기술부 2009

23 김성숙, "2009년 국가수준 학업성취도 평가 전수분석 결과 - 중학교 3학년" 한국교육과정평가원 2010

24 정구향, "2003년 국가수준 학업성취도 평가 연구 - 총론" 한국교육과정평가원 2004