학생건강체력평가의 준거설정

국문 초록 (Abstract)

이 연구는 최근 개발된 학생건강체력평가 종목의 준거설정을 위한 연구로 확장된 Angoff 방법을 이용하여 기존 학생체력장에 포함되지 않았던 새로운 종목인 페이서, 윗몸말아올리기, 무릎대고 팔굽혀펴기의 준거인 최소건강수준을 설정하였다. 중학교 체육교사 3명과 체육학을 전공한 체력관련 연구자 3명으로 구성된 전문가 패널을 대상으로 확장된 Angoff 방법(Hambleton & Plake, 1995)을 적용하여 최소건강수준인 준거를 설정하였다. 또한 인천지역 1개 중학교(n=1393) 학생을 대상으로 실제 검사종목을 실시하여 패널들의 준거설정 참고자료로 제공하였고 최종 설정된 준거와 학생들의 수행 결과를 비교하였다. 준거설정자간 신뢰도는 상관계수와 일원분산분석을 실시하여 확인하였다. 연구결과 페이서는 외국의 체력검사 준거와 다소 차이가 나타났지만 윗몸말아올리기는 비교적 유사한 결과가 나타났다. 준거설정자간 신뢰도를 확인할 수 있는 상관계수는 전반적으로 높게 나타나서 평정경향은 대체적으로 일관된 것을 확인할 수 있었다. 일원분산분석 결과 윗몸말아올리기를 제외한 페이서와 무릎대고 팔굽혀펴기에서 준거설정자간 유의한 차이가 있는 것으로 나타났다. 이 연구에서 최소건강수준을 설정하기 위해 사용된 확장된 Angoff 방법은 체육분야 수행관련 검사 기준을 설정하는 새로운 대안으로 이용될 수 있을 것이다.

다국어 초록 (Multilingual Abstract)

Setting standards, known also as "cut-off score", is most important procedure in test construction and practice. The purpose of this study is setting performance standards-criterion for the fitness test in Physical Activity Promotion System(PAPS). 1393 junior high school students were selected as a sample to perform 3 tasks-PACER, curl-up, and modified push up. The extended Angoff method was applied for setting criterion, the minimal healthy level. Three junior high school PE teachers and three fitness experts were recruited as a panel for the extended Angoff method. 6 Panels are asked to estimate the possible scores that students with minimal competence level will likely to achieve on the fitness tests. The cut-off score was determined from the mean of 6 panel`s judgment scores based on the result of round 2. In results, the cut-off score was different with other fitness test such as Fitnessgram. The interrater reliability were significantly different in the test of Pacer and modified push-ups. The extended Angoff method would be useful tool for setting performance standards in physical education and exercise science.

참고문헌 (Reference)

1 강재현, "한국의 비만 추이" 11 : 329-336, 2002

2 교육인적자원부, "학생체력검사 결과 비교" 교육인적자원부 학교정책과 2002

3 김종택, "체육평가와 준거지향검사" 14 : 87-100, 1993

4 김미예, "체육분야 수행관련 검사의 평가기준 설정" 한국체육측정평가학회 9 (9): 1-11, 2007

5 양길석, "준거지향평가의 준거 설정 방법 비교－중학교 논술 기초능력 검사를 중심으로" 13 : 107-133, 2000

6 신승윤, "준거지향검사의 연구과제" 1 : 19-33, 1999

7 인천시교육청, "맞춤형 학생건강 체력평가 시스템 구축" 교육인적자원부 2007

8 김목수, "대학 육상경기 전공수업 평가를 위한 준거지향 기준치 설정" 한국체육학회 42 (42): 519-530, 2003

9 육동원, "군체력 검사의 준거지향 기준설정:사병을 중심으로" 40 : 875-884, 2001

10 Hambleton, R. K, "Using an extended Angoff procedure for setting standards on comple×performance assessments" 8 : 41-55, 1995

11 Linn,R.L, "The likely impact of performance standards as a function of uses: From rhetoric to sanctions" Paper presented at the Joint Conference on Standard Setting for Large-Scale Assessments, Washington, DC 1994

12 Lewis, D. M, "Standard setting: A Bookmark approach. In D. R. Green, IRT-based standard setting procedures utilizing behavior anchoring" Symposium presented at the 96 Council of Chief State School Officers National Conference in Large-scale Assessment, Phoenix, AZ 1996

13 Cizek, G. J, "Standard setting" Sage Publication 2007

14 Cizek, G. J, "Setting performance standards: Contemporary methods" 23 : 31-50, 2004

15 Angoff,W.H, "Scales, norms, and equivalent scores. Educational measurement, 2nd" Washington, DC: American Council on Education 508-600, 1971

16 Livingston, S. A, "Passing scores: A manual for setting standards of performing on educational and occupational tests" Princeton, NJ: Educational Testing Service 1982

17 Looney, A, "Passing rates of American children and youth on the FITNESSGRAM criterion-referenced physical fitness standards" 61 : 215-223, 1990

18 Vos,H, "Methods of setting standards for comple×performance-based assessment International" 14 : 111-120, 2004

19 Zieky, M. J, "Manual for setting standards in the basic skill assessment tests" Princeton, NJ: Educational Testing Service 1977

20 Safrit, M. J, "Issues in setting motor performance standards" 32 : 152-162, 1980

21 The Cooper Institute, "Fitnessgram/Activitygram Test Administration Manual, 4th" IL: Human Kinetics 2007

22 Ebel,R.L, "Essentials of educational measurement" Englewood Cliffs, MJ: Prentice-Hall 1972

23 Berk,R.A, "Determinant of optical cutting scores in criterion-referenced measurement" 45 : 4-9, 1976

24 Looney,M, "Criterion-referenced measurement: Reliability, Measurement concepts in physical education and exercise science" Champaign, IL: Human Kinetics 137-152, 1989

25 Safrit,M, "Criterion-referenced measurement: Application in physical education" 2 : 21-35, 1977

26 Jaeger,R.M, "Certification of student competence. Educational Measurement, 3rd" American Council on Education & Macmillan Publishing Company 485-514, 1989

27 김태은, "Angoff와 북마크 방법에 의한 준거설정의 적용가능성 비교" 이화여자대학교 2005

28 Plake,B.S, "An integration and reprise: What we think we have learned" 8 : 85-91, 1995

29 Nedelsky,L, "Absolute grading standards for objective test" 14 : 3-19, 1954

30 Jaeger,R.M, "A proposal for setting a standards on the North Carolina High School Competency test" Paper presented at the spring meeting of the North Carolina Association for Research in Education, Chaper Hill 1978

31 Berk,R.A, "A consumer's guide to setting performance standards on criterion-referenced tests" 56 : 137-172, 1986