기술과 수행평가에서 학습자 중심 루브릭이 채점 결과의 신뢰도에 미치는 영향 = The Influence of Student-Generated Rubrics on Reliability of Grade Result in Technology Education Assessment

다국어 초록 (Multilingual Abstract)

The purpose of this study was to analysis influence of student-generated rubrics on reliability of grade result in technology education assessment. To achieve the purpose of this study, the result of teacher-evaluation, self-evaluation and peer-evaluation was analysed between groups used student-generated rubrics and didn't used it., and cognition for effectiveness of student-generated rubrics such as decrease of subjectivity for evaluation result etc. was analysed among two groups.
The study was carried out through literature review on rubrics, rubrics' effetiveness, experimental research, survey method. 6 classess of 2nd grade of middle school in Seoul were divided into two experimental groups and control group in order to reach the goal of this study.
The nonequivarent control group design model of quasi-experimental design was utilized for this experimental study. Performance of the experimental group 1 was evaluated using student-generated rubrics developed through negotiation between teacher and students. The experimental group 2 was lopisidedly presented the rubrics developed by experimental group 1 by their teacher to be evaluated. Performance of the control group was evaluated without any rubrics. This experiment was executed for 7 classes, the first class included the development of student-generated rubrics. Making the arm of a robot, including designing a new thing and sketching, was executed for 4 classes.
The findings of the study were as follows:
First, the correlation analysis results of experimental group 1 were more than those of experimental group 2 and control group for the result of teacher-evaluation, self-evaluation and peer-evaluation.

Second, to show only a rubrics without process of negotiation between teacher and students is no more effective, so student-generated rubrics will be a plan to recover reliability for result of teacher evaluation in performance assessment.

국문 초록 (Abstract)

이 연구의 목적은 기술과 수행평가에서 학습자 중심 루브릭이 채점 결과의 신뢰도에 미치는 영향을 분석하는 것이다. 이 연구의 목적을 달성하기 위해 학습자 중심 루브릭을 이용한 집단과 그렇지 않은 집단간에 평가 주체간의 평가 결과의 일치도를 분석하고, 학습자 중심 루브릭을 이용한 집단과 그렇지 않은 집단간에 학생들의 평가 결과의 신뢰도에 대한 인식 차이를 분석하였다. 이 연구에서는 루브릭과 루브릭의 효과에 대한 문헌연구와 함께 실험연구, 조사연구가 수행되었다. 실험연구의 경우 서울 지역에 있는 중학교 2학년 6개 학급을 2개의 실험집단과 한 개의 통제집단으로 나누어 수행하였다. 실험설계는 준실험설계의 일종인 이질통제집단설계 모형을 이용하였다. 실험집단1은 교사와 학생간에 협상을 통해 개발된 학습자 중심 루브릭을 이용하여 평가되었고, 실험집단2에는 실험집단1에 의해 개발된 루브릭이 제시되었다. 반면에 통제집단에는 어떠한 루브릭도 제시되지 않았다. 이 실험연구는 7차시 동안 수행되었는데, 1차시에는 학습자 중심 루브릭의 개발 과정이 포함되었고 4차시 동안에는 로봇팔 만들기를 수행하였다. 이 연구의 결과는 다음과 같다. 첫째, 교사 평가, 자기평가, 동료평가의 결과에 대한 실험집단1의 상관관계가 실험집단2와 통제집단의 상관관계보다 더 높다는 것을 알 수 있었다. 둘째, 교사와 학생간 협상의 과정 없이 루브릭을 제시해 주는 것은 수행평가에서 평가 결과의 신뢰도에 효과적이지 못하다. 따라서 학습자 중심 루브릭은 평가 결과의 신뢰도를 회복하는 하나의 방안이 될 수 있을 것이다.

참고문헌 (Reference)

1 "지식기반사회에 대비한 기술교과 교육의 과제와 개선 방향" 1 (1): 11-34, 2001

2 "제7차 교육과정에 따른 성취기준과 평가기준 개발 연구: 중학교 기술가정" 한국교육과정평가원 2000

3 "기술과 교육평가에서 학습자 중심 루브릭이 학습과정 및 학업성취에 미치는 영향" 2004

4 "구성주의 관점에서의 기술과 교육의 수업 전략" 24 (24): 181-197, 1999

5 "과제 수행평가의 이론적 기조" 26-49, 1999

6 "Using Rubrics; Teacher to Teacher : Ohio Literacy Resource Center. ERIC Document Reproduction Service No. ED458392." Ohio Literacy Resource Center 2001

7 "Using Rubrics to Promote Thinking and Learning" 57 (57): 13-18, 2000

8 "Understanding Rubrics" 54 : 14-17, 1997

9 "The importance of providing background information on the structure and scoring of performance assessment" 13 (13): 2000

10 "The Role of Instructional Rubrics and Self-Assessment in Learning To Write: A Smorgasbord of Findings" 1999

11 "The Effect of Rubric on the Portfolio Assessment Process" Doctoral Dissertation Boston University 1999

12 "The Art and Science of Classroom Assessment: The Missing Part of Pedagogy" The George Washington University 27 (27): 1999

13 "Student-Generated Rubrics: An Assessment Model to Help All Students Succeed" Dale Seymour Publications 1998

14 "Sharing Scoring Guides." 2001

15 "Scoring rubrics: An assessment option" 15 (15): 44-45, 1992

16 "Scoring Rubrics: What, When and How?" 7 (7): 2000

17 "Scoring Rubrics in the Classroom; Using Performance Criteria for Assessing and Improving Student Performance" Corwin Press 2001

18 "Rubrics: Design and Use in Science Teacher Education" 1998

19 "Rubrics: A Cross-Curricular Approach to Assessment" A Handbook for Construction and Use The Scarecrow Press Inc 2001

20 "Rubrics, Scoring Guides, and Performance Criteria: Classroom Tools for Assessing and Improving Student Learning" 2000

21 "Rubrics : Models of Evaluation within a Constructivist Learning Environment" 2001

22 "National Science Education Standards" National Academy Press 1996

23 "How to assess student performance in science: Going beyond multiple-choice tests" University of North Carolina 1993

24 "Experimental and Quasi-Experimental Design for Research on Teaching Handbook of Research on Teaching" 1963

25 "Classroom assessment: What teachers need to know" Allyn and Bacon 1995

26 "Can performance-based student assessments be psychotically sound?" Univ of Chicago press 1996

27 "Authentic assessment: The key to unlocking student success" Technomic 1995

28 "Authentic Assessment: A handbook for educators" Addision-Wesley 1994

29 "Assessing Learning in the Classroom" National Education Association 1994

30 "A practical guide to alternative assessment" ASCD 1992