웹기반 형성적 동료평가 시스템 개발을 위한 설계기반 연구 = Design-Based Research on the Development of Web-Based Formative Peer Assesment System

다국어 초록 (Multilingual Abstract)

The purpose of this study was to design and develop web-based formative peer assessment system. For the purpose, this study employed design-based research method. First of all, researcher developed formative peer assessment model to establish the theoretical framework for the system. Then, she developed the first-round design principles based on the model. The first system with the first-round design principles was developed and implemented in an actual classroom. After the first field study, researcher found a few drawbacks of the system such as unnecessary learning step, no supports for reducing cognitive load, and lack of direct interaction between assessor and assessee. Based on the results, researcher derived a few design & development principles for the second formative peer assessment system. The design & development principles were the followings: deleting unnecessary learning steps to avoid time-consuming work, providing instructor`s customized guidance to reduce learners` cognitive overload, and providing back-feedback opportunity to make actual interaction with peers. The second system was implemented in the classroom again. In addition to the two times field study, expert reviews were used to correct different perspectives toward the system. Finally developed web-based formative peer assessment system is unique in that it allows instructors to design their own peer assessment activities, and it has intuitive menu tabs showing formative learning processes.

참고문헌 (Reference)

1 이용숙, "교육에서의 질적 연구" 교육과학사 1999

2 Cho, K., "Validity and reliability of peer assessment with a missing data estimationt echnique. Paper presented at the ED-Media, Hawaii"

3 Collins,A., "Towards a design science of education" New directions in educational technology 15-22, 1992

4 Orsmond, P., "The use of student derived marking criteria in peer and self-assessment" 25 (25): 23-38, 2000

5 Dochy, F., "The use of self-, peer and co-assessment in higher education: A review" 24 (24): 331-350, 1999

6 Orsmond, P., "The use of exemplars and formative feedback when using student derived marking criteria in peer and self-assessment" 27 (27): 309-323, 2002

7 Sluijsmans, D. M. A., "The training of peer assessment skills to promote the development of reflection skills in teacher education" 29 : 23-42, 2003

8 Steed,M., "The power of peer review in multimedia production" 11 (11): 237-250, 2002

9 Kim,M., "The effects of assessor's role and assessee's role on metacognitive awareness, performance, and attitude in a technology-related design task. Unpublished doctoral dissertation" Florida State University 2005

10 Smyth,K., "The benefits of students learning about critical evaluation rather than being summatively judged" 29 (29): 369-378, 2004

11 Falchikov, N., "Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks" 70 (70): 287-322, 2000

12 Rudy, D. W., "Self- and peer assessment in a first-year communication and interviewing course" 24 (24): 436-445, 2001

13 Falchikov,N., "Peer feedback marking: developing peer assessment" 32 (32): 175-187, 1995

14 Topping, K., "Peer assisted learning" Lawrence Erlbaum Associates 1998

15 Sluijsmans, D. M. A., "Peer assessment training in teacher education: effects on performance and perceptions" 27 (27): 443-454, 2002

16 Blom, D., "Peer assessment of tertiary music performance: opportunities for understanding performance assessment and performing through experience and self-reflection" 21 (21): 111-125, 2004

17 Hunter, D., "Peer assessment in performance studies" 13 : 67-78, 1996

18 Topping,K., "Peer assessment between students in colleges and universities" 68 (68): 249-276, 1998

19 Purchase,H.C., "Learning about interface design through peer assessment" 27 (27): 341-352, 2000

20 Keig,L., "Formative peer review of teaching: attitudes of faculty at liberal arts colleges toward colleague assessment" 14 (14): 67-87, 2000

21 Topping, K., "Formative peer assessment of academic writing between postgraduate students" 25 (25): 149-169, 2000

22 Reeves,T., "Enhancing the worth of instructional technology research through "Design Experiments" and other development research strategies" 2000

23 Tsai, C.-C., "Developing science activities through a networked peer assessment system" 38 : 241-252, 2002

24 Ballantyne, R., "Developing procedures for implementing peer assessment in large classes using an action research process" 27 (27): 427-441, 2002

25 Pedersen,S., "Designing and Researching Enhancements for Online Learning: A Commentary on Veal, Brantley, and Zulli" 4 (4): 163-172, 2004

26 Brown,A.L., "Design experiments:Theoretical and methodological challenges in creating complex interventions in classroom settings" 2 (2): 141-178, 1992

27 Richey, R., "Design and Development Research: Methods, Strategies, and Issues" Lawrence Erlbaum Associates 2007