통계적 기법을 이용한 집단 협업 프로젝트에서의 공정한 동료 평가 방법론에 대한 연구 = Equitable Peer Assessment Method in Collaboration Project Using Statistical Technique

다국어 초록 (Multilingual Abstract)

For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however, statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor's reliability. The gist of our proposed algorithm is that an assessor's reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.

목차 (Table of Contents)

• Abstract
• 1. 서 론
• 2. 기존 연구
• 3. 일관성과 공정성
• 4. 제안 알고리듬
• 5. 사례 분석
• 5. Conclusion
• Acknowledgements

참고문헌 (Reference)

1 고성석, "온라인 협업 시스템의 품질관리 체계에 대한 연구" 한국산업경영시스템학회 33 (33): 127-132, 2010

2 Michaelsen, L. K., "Team learning : a comprehensive approach for harnessing the power of small groups in higher education" 11 : 107-122, 1994

3 Raban, R., "Supporting peer assessment of individual contributions in groupwork, Proc" 685-694, 2007

4 Panchal, J., "Product Realization in The Age of Mass Collaboration, Proc" 3-6, 2008

5 Freeman, M., "Peer assessment by groups of group work" 20 : 289-299, 1995

6 Herbet, N., "Peer assessment : Is it fair?" 2006

7 Topping, K.J., "Peer Assessment"

8 Parsons, D., "Justice in the Classroom : Peer Assessment of Contributions in Group Projects, Proc" 145-151, 2004

9 Marjo van Zundert, "Effective peer assessment processes : Research findings and future directions" 20 : 270-279, 2009

10 Gehringer, E. F., "Assessing Studentsʼ Wiki Contributions" 2008

11 Kennedy, J.G., "-assessment in Group Projects : Is It Worth It?" 42 : 2005