현업 HRD 담당자들의 Kirkpatrick 평가 모형에 대한 인식: 적용 현장에서의 장점, 한계, 개선 방향을 중심으로 = HRD practitioners` recognition of the Kirkpatrick evaluation model: Focused on strengths, limits, and improvements

다국어 초록 (Multilingual Abstract)

The purpose of this study was to suggest complements of Kirkpatrick evaluation model for applying in HRD field. To achieve the purpose, literature review and focused group interview was implemented two times in order to explore strengths, limits, and improvements about Kirkpatrick evaluation model. 16 HRD practitioners attended in FGI. Interview results were recorded and analyzed for deducting significant keywords and categorizes. Based on the findings, strengths, limits, and improvements of Kirkpatrick evaluation model were described. The complements of Kirkpatrick evaluation model were suggested with following dimensions: designing and conducting evaluation to align course objectives, systematic evaluation implementation, ensuring the objectivity and reliability of evaluation, and improving utilization of evaluation results.

참고문헌 (Reference)

1 홍계훈, "훈련에 대한 개인수준에서의 반응평가 모델 개발: Kirkpatrick의 모델을 기초로 하여" 한국인사관리학회 32 (32): 1-27, 2008

2 박소연, "평가에 대한 HRD 이해관계자들의 인식 탐구 : Q 방법론을 중심으로" 한국인력개발학회 12 (12): 95-117, 2010

3 배을규, "통합적 평가 접근법을 활용한 HRD 프로그램 평가 모형 개발: 학교·사회 예술강사 기본 연수 평가 모형 개발 사례를 중심으로" 한국인력개발학회 16 (16): 25-50, 2014

4 김대영, "중소기업의 구조화된 현장 훈련(SOJT) 프로그램에 대한 이해관계자 집단의 평가 요구 비교 분석: 논리 지향 평가 모형을 중심으로" 한국경영학회 16 (16): 203-230, 2012

5 배을규, "인적자원개발론" 학이시습(커뮤니케이션북스) 2009

6 이원석, "우리는 왜 프로그램을 평가하는가?" 한국교육평가학회 26 (26): 1-13, 2013

7 김대영, "논리 지향 평가 실행 수준과 평가 결과 활용의 관계에 대한 평가의 질의 조절 효과 : 중소기업 구조화된 현장 훈련(SOJT) 프로그램을 중심으로" 한국인력개발학회 15 (15): 165-194, 2013

8 배호순, "교육프로그램 평가론" 원미사 2008

9 김정원, "공무원교육의 현업적용도 제고방안" 강원발전연구원 2010

10 진선미, "공무원 교육결과를 측정할 수 있는 평가방안 및 평가도구 개발 -서울시공무원교육원에서 운영하는 교육프로그램을 중심으로" 한국교육평가학회 18 (18): 187-212, 2005

11 민경석, "경찰교육훈련 평가지표에 관한 연구: Kirkpatrick 모형에 기반하여" 경찰학연구소 10 (10): 9-33, 2015

12 Patton, M. Q., "Utilization-focused evaluation: The new century text" Sage 1997

13 Brinkerhoff, R. O., "The success case method: A strategic evaluation approach to increasing the value and effect of training" 7 (7): 86-101, 2005

14 Holton, E. F., "The flawed four‐level evaluation model" 7 (7): 5-21, 1996

15 Bassi. L. J., "The 1999 ASTD state of the industry report" The American Society for Training and Development 1999

16 Kirkpatrick, D. L., "Seven keys to unlock the four levels of evaluation" 45 (45): 5-8, 2006

17 Newstrom, J. W., "Review of “Evaluating training programs: the four levels by D. L. Kirkpatrick.”" 6 (6): 317-320, 1995

18 Collins, D. B., "Performance-level evaluation methods used in management development studies from 1986 to 2000" 1 (1): 91-110, 2002

19 Phillips, J. J., "Measuring return on investment" American Society for Training and Development 1997

20 Kaufman, R., "Levels of evaluation: beyond Kirkpatrick" 5 (5): 371-380, 1994

21 Stokking, K. M., "Levels of evaluation: Kirkpatrick, Kaufman and Keller, and beyond" 7 (7): 179-183, 1996

22 Rossett, A., "Leveling the levels" 61 (61): 49-53, 2007

23 Alliger, G. M., "Kirkpatrick's levels of training criteria: Thirty years later" 42 (42): 331-342, 1989

24 Pershing, J. A., "Ineffective reaction evaluation" 12 (12): 73-90, 2001

25 Holton III, E. F., "Improving learning transfer in organizations" Jossey-Bass 2003

26 Kirkpatrick, D. L., "Implementing the four levels" Berrett-Koehler 2007

27 Wang, G. G., "Human resource development measurement and evaluation: Looking back and moving forward" 7 (7): 5-15, 2005

28 Wang, G. G., "Human resource development evaluation: Emerging market, barriers, and theory building" 7 (7): 22-36, 2005

29 Holton, E. F., "Holton's evaluation model: New evidence and construct elaborations" 7 (7): 37-54, 2005

30 박소연, "HRD 프로그램의 반응평가에 대한 메타평가 연구" 한국기업교육학회 10 (10): 119-137, 2008

31 박소연, "HRD 프로그램 평가 보고서의 내용 분석: 보고서의 형식과 실체를 중심으로" 한국기업교육학회 12 (12): 101-122, 2010

32 Krueger, R. A., "Focus groups: a practical guide for applied research" Sage 1994

33 Morgan, D. L., "Focus groups as qualitative research" Sage Publications 1997

34 Stufflebeam, D. L., "Evaluation theory, models and applications" Jossey-Bass 2007

35 Russ-Eft, D., "Evaluation in organizations: A systematic approach to enhancing learning, performance, and change" Perseus Publishing Services 2001

36 Kirkpatrick, D. L., "Evaluating training programs: the four levels" Berrett-Koehler 2008

37 Kirkpatrick, D. L., "Evaluating training programs: The four levels" Berrett-Koehler 1998

38 Kirkpatrick, D. L., "Evaluating training programs: The four levels" Berrett-Koehler 2006

39 Stufflebeam, D. L., "Educational evaluation and decision making" Peacock 1971

40 Kraiger, K., "Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation" 78 (78): 311-328, 1993

41 Alvarez, K., "An integrated model of training evaluation and effectiveness" 3 (3): 385-416, 2004

42 Sadler-Smith, E., "Adding value to HRD: Evaluation, investors in people and small firm training" 2 (2): 369-390, 1999

43 Bates, R., "A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence" 27 (27): 341-347, 2004

44 배을규, "A Pragmatic Evaluation Approach to Measure Training Efficiency and Effectiveness: Enhancing Utilization of Training Evaluation" 한국성인교육학회 6 (6): 79-101, 2003