통합적 평가 접근법을 활용한 HRD 프로그램 평가 모형 개발: 학교?사회 예술강사 기본 연수 평가 모형 개발 사례를 중심으로 = A Case Study on Integrative Evaluation Model of Basic Training Program for Arts and Culture Instructors in Korea Arts and Culture Service

다국어 초록 (Multilingual Abstract)

The purpose of this study was to describe the process and results of developing an evaluation model for HRD program by applying some evaluation approaches, that is, objectives-oriented, goal-free, utilization-focused, and theory-driven(logic model) ones, and discuss how relevant evaluation approaches were selected and why those approaches were used integratively for evaluating HRD program. The target of this study was ``Basic Training Program`` provided by Korea Arts and Culture Service, in which experienced artists would be intensively trained for acting as professional instructors in the field of arts and culture. This study was proceeded as follows. First, key stakeholders were identified to understand the context of the program and draw evaluation needs from them. Second, four major evaluation approaches were chosen to reflect evaluation needs through talking with stakeholders. Third, using those approaches, evaluation criteria and indicators were decided and specified, which resulted in a evaluation logic model. Several implications were then suggested for planning and implementing evaluation in the field of HRD.

참고문헌 (Reference)

1 배호순, "학교교육과정 평가설계의 합리화를 위한 프로그램논리의 적용" 한국교육평가학회 16 (16): 1-22, 2003

2 이원석, "프로그램 평가에서의 맥락(context)과 일반화(generalization): 의의와 조화 가능성" 한국교육평가학회 24 (24): 73-88, 2011

3 김주후, "프로그램 논리중심의 평가적용: TALENT 프로젝트의 사례를 중심으로" 한국교육평가학회 17 (17): 1-14, 2004

4 박소연, "프로그램 논리에 기반한 산업안전교육현황 및 논리 분석" 한국산업교육학회 21 (21): 49-68, 2010

5 이원석, "타당도 분석을 위한 평가적 접근 모형: 통합적 관점" 한국교육평가학회 22 (22): 1079-1099, 2009

6 김대영, "중소기업의 구조화된 현장 훈련(SOJT) 프로그램에 대한 이해관계자 집단의 평가 요구 비교 분석: 논리 지향 평가 모형을 중심으로" 한국경영학회 16 (16): 203-230, 2012

7 배을규, "인적자원개발론" 학이시습(커뮤니케이션북스) 2009

8 배을규, "육군 위탁교육 성과관리 체계 수립 연구 보고서" 육군본부 2011

9 이원석, "우리는 왜 프로그램을 평가하는가?" 한국교육평가학회 26 (26): 1-13, 2013

10 조대연, "설문조사를 통한 요구분석에서 우선순위결정 방안 탐색" 교육문제연구소 35 (35): 165-187, 2009

11 배을규, "문화예술교육 전문 인력의 프로티언 경력 태도가 경력 만족에 미치는 영향: 자기주도학습 능력의 조절 효과" 한국성인교육학회 17 (17): 91-113, 2014

12 김대영, "논리 지향 평가 실행 수준과 평가 결과 활용의 관계에 대한 평가의 질의 조절 효과 : 중소기업 구조화된 현장 훈련(SOJT) 프로그램을 중심으로" 한국인력개발학회 15 (15): 165-194, 2013

13 박소연, "기업의 조직풍토가 프로그램 평가 결과 활용에 미치는 영향" 7 (7): 27-46, 2005

14 배을규, "기업 교육훈련 평가의 동향과 과제 - 무엇을 어떻게 평가할 것인가?" 한국산업인력공단 2012

15 장희영, "교회부모교육 프로그램에 대한 논리주도 평가연구" 한국기독교교육정보학회 26 (26): 291-314, 2010

16 배호순, "교육프로그램 평가론" 원미사 2008

17 Patton, M. Q., "Utilization-focused Evaluation: The new century text" Sage 1997

18 Brinkerhoff, R. O., "Training impact evaluation that senior managers believe and use. TU320" ASTD 2008

19 Robinson, D. G., "Training for Impact: How to link training to business needs and measure the results" Jossey Bass 1989

20 Chen, H. T., "Theory-driven evaluations" Sage 1990

21 Weiss, C. H., "Theory-based evaluation : Past, present, and future" 76 : 41-55, 1997

22 Christie, C. A., "The user-oriented evaluator’s role in formulating a program theory : Using a theory-driven approach" 24 (24): 373-386, 2003

23 Bledsoe, K. L., "The use of multiple evaluation approaches in program evaluation" 26 (26): 302-319, 2005

24 Cooksy, L. J., "The program logic model as an integrative framework for a multimethod evaluation" 24 (24): 119-128, 2001

25 Yarbrough, D. B., "The program evaluation standards" Sage 2011

26 Turnbull, B., "The mediating effect of participation efficacy on evaluation use" 22 (22): 131-140, 1999

27 Towns, D. P., "The journey to urban school success:Going the extra mile" 70 (70): 4-18, 2001

28 Wick, W., "Six Disciplines of Breakthrough Learning : How to Turn Training and Development into Business Result" John Wiley & Sons International Right, Inc 2010

29 Scriven, M., "School evaluation" McCutchen Publishing 1973

30 Kirkpatrick, W., "ROE Part 2: The new world Kirkpatrick Four Levels. TU216" ASTD 2013

31 Kirkpatrick, J. D., "ROE Part 1: The ultimate demonstration of training value. M215" ASTD 2013

32 Merriam, S. B., "Qualitative research: A guide to design and implementation" Jossey-Bass 2009

33 Creswell, J. W., "Qualitative inquiry and research design: Choosing among five approaches" Sage 2007

34 Donaldson, S. I., "Program theory-driven evaluation science: Strategies and applications" Psychology Press, Taylor & Francis Group 2007

35 Chen, H. T., "Practical program evaluation: Assessing and improving planning, implementation, and effectiveness" Sage 2005

36 Bickman, L., "New Directions for Program Evaluation, 33" Jossey-Bass 5-18, 1987

37 Scriven, M., "Minimalist theory : The least theory that practice requires" 19 (19): 57-70, 1998

38 Chavis, D., "Looking the enemy in the eye: Gazing into the mirror of evaluation practice" 9 (9): 8-9, 2004

39 McLaughlin, J. A., "Logic models : A tool for telling your programs performance story" 22 (22): 65-72, 1999

40 Phillips, J. J., "Handbook of training evaluation and measurement methods" Gulf Publishing Company 1997

41 McLaughlin, J. A., "Handbook of practical program evaluation" Jossey-Bass 55-80, 2010

42 Wholey, J. S., "Handbook of practical program evaluation" Jossey-Bass 2010

43 박소연, "HRD 프로그램의 반응평가에 대한 메타평가 연구" 한국기업교육학회 10 (10): 119-137, 2008

44 박소연, "HRD 프로그램의 논리 주도적 평가 체제 개발" 안암교육학회 13 (13): 243-268, 2007

45 박소연, "HRD 프로그램 평가의 질이 평가결과 활용에 미치는 영향" 한국인력개발학회 11 (11): 27-47, 2009

46 배을규, "HRD 실무자를 위한 교육훈련 프로그램 평가" 학이시습 2012

47 Swanson, R, A., "Foundations of human resource development" Berrett-Koehler 2001

48 Rossi, P. H., "Evaluation: A systematic approach" Sage 2004

49 Stufflebeam, D. L., "Evaluation theory, models and applications" Jossey-Bass 2007

50 Rogers, P. J., "Evaluation models: Viewpoints on educational and human services evaluation" Kluwer Academic Pub 209-232, 2000

51 Russ-Eft, D., "Evaluation in organizations: A systematic approach to enhancing learning, performance, and change" Perseus Publishing Services 2001

52 Kirkpatrick, D. L., "Evaluating training programs: The four levels" Berrett-Koehler 2006

53 Donaldson, S. I., "Evaluating social programs and problems: Visions for the new millenium" Erlbaum 2002

54 Chen, H. T., "Current trends and future directions in program evaluation" 15 (15): 229-238, 1994

55 Smith, N. L., "Clarifying and expanding the application of program theory-driven evaluations" 15 (15): 83-87, 1994

56 Kraiger, K., "Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation" 78 (78): 311-328, 1993

57 Renger, R., "A three-step approach to teaching logic models" 23 (23): 493-503, 2002

58 Coryn, L. S., "A systematic review of theory-driven evaluation practice from 1990 to 2009" 32 (32): 199-226, 2011

59 Michalski, J. H., "A multi-method impact evaluation of a therapeutic summer camp program" 20 (20): 53-76, 2003

60 배을규, "A Pragmatic Evaluation Approach to Measure Training Efficiency and Effectiveness: Enhancing Utilization of Training Evaluation" 한국성인교육학회 6 (6): 79-101, 2003