A Study on the Development for the System of Evaluating Local Governments = Focusing on the Impact of Evaluation Factors on Evaluation Acceptance

다국어 초록 (Multilingual Abstract)

I conducted this study to improve the system of evaluating local governments so as to enhance evaluation acceptance by local governments (ratees). That is, by reviewing theories and previous studies regarding evaluation and evaluation acceptance, I derived an analytical framework to analyze the system of evaluating local governments. I decided on CELG (Combined Evaluation of Local Governments) as an example of a system of evaluating local governments, and conducted surveys and in-depth interviews according to the framework.As a result of statistical analysis, the evaluation acceptance of local governments (ratees) is positively correlated to 'Evaluation Methods', 'Evaluation Results', and 'Stakeholders' with statistical significance. Over 50% of responses from local governments (ratees) in the subjective questionnaires were about 'Evaluation Indicators', and evaluation professionals emphasized communication among stakeholders regarding evaluation indicators. This paper stresses the need for interest in evaluation indicators and calls for further research on evaluation contexts.

참고문헌 (Reference)

1 박우서, "현행 합동평가제도의 개선방안" 사회과학연구소 36 : 47-72, 2005

2 고성철, "합동평가 시책 및 대상과제의 대표성 확보에 관한 연구" 한국정책분석평가학회 15 (15): 213-239, 2005

3 라휘문, "지방행정 혁신평가결과의 수용도에 대한 영향요인 분석" 한국지방행정연구원 21 (21): 199-224, 2007

4 류영아, "지방자치단체 합동평가에 대한 지방공무원의 인식 비교연구" 한국지방정부학회 16 (16): 291-308, 2012

5 류영아, "지방자치단체 메타평가 제도 정착의 영향요인: 중앙과 지방공무원의 인식을 중심으로" 한국행정학회 43 (43): 97-119, 2009

6 김현구, "정부업무평가 기본법의 논리와 과제: 평가성공의 제도적 요인 분석" 한국정책분석평가학회 16 (16): 1-28, 2006

7 이석환, "성과평가제도의 수용성에 영향을 미치는 요인에 대한 연구: 평가체계요인과 내부동기요인을 중심으로" 서울행정학회 20 (20): 269-291, 2010

8 김민영, "성과평가제도 수용성의 선행 및 결과요인에 관한 연구:한국 NGO를 중심으로" 한국정책분석평가학회 23 (23): 87-125, 2013

9 김범규, "기관평가지표 및 외형적 특성이 연구기관평가 결과 수용성에 미치는 영향" 금융지식연구소 11 (11): 183-202, 2013

10 김현구, "광역자치단체 합동평가체제의 실증분석" 한국정책분석평가학회 13 (13): 125-148, 2003

11 Miyoshi, Koichi, "Toward a More Holistic Evaluation Approach for Rural Development" 34 (34): 587-589, 2013

12 Hermans, Leon, "The Usefulness of Game Theory as a Method for Policy Evaluation" 20 (20): 10-25, 2014

13 Hanberger, Anders, "The Real Functions of Evaluation and Response Systems" 17 (17): 327-349, 2011

14 Yarbrough, Danald B., "The Program Evaluation Standards" SAGE Publications, Inc 2011

15 Veloso, Luísa, "The Portuguese Schools’ Evaluation Programme: A Sociological Approach to the Participation of Social Actors" 19 (19): 110-125, 2013

16 Cullen, Anne E., "The Politics and Consequences of Including Stakeholders in International Development Evaluation" 32 (32): 345-361, 2011

17 Jacobson, Miriam R., "The Nature and Frequency of Inclusion of People with Disabilities in Program Evaluation" 34 (34): 23-44, 2013

18 Ton, Giel, "The Mixing of Methods : A Three-Step Process for Improving Rigour in Impact Evaluations" 18 (18): 5-25, 2012

19 Tapella, Esteban, "Shared Learning and Participatory Evaluation : The Sistematización Approach to Assess Development Interventions" 20 (20): 115-133, 2014

20 Lepori, Benedetto, "S&T Indicators as a Tool for Formative Evaluation of Research Programs" 18 (18): 451-465, 2012

21 Kim, Chan Dong, "Reform proposals of CELG for development strategy of local autonomy" 461-492, 2014

22 Greenwald, Howard P., "Increasing the Value of Evaluation to Philanthropic Foundations" 34 (34): 504-518, 2013

23 Ryan, Katherine, "Improving Survey Methods With Cognitive Interviews in Small and Medium Scale Evaluations" 33 (33): 414-430, 2012

24 Barrados, Maria, "Improving Program Results Through the Use of Predictive Operational Performance Indicators: A Canadian Case Study" 34 (34): 45-56, 2013

25 Wholey, Joseph S., "Handbook of Practical Program Evaluation" John Wiley & Sons, Inc 2010

26 Azzam, Tarek, "GIS in Evaluation : Utilizing the Power of Geographic Information Systems to Represent Evaluation Data" 34 (34): 207-224, 2013

27 Russ-Eft, Darlene F., "Evaluator Competencies: Standards for the Practice of Evaluation in Organizations" Jossey-Bass 2008

28 Azzam, Tarek, "Evaluator Characteristics and Methodological Choice" 32 (32): 376-391, 2011

29 Højlund, Steven, "Evaluation Use in the Organizational Context–Changing Focus to Improve Theory" 20 (20): 26-43, 2014

30 Stufflebeam, Daniel L., "Evaluation Theory, Models, and Applications" Jossey-Bass 2007

31 MOSPA, "Evaluation Indicators and Manual of CELG 2014" MOSPA 2013

32 Souza Denise E. de, "Elaborating the Context-Mechanism-Outcome Configuration (CMOc) in Realist Evaluation: A Critical Realist Perspective" 19 (19): 141-154, 2013

33 Lladó, Anna Planas, "Design and Application of a System of Evaluation Indicators for Municipal Cultural Policies" 17 (17): 277-291, 2011

34 Simon, Dagmar, "Can Evaluation Contribute to the Organizational Development of Academic Institutions? An International Comparison" 19 (19): 402-418, 2013

35 Chelimsky, Eleanor., "Balancing Evaluation Theory and Practice in the Real World" 34 (34): 91-98, 2013

36 Cousins, J. Bradley, "Arguments for a Common Set of Principles for Collaborative Inquiry in Evaluation" 34 (34): 7-22, 2013

37 Kim, Tae Hee., "Antecedents to employees’ acceptance of and satisfaction with performance measurement and management system" 4 (4): 95-114, 2011

38 Kurejšepi, Esad, "Acceptance of Self-Evaluation of Teachers in Lower Primary Schools" 3 (3): 16-18, 2013

39 Kang, Whang Sun, "A study on the Improvement Plan for the Acceptance of Public Servants about the Organization Performance Evaluation Results" 16 (16): 789-811, 2004

40 Fukushima, Kazunori, "A Theoretical Framework for Performance Evaluation Acceptance" 22 (22): 13-20, 2009

41 Park, Hae Yug, "A Study on the Redesign of the Combined Evaluation of Local Government" 20 : 95-118, 2013

42 Park, Hae Yug, "A Study on the Citizen Participation in the process of Self-Evaluation in Local Governments" Korea Research Institute of Local Government 2006

43 Lapreeière, Hélène, "A Socio-Political Framework for Evaluability Assessment of Participatory Evaluations of Partnerships: Making Sense of the Power Differentials in Programs That Involve the State and Civil Society" 18 (18): 246-259, 2012

44 Pawson, Ray, "A Realist Diagnostic Workshop" 18 (18): 176-191, 2012

45 Jackson, Suzanne F., "A New Realistic Evaluation Analysis Method: Linked Coding of Context, Mechanism, and Outcome Relationships" 33 (33): 339-349, 2012

46 MOSPA, "2014 CELG Implementation and Operating Plan for Combined Evaluation Group" MOSPA 2014