국방R&D사업 자체평가시스템 메타평가 = A Study on the Meta Evaluation for Defense R&D Programs

다국어 초록 (Multilingual Abstract)

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as ‘Good’. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as ‘Very Good’. The evaluation input component gained 73.1 points out of 100, so it was evaluated as ‘Good’. The evaluation process component gained 74.8 points out of 100, so it was evaluated as ‘Good’. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as ‘Good’. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach’s α coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

참고문헌 (Reference)

1 김병철, "정부출연연구기관 평가에 대한 메타평가 모형설계 및 적용" 서울시립대학교 대학원 2008

2 박종수, "정보화 사업 메타평가를 위한 CIPOU 모형개발" 충남대학교 대학원 2003

3 노유진, "우리나라 정부부처에 있어서 정책평가결과의 저활용요인에 관한 연구" 한국행정연구소 43 (43): 245-299, 2005

4 이찬구, "영국의 범부처간 과학기술정책 평가제도 - 메타평가와 한국에의 시사점 -" 한국정부학회 15 (15): 809-833, 2003

5 방위사업청, "방위력개선사업관리규정"

6 류영수, "기술영향평가의 메타평가 모형개발 및 적용" 한양대학교 대학원 2007

7 과학기술부, "국가연구개발사업 등의 성과평가 및 성과관리에 관한 법률, 법률 제7808호"

8 이형우, "국가연구개발(R&D)사업 평가체제에 관한 소고" 한국정책분석평가학회 15 (15): 191-219, 2005

9 Joint Committee on Standards for Educational Evaluation, "The Programme Evaluation Standards" Sage Publications 1994

10 Yi, Chan Goo, "The National R&D Evaluation System in the UK : Meta-evaluation and Applicability to the Korea Case" PREST, University of Manchester 2003

11 이학식, "SPSS 14.0 매뉴얼" 법문사 2008

12 Leviton, Laura C, "Research on the Utilization of Evaluations : A Review and Synthesis" 5 (5): 1981

13 Chelimsky, Eleanor, "Program Evaluation: Patterns and Directions" The American Society for Public Administration 1-35, 1985

14 Worthen, Blaine R., "Program Evaluation: Alternative Approaches and Practical Guidelines" Longman Publishers 1997

15 Larson, Richard C, "On Evaluating Valuations" 16 (16): 147-163, 1983

16 Stufflebeam L., "Metaevaluation:Concepts,Standard and Uses" Educational Evaluation Methodology, The JHU Press 1981

17 Stevenson, John F., "Metaevaluation in Human Services" Sage Publications 2000

18 Cook T D., "Metaevaluation Research" 2 (2): 5-55, 1978

19 Hong H. D., "Meta-evaluation of National Large-Scale R&D Programs : A Comparison of Evaluation Systems of 6 National R&D Programs" University of Manchester 2000

20 OECD, "Improving Evaluation Practices-Best Practice Guidelines for Evaluation and Background Paper"

21 American Evaluation Association, "Guidelines for Evaluator" Jossey-Bass 1995

22 Scriven M., "Evaluation Thesaurus(4th ed.)" Sage Publications 1991

23 과학기술혁신본부, "2008년도 국가연구개발사업 자체 평가매뉴얼"