프로그램 논리모형(Logic Models)의 적용과 사용에 관한 연구 - “간접흡연제로! 서울 평가지표 개발연구” 사례를 중심으로 - = A Study on the Application and Use of Program Logic Models - A Research and Development of Evaluation Indicators for Secondhand Smoking Free Seoul! Program

다국어 초록 (Multilingual Abstract)

Program logic models has being actively applied to program planning and evaluation in U.S., Canada, and Australia and so on. Some practitioners or researchers, however, do not precisely know the meaning and methods of logic models, just using those as templates. In the meanwhile, Korea is now in the beginning stage in studying logic models, and has the same problems in using those. Therefore, this study selected ‘secondhand smoking free! Seoul program’ as a research case among academic papers and government supported researches, and investigated the problems when applying logic models. As a result, this article has found that the logic model for the secondhand smoking prevention program has exposed several errors, and has the limits in representing the complex realities. For this reason, this study tried to modify the errors of the logic model of the secondhand smoking prevention program, and suggest a more applicable logic model tailored to the complex world, which draws on systems thinking approaches.

국문 초록 (Abstract)

프로그램 논리모형은 미국과 캐나다, 호주 등에서 프로그램 기획, 집행, 평가를 위해 정책현장에서 활용되고 있고, 학계에서는 관련 연구가 활발하게 이루어지고 있다. 다만 일부에서는 논리모형의 의미와 적용방법을 정확히 인지하지 못한 상태로 단지 템플릿처럼 사용하는 문제점이 발견되고 있다. 한편 국내에서는 논리모형의 활용과 연구가 이제 시작단계로서 해외사례에서 발견되는 문제점이 마찬가지로 동일하게 발견되고 있다. 그래서 이 연구는 국내 학계연구와 정책연구 사례 중 대표사례로서 「간접흡연제로! 서울」 정책연구를 선정하여 그 문제점을 살펴보았다. 연구 결과 이 사례는 논리모형의 가장 기본적인 원리와 방법의 적용에서 많은 문제점을 드러내고 있었으며 아울러 좀 더 복잡한 현실을 반영하는 논리모형으로서는 부적합한 측면이 드러났다. 그래서 이 글은 사례의 논리모형을 기본 논리모형의 원리와 방법론에 맞게 수정하였으며, 아울러 좀 더 현실적합한 논리모형을 개발하기 위하여 시스템 사고를 도입하고 적용하여 발전된 논리모형을 제시하였다.

참고문헌 (Reference)

1 김동립, "프로그램논리모형의 개념과 유형화에 관한 소고" 2010

2 김복규, "프로그램 논리모형 설계 및 평가: 농촌활력화사업을 대상으로" 서울행정학회 19 (19): 97-122, 2008

3 정주택, "정책평가론" 법문사 2008

4 보건복지부, "재정지원사업의 성과주의 예산제 도입방안" 보건복지부 2006

5 한국보건산업진흥원, "맞춤형 방문건강관리사업 평가체계개발" 한국보건사업진흥원 2008

6 문종열, "금강산관광사업 논리모형과 특성 그리고 정책적 함의" 한국정부학회 19 (19): 405-428, 2007

7 서미경, "건강증진정책 평가 및 실천방향" 한국보건사회연구원 2006

8 서울시정개발연구원, "간접흡연제로! 서울 평가지표 개발연구" 서울시정개발연구원 2010

9 최은진, "간접흡연감소를위한정책과제" 2005

10 최은진, "간접흡연 감소정책의 방향" 2003

11 Rennekamp, R. A, "What Progress, Program Evaluation? reflections on a Quarter-Century of Extension Evaluation Practice" 47 (47): 2009

12 Patton,M, "Utilization-focused Evaluation, 3rd Edition" CA:Sage Publications 1997

13 Rogers,P, "Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions" 14 (14): 29-48, 2008

14 Wholey,J, "Using Policy Evaluation to Support Decision Making and Improve Program Performance" 3 (3): 6-11, 2003

15 Donaldson, S, "Theory-driven Program Evaluation in the New Millennium. In Evaluating Social Programs and Problems: Visions for the New Millennium" Lawrence Erlbaum Associates 2003

16 Weiss,C, "Theory-based Evaluation: Past, present, and future" (76) : 41-55, 1997

17 Chen,H, "Theory-Driven Evaluations" CA: Sage Publications 1990

18 Kaplan, S, "The Use of Logic Models by Community-based Initiatives" (28) : 167-172, 2005

19 Cooksy, L. J, "The Program Logic Model as an Integrative Framework for a Multimethod Evaluation" (24) : 119-128, 2001

20 Yarbrough, D. B, "The Program Evaluation Standards: A Guide for Evaluators and Evaluation Users" CA: Sage 2010

21 Kurtz, C. F, "The New Dynamics of Strategy:Sense-making in a Complex and Complicated World" 42 (42): 462-483, 2003

22 Stufflebeam,D.L, "The Meta-evaluation Imperative" 22 (22): 183-209, 2001

23 Knowlton, L, "The Logic Model Guidebook" Sage Publications 2009

24 Bickman,L, "The Functions of Program Theory" (33) : 5-18, 1987

25 Pope-Davis, D. B, "The Assessment of Multicultural Counseling Competencies. In Handbook of Multicultural Counseling" CA: Sage 2010

26 Stufflebeam,D.L, "The 21st Century CIPP Model in Evaluation Roots" CA: SAGE 245-246, 2004

27 Midgley,G, "Systems Thinking for Evaluation In Systems Concepts in Evaluation: An Expert Anthology. Point Reyes" EdgePress of Inverness 2007

28 Donaldson,S, "Program Theory-Driven Evaluation Science: Strategies and Applications" Taylor & Francis Group 2007

29 Chen,H, "Practical Program Evaluation: Assessing and improving Planning, Implementation, and Effectiveness" CA: Sage 2005

30 Hatry,H, "Performance Measurement: Getting Results" Urban Institute Press 1999

31 United Way of America, "Measuring Program Outcomes: A Practical Approach" United Way of America 1996

32 McLaughlin, J, "Logic Models:A Tool for Telling your Program’s Performance Story" (22) : 65-72, 1999

33 Millar, A, "Logic Models:A Systems Tool for Performance Management" (24) : 73-81, 2001

34 Noga, J, "Logic Models and Systems Models: Two Sides to the Same Coin" 2009

35 Cato, B, "Logic Model: A Tool for Planning and Evaluating Health and Recreation Prevention Projects" Recreation & Dance 69 (69): 1998

36 W.K.Kellogg Foundation, "Logic Model Development Guide.Bettle Creek,MI:W.K" W. K. Kellogg Foundation 2004

37 Centers for Disease Control and Prevention, "Introduction to Program Evaluation for Public Health Programs: A Self-study Guide" Centers for Disease Control and Prevention 2005

38 Mohr,L, "Impact Analysis for Program Evaluation" CA: Sage Publications 1995

39 Westmoreland, H, "How to Develop a Logic Model for Districtwide Family Engagement Strategies" Harvard Family Research Project․ Harvard Graduate School of Education 2009

40 Westly, F, "Getting to Maybe: How the World Is Changed" Random House Canada 2007

41 Renger, R, "From Theory to Practice:Lessons learned in the Application of the ATM Approach to Developing Logic Models" (29) : 106-119, 2006

42 Wholey,J, "Evaluation:Promise and Performance" Urban Institute Press 1979

43 Rossi, P. H, "Evaluation: A Systematic Approach(7th ed.)" CA: Sage 2004

44 Weiss,C, "Evaluation. Upper Saddle River" NJ: Prentice Hall 1998

45 Eoyang, G. H, "Evaluation in a Complex Adaptive System In Managing Complexity in Organizations" CT: Quorum Books 1998

46 Suarez-Balcazar, "Evaluation Capacity Building: A Cultural and Contextual Framework. In Culture and Disability: Rehabilitation Science and Practice. Sudbury" Jones and Bartlett 2010

47 Chen, H, "Evaluating with Sense: The Theory-driven Approach" (7) : 283-302, 1983

48 Wholey,J, "Evaluability Assessment: Developing Program Theory In Using Program Theory in Evaluation, New Directions for Program Evaluation" CA: Jossey-Bass Publishers 77-92, 1987

49 Taylor-Powell, E, "Enhancing Program Performance with Logic Models. retrieved from"

50 Patton,M, "Developmental Evaluation:Appling Complexity Concepts to Enhance Innovation and Use" The Guilford Press 2010

51 Patton,M, "Developmental Evaluation" (15) : 311-319, 1994

52 World Bank, "Curbing the Epidemic Governments and the Economics of Tobacco Control. retrieved from"

53 Stacey,R, "Complexity and Creativity in Organizations" CA: Berrett-Koehler 1996

54 Weiner, D, "Community Participation and Geographic Information System. In Community Participation and Geographic Information System" Taylor and Francis 2002

55 Rogers, P, "Causal models in program theory evaluation. In Program Theory in Evaluation: Challenges and Opportunities, New Directions in Program Evaluation" Jossey-Bass Publishers 47-55, 2000

56 Batterham, R, "Can We Achieve Accountability for Long-Term Outcomes in Rehabilitation" 77 (77): 1219-1225, 1996

57 Office of Management and Budget, "Budget Procedures Memorandum No. 861. retrieved from"

58 Bickman,L, "Barriers to the use of program theory" (12) : 387-390, 1989

59 Kauffman,S.A, "At Home In The Universe:The Search for the Law of Self-Organization and Complexity" Oxford University Press 1995

60 Wholey, J, "Assessing the Feasibility and likely Usefulness of Evaluation In Handbook of practical program evaluation" Jossey-Bass 1994

61 Pinnegar,S, "Are Complex Programs the Best Response to Complex Policy Issues? City Futures Research Centre Issues paper" University of New South Wales 2006

62 Bennett,C, "Analyzing Impacts of Extension Programs" U.S. Department of Agriculture 1976

63 Renger, R, "A Three-step Approach to Teaching Logic Models" 23 (23): 493-503, 2002

64 Patton,M, "A Context and Boundaries for Theory-driven Approach to Validity" (12) : 375-377, 1989

65 Dyehouse, M, "A Comparison of Linear and Systems Thinking Approaches for Program Evaluation Illustrated Using the Indiana Interdisciplinary GK-12" (32) : 187-196, 2009

66 보건복지부, "2009년도 흡연예방 및 금연클리닉 사업안내" 보건복지부 2009