정책분석평가의 다각화: 양적 방법과 질적 방법의 결합 = Triangulation in Public Analysis and Evaluation: Combining Quantitative and Qualitative Methods

다국어 초록 (Multilingual Abstract)

For decades, positivist philosophy and the notion of rational decision making have guided research in public policy. Recently, as qualitative approach is emphasized, important attempts to combine quantitative and qualitative methods have been made in policy evaluation research. Various qualitative methods have not yet been accepted as alternatives to quantitative methods. Under the circumstance, this study discussed alternative methods to combine quantitative(QUAN) and qualitative(QUAL) evaluation methods from the perspective of methodological triangulation. In particular, it suggested parallel combination, sequential combination, cross combination, and multi-level combination as alternative methods for policy evaluation.

국문 초록 (Abstract)

실증주의와 합리적 의사결정은 정책 연구의 방향을 인도하는 지배적인 패러다임으로 공고히 자리메김하고 있다. 최근 들어 정책 연구에서 질적 접근의 중요성이 부각되고, 혼합방법론을 중심으로 양적 방법과 질적 방법을 상호보완적으로 결합하려는 시도들이 나타나고 있다. 그럼에도 불구하고 질적 방법론 자체가 독립적인 정책분석평가 모형이나 이론을 제공하는 수준까지는 이르지 못하고 있다. 이러한 상황에서 본 논문은 정책분석평가에서 양적 방법과 질적 방법의 결합을 통해 정책분석평가 이론 및 실제를 개선하는데 기여하고자 하였다. 이를 위해 본 논문은 정책분석평가에서 양적 방법과 질적 방법이 각각 지닌 한계를 극복하기 위한 대안으로 평가 다각화(triangulation) 관점에서 순차적 다각화, 병렬적 다각화, 교차적 다각화, 및 다수준 결합 모형들을 제시하였다.

참고문헌 (Reference)

1 이성우, "후기 실증주의와 질적 연구방법의 정책분석평가연구에의 적용가능성" 한국정책분석평가학회 18 (18): 15-42, 2008

2 심준섭, "행정학연구의 대안적 방법으로서의 방법론적 다각화(Triangulation): 질적 방법과 양적방법의 결합" 한국행정연구원 17 (17): 3-31, 2008

3 임도빈, "질적 연구 방법의 내용과 적용전략: 양적인 질적 연구와질적인 질적 연구" 정부학연구소 15 (15): 155-187, 2009

4 이성우, "사회정책 평가에서 질적 평가의 의의와 정합성" 한국사회정책학회 22 (22): 165-196, 2015

5 Ragin, C. C., "Turning the tables: how case-oriented methods challenge variable-oriented methods" 16 : 27-42, 1997

6 Nachmias, D., "The role of evaluation in public policy" 8 (8): 1163-, 1980

7 Ragin, C. C., "The comparative method. Moving beyond qualitative and quantitative strategies" University of California Press 1987

8 Greener, I., "The Routledge Handbook of the Welfare State" Routledge 419-430, 2013

9 Bovens, M., "The Oxford handbook of public policy" 319-335, 2006

10 Yates, J., "Social protection and health: Experiences in Uganda" 24 (24): 339-356, 2006

11 Begun, A., "Social policy evaluation: An example from drinking age legislation" 3 : 165-170, 1980

12 Heclo, H., "Review Article: Policy Analysis" 2 (2): 83-108, 1972

13 Creswell, J. W., "Research design: Qualitative, quantitative, and mixed methods approaches" SAGE 2003

14 Garbarino, S., "Quantitative and qualitative methods in impact evaluation and measuring results" GSDRC Emerging Issues Research Service. Governance and Social Development Resource Centre 2009

15 Patton, M., "Qualitative research and evaluative methods" Sage Publications 2002

16 Munda, G., "Qualitative multicriteria evaluation for environmental management" 10 (10): 97-112, 1994

17 Symon, G., "Qualitative methods and analysis in organizational research" Sage Publications 1998

18 Rihoux, B., "Qualitative comparative analysis (QCA) in public policy analysis: an extensive review" 7 (7): 9-82, 2011

19 Ascher, W., "Policy sciences and the economic approach in a ‘post-positivistic’ era" 20 : 3-9, 1987

20 Albæk, E., "Policy evaluation: Design and utilization" 2 (2): 6-19, 1989

21 Dryzek, J., "Policy analysis as a hermeneutic activity" 14 : 309-329, 1982

22 Landau, M., "On the concept of a self-correcting organization" 33 (33): 533-542, 1973

23 Bamberger, M., "Introduction to mixed methods in impact evaluation" 3 (3): 1-38, 2012

24 Shim, J., "Identifying policy frames through semantic network analysis: an examination of nuclear energy policy across six countries" 48 (48): 51-83, 2015

25 Nagel, S. S., "Handbook of public policy evaluation" Sage 2002

26 Srivastava, A., "Framework analysis: A qualitative methodology for applied policy research" 4 (4): 2009

27 Schön, D., "Frame Reflection: Toward the Resolution of Intractable Controversies" Basic Books 1994

28 Greene, J. C., "Defining and describing the paradigm issue in mixedmethod evaluation" (74) : 5-17, 1997

29 Hentschel, J., "Contextuality and data collection methods: A Framework and application to health service utilization" 35 : 64-94, 1999

30 USAID, "Conducting mixed-method evaluations. Monitoring and Evaluation Series. Ver. 1"

31 Carvalho, S., "Combining the quantitative and qualitative approaches to poverty measurement and analysis" The World Bank 1997

32 White, H., "Combining quantitative and qualitative approaches in poverty analysis" 30 (30): 2002

33 Yin, R., "Case study research: design and methods" Sage Publications 2003

34 Ritchie, J., "Analyzing Qualitative Data" 173-194, 1994

35 Lynn Jr, L. E., "A place at the table: Policy analysis, its postpositive critics, and future of practice" 18 (18): 411-425, 1999