양적 연구에서 도출된 회귀계수 추정값의 실질적 유의성에 관한 연구 - 한국행정학보와 한국정책학회보를 중심으로 - = A Review of Practical Significance of the Statistically Significant Estimates Published in Korean Public Administration Review and Korean Policy Studies Review

다국어 초록 (Multilingual Abstract)

The purpose of this paper is twofold. First, we examine whether the analysis of practical significance is conducted among public administration and policy research that use regression analysis. Second, we emphasize the importance of examining practical significance of statistical results, in order to promote the quality of quantitative studies in public administration and policy. The logic that is often used in modern statistical inference is Fisherian inference. Researchers examine the significance of quantitative studies by estimating the effect of an explanatory variable on an outcome variable and analyzing whether the effect estimates are statistically significant based on the Fisherian logic. Note, however, that the significance of any research depends not only on statistical significance but also on the effect size (practical significance). An in-depth analysis of the effect estimates is, therefore, necessary in order for a researcher to derive appropriate policy implication from the estimated results. By examining the regression analysis published in Korean Public Administration Review and Korean Policy Studies Review from 2014 to 2018, we find that the share of published papers that analyzed the practical significance of the estimated results is only 1.37%. We argue that researchers should devote more on analyzing practical significance of estimated effects in order to secure conclusion validity of public administration and policy research.

참고문헌 (Reference)

1 김우철, "현대통계학" 영지문화사 2005

2 손호성, "행정학･정책학 연구에서의 이중차분 추정기법의 활용과 쟁점" 한국국정관리학회 28 (28): 1-31, 2018

3 고길곤, "행정학 분야의 로지스틱 회귀분석 활용 절차와 쟁점" 한국국정관리학회 27 (27): 3-33, 2017

4 한승훈, "행정학 및 정책학 연구에서의 회귀단절 설계의 활용 가능성 탐구" 한국국정관리학회 29 (29): 1-34, 2019

5 김우철, "일반통계학" 영지문화사 2006

6 구교준, "소득과 삶의 역량에 따른 행복 결정요인 연구" 한국행정학회 48 (48): 317-339, 2014

7 김지원, "산재근로자 직업재활서비스 지원이 동태적 고용성과에 미치는 영향" 한국행정학회 52 (52): 237-266, 2018

8 김진영, "사회자본과 층간소음 갈등" 한국정책학회 27 (27): 133-160, 2018

9 유금록, "부트스트랩 비방사적 전역 맘퀴스트 생산성지수를 이용한 지방상수도공기업의 생산성과 영향요인 분석" 한국행정학회 52 (52): 167-204, 2018

10 권남호, "도구변수의 활용: 정책학･행정학 연구를 중심으로" 한국국정관리학회 28 (28): 33-62, 2018

11 송헌재, "근로장려세제 도입이 저소득가구의 노동공급 및 후생에 미치는 영향분석" 한국조세연구원 2011

12 McCloskey, D. N., "The Standard Error of Regressions" 34 : 97-114, 1996

13 Zhu, L., "The Public Administration Manifesto II: Matching Methods to Theory and Substance" 29 (29): 287-298, 2019

14 Cohen, J., "The Earth Is Round (p< .05)" 49 (49): 997-1003, 1994

15 Gelman, A., "The Difference Between Significant and Not Significant Is Not Itself Statistically Significant" 60 (60): 328-331, 2006

16 Wasserstei, R. L., "The ASA’s Statement on -values: Context, Process, and Purpose" 70 (70): 129-133, 2016

17 Freedman, D., "Statistics" W. W. Norton & Company 2007

18 Schmidt, F. L., "Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for the Training of Researcher" 1 : 115-129, 1996

19 Freedman, D., "Statistical Models and Shoe Leather" 21 : 291-313, 1991

20 Lee, David S., "Regression Discontinuity Designs in Economics" 48 (48): 281-355, 2010

21 Groeneveld, S., "Quantitative Methods in Public Administration: Their Use and Development Through Time" 18 (18): 61-86, 2015

22 DeGroot, M., "Probability and Statistics" Addison-Wesley 2002

23 Wackerly, D., "Mathematical Statistics with Applications" Brooks/Cole 2008

24 Wooldridge, J., "Introductory Econometrics-A Modern Approach" South-Western Cengage Learning 2009

25 Moore, D., "Introduction to the Practice of Statistics" W. H. Freeman and Company 2014

26 박현희, "ERGM을 이용한 네트워크 데이터 분석 및 구조 파라미터 계수의 해석" 한국국정관리학회 29 (29): 35-61, 2019

27 Arceneaux, K., "Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment" 14 (14): 37-62, 2006

28 McShane, B. B., "Blinding Us to the Obvious? The Effect of Statistical Training on the Evaluation of Evidence" 62 (62): 1533-1841, 2016

29 Gujarati, D., "Basic Econometrics" McGraw-Hill/Irwin 2003

30 McShane, B. B., "Abandon Statistical Significance" 73 (73): 235-245, 2019

31 Fisher, R., "A Statistical Methods for Research Workers" Oliver and Boyd 1925