혼합식 조사와 웹패널의 (옅은) 빛과 (짙은) 그늘 = Prospects and Problems of the Recent Developments in Social Survey in Korea: Mixed-Mode Survey and Volunteer Web Panel

다국어 초록 (Multilingual Abstract)

Mixed-mode survey and (volunteer) web panels are the alternative methods introduced of late as ways to cope with the changing environment. Their formal and substantive bases are reviewed in this paper. After placing them in the ecology of social survey in contemporary Korea, I examine their characteristics and limitations, along with the adjustment methods developed to deal with the problems they incur. Of central concern in the assessment is the fundamental question of whether, or how well, they represent the population. With computer simulations, the biases produced when these requirements are not met are illustrated. Lastly, some concrete and practical steps to take in using these new methods are discussed. The paper once again reminds the role expected of the social survey: It is an instrument to observe the social reality, and it is to provide references for making and evaluating policy as well as basic data for research. In doing so, it reconfirms that the lowering of cost merely for the sake of expediencies and without regard to data quality amounts to nothing useful or meaningful.

참고문헌 (Reference)

1 김상욱, "한국종합사회조사 2010" 성균관대학교 출판부 2011

2 김석호, "한국 사회조사자료 생산의 문제점과 양질의 자료 구축을 위한 모색" 2011

3 구혜란, "표집방법에 따른 자료의 질: 할당표집과 확률표집의 결과 비교" 2011

4 이계오, "통계조사의 현황과 전망" 1 (1): 1-20, 2000

5 통계청, "장래가구추계: 2010년∼2035년"

6 허명회, "자원자 패널에 의한 인터넷 조사의 성향조정 가중화" 한국조사연구학회 11 (11): 1-28, 2010

7 임경은, "인터넷조사와 가구방문조사간 데이터 품질비교 -사회조사를 대상으로-" 통계개발원 2009

8 조성겸, "인터넷 여론조사의정확도 관련요인" 한국조사연구학회 6 (6): 51-74, 2005

9 이계오, "인터넷 선거조사에서 성향가중모형 적용사례" 한국조사연구학회 10 (10): 21-36, 2009

10 박무익, "우리나라 조사산업의 현황과 전망" 1 (1): 161-177, 2000

11 이윤석, "온라인 조사의 응답오차에 대한 연구:설문 응답 시간과 응답 성실성의 관계" 한국조사연구학회 9 (9): 51-83, 2008

12 조성겸, "생활시간 조사를 이용한 가중치 부여방법: 인터넷 조사에 대한 적용 가능성 검토" 한국조사연구학회 12 (12): 145-157, 2011

13 조성겸, "새로운 사회여론조사 방법: 모바일 조사방법의 가능성 검토" 한국조사연구학회 4 (4): 1-29, 2003

14 차종천, "사회조사의 업그레이드: 한국종합사회조사(KGSS) 출발" 성균관대학교 출판부 0-0, 2005

15 조동기, "사이버공간과 사회조사: 온라인 사회조사의 쟁점과 과제" 1 (1): 73-108, 2000

16 이희길, "국내 패널조사의 현황분석, 2009" 통계개발원 2009

17 이흥철, "국내 조사업계의 역사" 한국조사연구학회 3 (3): 123-153, 2002

18 Martin, Peter., "What Makes a Good Mix? Chances and Challenges of Mixed Mode Data Collection in the ESS" City University London, UK. 2011

19 Couper, Mick., "Web Survey: A Review of Issues and Approaches" 64 (64): 464-494, 2000

20 National Research Council., "Using the American Community Survey: Benefits and Challenges" The National Academies Press 2007

21 de Leeuw, Edith D., "Trends in Household Survey Nonresponse: A Longitudinal and International Comparison, In Survey Nonresponse" Wiley 41-54, 2002

22 Anderson, Margo, "To Sample or Not to Sample? The 2000 Census Controversy" 30 (30): 1-36, 1999

23 de Leeuw, Edith D., "To Mix or Not to Mix Data Collection Modes in Surveys" 21 (21): 233-255, 2005

24 Geertz, Clifford., "The Interpretation of Cultures" Basic Books 1973

25 Smith, Tom W., "The Globalization of Survey Research, In Survey Methods in Multicultur al, Multinational, and Multiregional Contexts" Wiley 477-484, 2010

26 Martin, Peter, "The Effects of Mixed Mode Survey Designs on Simple and Complex Analyses" City University London, UK. 2011

27 Groves, Robert M., "The Decennial Census and the ACS: Looking Back and Looking Ahead" U. S. Census Bureau. 2011

28 Rosenbaum, Paul R., "The Central Role of the Propensity Score in Observational Studies for Causal Effects" 70 (70): 41-55, 1983

29 Groves, Robert M., "Survey Methodology (2nd ed.)" Wiley 2009

30 Gelman, Andrew., "Struggles with Survey Weighting and Regression Modeling" 22 (22): 153-164, 2007

31 Deming, W. Edwards., "Sample Design in Business Research" Wiley 1960

32 Baker, Reg, "Research Synthesis: AAPOR Report on Online Panels" 74 (74): 711-781, 2010

33 Gelman, Andrew, "Rejoinder: Struggles with Survey Weighting and Regression Modeling" 22 (22): 184-188, 2007

34 Link, Michael W., "Reaching the U.S. Cell Phone Generation: Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey" 71 (71): 814-839, 2007

35 Revilla, Melanie., "Quality in Unimode and Mixed-Mode Designs: A Multitrait-Multimethod Approach" 4 (4): 151-164, 2010

36 Lee, Sunghee., "Propensity Score Adjustment as a Weighting Scheme for Volunteer Panel Web Surveys" 22 (22): 329-349, 2006

37 Groves, Robert M, "Nonresponse in Household Interview Surveys" Wiley 1998

38 Roberts, Caroline., "Mixing Modes of Data Collection in Surveys: A Methodological Review" ESRC National Centre for Research Methods. 2007

39 Griffin, Deborah H., "Meeting 21st Century Demographic Needs .Implementing the American Community Survey: Report 2. Demonstrating Survey Quality" U.S. Census Bureau, Economics and Statistics Administration 2002

40 Sparrow, Nick, "Measuring the Attitudes of the General Public via Internet Polls: An Evaluation" 46 (46): 23-44, 2004

41 Dillman, Don A., "Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method (3rd Edition)" John Wiley & Sons, Inc 2009

42 de Leeuw, Edith D., "Internet Surveys as Part of a Mixed-Mode Design, In Social and Behavior al Resear ch and the Internet" Routledge 45-76, 2011

43 Lynn, Peter, "How Representative Can a Multi-Nation Survey Be?, In Measuring Attitudes Cross-Nationally: Lessons from the European Social Survey" Sage 33-52, 2007

44 Martin, Elizabeth, "Guidelines for Designing Questionnaires for Administration in Different Modes" U.S.Census Bureau

45 D’Agostino, "Estimating and Using Propensity Scores with Partially Missing Data" 95 (95): 749-759, 2000

46 Valliant, Richard, "Estimating Propensity Adjustments for Volunteer Web Surveys" 40 (40): 105-137, 2011

47 Rubin, Donald., "Estimating Causal Effects from Large Data Sets Using Propensity Scores" 127 (127): 757-763, 1997

48 Krug, Steve., "Don't Make Me Think: A Common Sense Approach to Web Usability (2nd ed.)" New Riders Press 2005

49 Taylor, Humphrey., "Does Internet Research Work? Comparing Electronic Survey Results with Telephone Survey" 42 (42): 51-63, 2000

50 Vannieuwenhuyze, Jorre, "A Method for Evaluating Mode Effects in Mixed-Mode Surveys" 74 (74): 1027-1045, 2010

51 Roster, Catherine A., "A Comparison of Response Characteristics from Web and Telephone Surveys" 46 (46): 359-373, 2004