A Study on Measuring the Change of the Response Results in Likert 5-Point Scale Measurement

다국어 초록 (Multilingual Abstract)

This study examines how and which direction respondents who participated in 5-point Likert scale surveys change their initial responses when they are given an identical second survey after certain treatments. The research employs three identical questionnaires (first, second and third surveys) to analyze survey results based on group differences, kinds of treatment, survey purposes, and response change direction and the degree. This paper concludes that, first, it is significant that specialist groups do not change their initial responses compared to a general librarian group. Second, there are no differences by survey purpose; however, participants tend to change their initial responses by others’ opinions rather than by previous use experiences. Third, participants who initially answered positively tend not to change their responses, and most participants who answered negatively change their initial responses in a positive direction. Fourth, when there are changes, participants change their initial responses by less than two points, and most of them change by one point. Finally, the hypothesis that middle responses change most and that participants who respond at both ends do not change their opinion was rejected by the finding that participants who answered on the negative end tend to change their initial responses in a positive direction.

참고문헌 (Reference)

1 노영희, "도서관지도정보시스템 구축을 위한 메타데이터 개발 연구" 한국정보관리학회 27 (27): 241-264, 2010

2 Cummins, R. A, "Why we should not use 5-point Likert scales: The case for subjective quality of life measurement" 74-93, 2000

3 Becker, S. L, "Why an order effect" 18 : 271-278, 1954

4 Yammarino, F. J, "Understanding mail survey response behavior: A meta-analysis" 55 : 613-639, 1991

5 Goldberg, L. R, "Unconfounding situational attributions from uncertain, neutral, and ambiguous ones: A psychometric analysis of descriptions of oneself and various types of others" 41 (41): 517-552, 1981

6 Jacoby, J, "Three-point Likert scales are good enough" 8 : 495-500, 1971

7 Ruggg, D, "The wording of questions, In Gauging public opinion" Princeton University Press 1944

8 Sedlmeier, P, "The role of scales in student ratings" 16 : 401-415, 2006

9 Guy, R. F, "The neutral point on a Likert scale" 95 (95): 199-204, 1977

10 Armstong, R. L, "The midpoint on a five-point Likert-type scale" 64 : 359-362, 1987

11 Garland, R, "The mid-point on a rating scale: Is it desirable" 2 : 66-70, 1991

12 Belson, W. A, "The effects of reversing the presentation order of verbal rating scales" 6 : 30-376, 1966

13 Payne, J. D, "The effects of reversing the order of verbal rating scales in a postal survey" 14 : 30-44, 1971

14 Everett, S. A, "The effect of a monetary incentive in increasing the return rate of a survey to family physicians" 20 : 204-207, 1997

15 Quinn, S. B, "The Effects of Reversing of the Order of Presentation of Verbal Rating Scales in Survey Interviews" Survey Research Centre 1969

16 Payne, S. L, "The Art of Asking Questions" Princeton University Press 1951

17 Nicholls, M. R., "Satisfaction guaranteed: The effect of spatial biases on responses to Likert scales" 17 : 1027-1028, 2006

18 Sheehan, B. K, "Response variation in e-mail surveys: An exploration" 39 (39): 45-54, 1999

19 Stewart, T. J, "Reliability and validity issues for two common measures of medical students' attitudes toward older adults" 32 : 409-421, 2006

20 Schwarz, N. B, "Rating scales: Numeric values may change the meaning of scale labels" 55 : 570-582, 1991

21 Shcuman, H, "Questions and Answers in Attitude Surveys" Academic Press 1981

22 Wyatt, R. C, "Psychometric properties of four 5-point Likert-type scales" 47 : 27-35, 1987

23 McFadden, L. S, "Psychometric function of the "neutral" response option in clinical personality scales" 7 : 25-33, 1984

24 Brook, D, "Primacy effects in single trial free recall" 23 : 414-419, 1974

25 Carp, F. M, "Position effects on interview response" 29 : 581-587, 1974

26 Kulas, J. T, "Middle response function in Likert-responses to personality items" 22 : 251-259, 2008

27 Fox, R. J., "Mail survey response rate: A meta-analysis of selected techniques for introducing response" 52 : 467-491, 1988

28 Dillman, D. A, "Mail and internet surveys: The tailored design method" John Wiley and Sons 1999

29 James, J, "Large monetary incentives and their effect on mail survey response rates" 56 : 442-453, 1992

30 Matell, M. S, "Is there an optimal number of alternatives for Likert scale items? Effects of testing time and scale properties" 56 (56): 506-509, 1972

31 Hartley, J, "Four layouts and a finding: The effects of changes in the order of the verbal labels and numerical values on Likert-type scales" 13 (13): 17-27, 2010

32 Church, A. H, "Estimating the effect of incentive on mail survey response rates: A meta-analysis" 57 : 62-79, 1993

33 Amoo, T, "Do numeric values influence subjects' responses to rating scales" 26 : 41-46, 2001

34 Dawes, J, "Do data characteristics change according to the number of points used? An experiment using 5-point, 7-point and 10-point scales" 50 : 61-77, 2008

35 Wildt, A. R, "Determinants of scale responses: Label versus position" 261-267, 1978

36 De Leeuw, E. D, "Data Quality in Mail, Telephone, and Face-to-face Surveys" TT Publications 1992

37 Yun, G. W, "Comparative response to a survey executed by post, e-mail, & web form" 6 (6): 235-239, 2000

38 Mueller, J. E, "Choosing among 133 candidates" 34 : 395-402, 1970

39 Weems, G. H, "Characteristics of respondents who respond differently to positively and negatively worded items on rating scales" 28 : 587-607, 2003

40 Armitage, C, "Changing student evaluations by means of the numeric values of rating scales" 3 : 122-125, 2004

41 Beck, J, "Career anchors, organizational commitment, and job plateaus: An analysis of hotel executive operating committee members' career development. (Doctoral Dissertation, Purdue University, 1996)" Publication Number: AAT 9725508 58 (58): 1996

42 Green, B. F, "Attitude measurement, In Handbook of Social Psychology" Addison-Wesley 1969

43 Komorita, S. S, "Attitude content, intensity and the neutral point on a Likert scale" 61 : 327-334, 1963

44 Krosnick, J. A, "An evaluation of a cognitive theory of response-order effects in survey measurement" 51 : 201-209, 1987

45 Bignami-Van Assche, S. G, "An assessment of the KDICP and MDICP data quality" 1 (1): 31-76, 2003

46 Dillman, D. A, "Administrative issues in mixed mode surveys, In Telephone survey methodology" Wiley 509-528, 1988

47 Likert, R, "A technique for the measurement of attitudes" 140 : 1-55, 1932

48 Worcester, R. M, "A statistical examination of the relative precision of verbal scales" 17 (17): 181-197, 1975

49 Cobanoglu, C, "A comparison of mail, fax and web-based survey methods" 43 (43): 441-452, 2001

50 Friedman, H. H, "A comparison of balanced and unbalanced rating scales" 19 (19): 1-7, 1981

51 Schwarz, N, "A cognitive model of response-order effects in survey measurement, In Context effects in social and psychological research" Springer-Verlag 187-199, 1992

52 Noh, Y, "A Study on Metadata Elements for Web-based Reference Resources System Developed through Usability Testing" 29 (29): 242-265, 2010

53 "A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries" ELSEVIER SCIENCE INC 36 (36): 41-52, 2010