과학학습의 정의적 영역에서 사전-사후 통합 검사 설계의 타당화 연구: 과학영재를 대상으로 = A Validation Study of Retrospective Pre-post Testin the Affective Domain in Science Learning:for Scientifically Gifted Elementary Students

다국어 초록 (Multilingual Abstract)

In this study, the reliability and validity of the retrospective pre-post test were analyzed in order to solve the problem of traditional pre-post test including response shift bias. Samples of the study were 162 elementary school students who are studying at the S university gifted education center in Seoul. Before completion of the field trip, we conducted pre test of science-related attitudes. After completion of the field trip, respondents were asked to compare their responses of pre and post science-related attitudes to quantitatively analyze the commonalities and differences of the two tests. To find out more characteristics, qualitative data such as daily records and interview were also gathered and analyzed. The major results of the study are as follows. First, for the paired t-test, there was no statistically significant difference between separate pre-test scores and retrospective pre-test. There was a very high correlation between the separate pre-test scores and the retrospective pre-test. Second, there were significant differences in all seven sub-factors of science-related attitudes between the retrospective pre-test and the post-test. Third, the separate pre-test scores showed a slightly higher tendency than the retrospective pre-test scores. This suggests that the response shift bias appears when it is performed the separate pre-test in affective domain. As a result of the interview, it was found that the evaluation standards of separate pre-test did not match with those of post-test. Forth, internal consistency reliability of the retrospective pre-test was higher than that of the separate pre-test. However, there were significant differences in six factors of science-related attitudes excluding the 'social implications of science' between the separate pre-test and the post-test. Based on these results, the retrospective pre-post test design provides simplicity and convenience to both respondents and investigators, as it is done with one test. The retrospective pre-post test design can be regarded as a valid design for the self-report measurement of affective domain on a single experimental group.

참고문헌 (Reference)

1 성태제, "타당도와 신뢰도" 학지사 2002

2 성태제, "연구방법론" 학지사 2014

3 이학식, "연구디자인이 Cronbach’s α 계수에미치는 영향" 12 (12): 209-221, 1997

4 한국교육심리학회, "교육심리학 용어사전" 학지사 2000

5 Colosi, L., "What’s the difference:“Post the pre” & pre then post" Cornell Cooperative Extension 2006

6 Davis, G. A., "Using a retrospective pre-post questionnaire to determine program impact" 41 (41): 1-5, 2003

7 Henson, R. K., "Understanding internal consistency reliability estimates : A conceptual primer on coefficient alpha" 34 (34): 177-189, 2001

8 Lamb, T., "The retrospective pretest : An imperfect but useful tool" 11 (11): 18-19, 2005

9 Fraser, B. J., "TOSRA: Test of science-related attitudes:Handbook" Australian Council for Educational Research 1981

10 Hill, L. G., "Revisiting the retrospective pretest" 26 (26): 501-517, 2005

11 Howard, G. S., "Response-shift bias : A source of contamination of self-report measures" 64 (64): 144-150, 1979

12 Churchill Jr, G. A., "Research design effects on the reliability of rating scales: A meta-analysis" 360-375, 1984

13 Schwartz, C. E., "Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal" 2 (2): 16-, 2004

14 Cook, T. D., "Quasiexperimentation : Design & analysis issues for field settings(Vol. 351)" Houghton Mifflin 1979

15 Dimitrov, D. M., "Pretest-posttest designs and measurement of change. Work : Journal of Prevention" 20 (20): 159-165, 2003

16 Rockwell, S. K., "Post-then-pre evaluation : Measuring behavior change more accurately" 27 : 19-21, 1989

17 Pratt, C. C., "Measuring program outcomes : Using retrospective pretest methodology" 21 (21): 341-349, 2000

18 Rohs, F. R., "Increased accuracy in measuring leadership impacts" 4 (4): 150-158, 1997

19 Cronbach, L. J., "How we should measure"change’ : Or should we?" 74 (74): 68-80, 1970

20 Fraenkel, J. R, "How to design and evaluate research in education" McGraw-Hill Higher Education 2014

21 Campbell, D. T., "Handbook of Research on Teaching" 171-246, 1963

22 Creswell, J. W., "Handbook of Mixed Methods in Social and Behavioral Research" 209-240, 2003

23 Schwartz, C. E., "Exploring response shift in longitudinal data" 19 (19): 51-69, 2004

24 Marshak, H. H., "Evaluation of a peer-taught nutrition education program for low-income parents" 30 (30): 314-322, 1998

25 Gall, M. D., "Educational research: An introduction" Pearson Education, Inc 2006

26 Marino, L., "Do zoos and aquariums promote attitude change in visitors? A critical evaluation of the American zoo and aquarium study" 18 (18): 126-138, 2010

27 Stevens, G. L., "Community coalitions : Identifying changes in coalition members as a result of training" 37 (37): 1-9, 1999

28 Anderson, L. W., "Assessing affective characteristics in the schools" Erlbaum 2000

29 Peterson, R. A., "A meta-analysis of Cronbach’s coefficient alpha" 21 (21): 381-391, 1994