웹 기반 심리 평가의 타당화 = Validation of Web-based Psychological Assessments

다국어 초록 (Multilingual Abstract)

This study compared data from web-based psychological experiments and self-reporting questionnaires with data from laboratory experiments and paper-pencil tests to verify the validity of web-based psychological assessment. In study 1, a total of 14 subjects participated in a comparative experiment, in which each participant performed both laboratory and two types of web-based attention tasks(IOR and CPT). The results of paired-sample t-test, there were no significant differences between the measurements for two different formats. This result may show the equivalence of the results from the two types of experiments(lab-based and web-based). In study 2, we examined paired-sample t-test and test-retest pearson correlation of each self-reported questionnaire subscale to evaluate if there were statistically significant differences between paper-pencil and web-based formats. The results revealed that mean subscales for two formats were not significantly different and subscale scores were highly correlated with each other. This results also suggested that web-based questionnaire data can be dealt equivalently with paper-pencil administered data.

국문 초록 (Abstract)

본 연구는 웹 기반 심리 평가의 타당도 검증을 위해 실험과 설문 평가에 대한 웹 기반과 실험실 기반 자료를 비교하였다. 먼저 연구 1에서는 웹 기반 실험의 타당도를 밝히기 위해 동일한 피험자들을 대상으로 주의력 검사 실험과제인 회귀억제(IOR) 과제와 연속 수행 과제(CPT)를 웹 기반과 실험실 기반으로 실시하였다. 상관표본 t 검증으로 분석한 결과, 이들 두 과제에 대한 웹 기반과 실험실 기반의 종속측정치들이 모두 통계적으로 유의한 차이가 관찰되지 않았다. 이는 웹 기반 실험의 수행 결과가 실험실 기반 실험의 결과와 동등함을 시사한다. 연구 2에서는 웹 기반 설문 평가의 타당도를 검증하기 위해 웹 기반과 지필형 설문에 중복 참여한 자료를 바탕으로 각 척도 평균을 비교하고, 상관을 알아본 결과, 지필형과 웹 기반 설문의 각 척도에 대한 평균의 차이가 유의하지 않았고, 두 방법을 통한 각 척도점수는 매우 높은 상관을 나타냈다. 이는 웹을 통한 설문 역시 지필형과 동등하게 해석할 수 있다는 것을 의미한다.

참고문헌 (Reference)

1 곽호완, "회귀억제효과로 본 억제적 주의과정의 기제" 8 (8): 133-146, 1996

2 김영환, "회귀억제효과로 본 알쯔하이머 형 노인치매환자의 억제적 주의장애" 7 (7): 131-142, 1995

3 김호영, "한국판 Conners 성인 ADHD 평정척도의 신뢰도 및 타당도 연구: 대학생 표본을 중심으로" 한국임상심리학회 24 (24): 171-186, 2005

4 채선희, "컴퓨터화된 개별적응검사와 지필식 검사에 있어서 문항 모수값의 동등성 검증" 8 (8): 145-160, 1995

5 서현주, "웹을 이용한 초등학생 심리검사 시스템의 설계 및 구현" 6 (6): 228-235, 2001

6 곽호완, "신경심리평가 (Neuropsychological Testing)"

7 정진영, "성인 ADHD 성향군의 회귀억제와 반응억제 결함" 한국심리학회 27 (27): 179-196, 2008

8 곽호완, "성인 ADHD 경향성에 대한 웹기반 실험신경심리 연구: 회귀억제, 스트룹 및 내생-외생 주의과제" 한국임상심리학회 26 (26): 1039-1056, 2007

9 김영환, "대인관계문제검사 매뉴얼" 학지사 2002

10 이영호, "귀인양식, 생활사건, 사건귀인 및 무망감과 우울의 관계: 공변량 구조모형을 통한 분석" 서울대학교 1993

11 Krantz, J. H., "Validity of web-based psychological research in Psychological experiments on the internet" Academic Press 35-60, 2000

12 Birnbaum, M. H., "Validity of web-based psychological research in Psychological experiments on the Internet" Academic Press 35-60, 2000

13 Carlbring, P., "Treatment of panic disorder: live therapy vs. self-help via the internet" 43 (43): 1321-1333, 2005

14 Reips, U. D., "The web experiment method: advantages, disadvantages, and solutions in Psychological experiments on the Internet" Academic Press 89-114, 2000

15 Rosenthal, R., "The volunteer subject in Artifact in behavioral research" Academic Press 1969

16 Chapanis, A., "The relevance of laboratory studies to practical situation in The science of psychology: critical reflections" Appleton Century Crofts 1970

17 Rosenthal, R., "The effect of experimenter bias on the performance of the albino rat" 8 : 183-189, 1973

18 Smart, R., "Subject selection bias in psychological research" 7 : 115-121, 1966

19 Reips, U. D., "Standards for internet-based experimenting" 49 (49): 243-256, 2002

20 Rosenberg. M., "Society and adolescent self- image" Princeton University press 1965

21 Conners, C. K., "Self-ratings of ADHD symptoms in Adults I: Factor structure and normative data" 3 : 141-151, 1999

22 Buchanan, T., "Research on the internet: validation of a World-Wide-Web mediated personality scale" 31 : 565-571, 1999

23 Cook, T. D., "Quasi-experimentation in Handbook of industial and organizational psychology" Consulting Psychologists Press 491-576, 1990

24 Orne, M. T., "On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications" 27 : 959-962, 1962

25 Krantz, J. H., "On belief bias in syllogistic reasoning" 107 : 852-884, 2000

26 Birnbaum, M. H., "Introduction to behavioral research on the Internet in Introduction to behavioral research on the Internet" Prentice-Hall 1-12, 2001

27 Richard, J., "Internet-based treatment for panic disorder" 32 : 125-135, 2003

28 Buchanan, T., "Internet-based questionnaire assessment: appropriate use in clinical contexts" 32 (32): 100-109, 2003

29 Barak, A., "Internet-Based Psychological Testing and Assessment in Online Counseling: A Handbook for Mental Health Professionals" Academic Press 2003

30 Carlbring, P., "Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research" 23 : 1421-1434, 2007

31 Andersson, G., "Internet administration of the Hospital Anxiety & Depression Scale in a sample of tinnitus patients" 55 : 259-262, 2003

32 Pohl, R. F., "Hindsight bias around the world" 49 (49): 2002

33 Reips, U. D., Morger, V., & Meier B., "Funfe gerade sein lassen: listenkontexteffekte beim Kategorisieren [Letting five be equal: list context effects in categorization]"

34 Brand, A. & Hahn, U., "Evaluating the validity of internet experiments: verbal overshadowing as a case study"

35 Buchanan, T., "Development of a behavioural measure of self-disclosure for use in online research" German Online Research' 02. Hohenheim 2002

36 Reips, U. D., "Das psychologische experimentieren im Internet [Psychological experimenting on the Internet] in Internet for psychologen" Hogrefe 245-265, 1997

37 Conners, C. K., "Conners' adult ADHD rating scales, technical manual" Multi-Health Systems 1999

38 Tseng, H., "Computer anxiety and measurement of mood change" 13 : 305-316, 1997

39 Krantz, J. H., "Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness" 29 : 264-269, 1997

40 이영호, "BDI, SDS, MMPI-D 척도의 신뢰도 및 타당도에 대한 연구" 10 (10): 98-113, 1991

41 Barkley, R. A., "Attention-Deficit Hyperactivity Disorder: A Clinical workbook" Guilford Press 1998

42 Pagani, D., "An intercultural examination of facial features communicating surprise in Psychological experiments on the internet" Academic Press 169-194, 2000

43 Brand, A., "A web experiment based enquiry into the verbal overshadowing effect"

44 Brand, A., "A web experiment based enquiry into the verbal overshadowing effect"

45 Musch, J., "A brief history of Web experimenting in Psychological experiments on the internet" Academic Press 61-87, 2000