Validation of Web-based Psychological Assessments

본 연구는 웹 기반 심리 평가의 타당도 검증을 위해 실험과 설문 평가에 대한 웹 기반과 실험실 기반 자료를 비교하였다. 먼저 연구 1에서는 웹 기반 실험의 타당도를 밝히기 위해 동일한 피험자들을 대상으로 주의력 검사 실험과제인 회귀억제(IOR) 과제와 연속 수행 과제(CPT)를 웹 기반과 실험실 기반으로 실시하였다. 상관표본 t 검증으로 분석한 결과, 이들 두 과제에 대한 웹 기반과 실험실 기반의 종속측정치들이 모두 통계적으로 유의한 차이가 관찰되지 않았다. 이는 웹 기반 실험의 수행 결과가 실험실 기반 실험의 결과와 동등함을 시사한다. 연구 2에서는 웹 기반 설문 평가의 타당도를 검증하기 위해 웹 기반과 지필형 설문에 중복 참여한 자료를 바탕으로 각 척도 평균을 비교하고, 상관을 알아본 결과, 지필형과 웹 기반 설문의 각 척도에 대한 평균의 차이가 유의하지 않았고, 두 방법을 통한 각 척도점수는 매우 높은 상관을 나타냈다. 이는 웹을 통한 설문 역시 지필형과 동등하게 해석할 수 있다는 것을 의미한다.

keywords: 웹 기반 실험, 웹 기반 설문 평가, 타당도, web-based experiment, web-based questionnaire, validity, web-based experiment, web-based questionnaire, validity

Abstract

This study compared data from web-based psychological experiments and self-reporting questionnaires with data from laboratory experiments and paper-pencil tests to verify the validity of web-based psychological assessment. In study 1, a total of 14 subjects participated in a comparative experiment, in which each participant performed both laboratory and two types of web-based attention tasks(IOR and CPT). The results of paired-sample t-test, there were no significant differences between the measurements for two different formats. This result may show the equivalence of the results from the two types of experiments(lab-based and web-based). In study 2, we examined paired-sample t-test and test-retest pearson correlation of each self-reported questionnaire subscale to evaluate if there were statistically significant differences between paper-pencil and web-based formats. The results revealed that mean subscales for two formats were not significantly different and subscale scores were highly correlated with each other. This results also suggested that web-based questionnaire data can be dealt equivalently with paper-pencil administered data.

keywords: 웹 기반 실험, 웹 기반 설문 평가, 타당도, web-based experiment, web-based questionnaire, validity, web-based experiment, web-based questionnaire, validity

참고문헌

곽호완 ; 장문선, (2007) 성인 ADHD 경향성에 대한 웹기반 실험신경심리 연구: 회귀억제, 스트룹 및 내생-외생 주의과제, 한국심리학회지 임상

곽호완, (1996) 회귀억제효과로 본 억제적 주의과정의 기제, 한국심리학회지: 실험 및 인지

곽호완, 신경심리평가 (Neuropsychological Testing),

김영환, (1995) 회귀억제효과로 본 알쯔하이머 형 노인치매환자의 억제적 주의장애, 한국심리학회지: 실험 및 인지

김영환, (2002) 대인관계문제검사 매뉴얼, 학지사

김호영 ; 이임순 ; 김지혜 ; 이주영 ; 조상수, (2005) 한국판 Conners 성인 ADHD 평정척도의 신뢰도 및 타당도 연구: 대학생 표본을 중심으로, 한국심리학회지 임상

서현주, (2001) 웹을 이용한 초등학생 심리검사 시스템의 설계 및 구현, 한국정보교육학회 논문지

이영호, (1993) 귀인양식, 생활사건, 사건귀인 및 무망감과 우울의 관계: 공변량 구조모형을 통한 분석, 서울대학교

이영호, (1991) BDI, SDS, MMPI-D 척도의 신뢰도 및 타당도에 대한 연구, 한국심리학회지: 임상

10.

정진영 ; 곽호완 ; 장문선, (2008) 성인 ADHD 성향군의 회귀억제와 반응억제 결함, 한국심리학회지:일반

11.

채선희, (1995) 컴퓨터화된 개별적응검사와 지필식 검사에 있어서 문항 모수값의 동등성 검증, 교육평가연구

12.

Andersson, G., (2003) Internet administration of the Hospital Anxiety & Depression Scale in a sample of tinnitus patients, Journal of Psychosomatic Research

13.

Barak, A., (2003) Internet-Based Psychological Testing and Assessment in Online Counseling: A Handbook for Mental Health Professionals, Academic Press

14.

Barkley, R. A., (1998) Attention-Deficit Hyperactivity Disorder: A Clinical workbook, Guilford Press

15.

Birnbaum, M. H., (2000) Validity of web-based psychological research in Psychological experiments on the Internet , Academic Press

16.

Birnbaum, M. H., (2001) Introduction to behavioral research on the Internet in Introduction to behavioral research on the Internet , Prentice-Hall

17.

Brand, A., A web experiment based enquiry into the verbal overshadowing effect,

18.

Brand, A., A web experiment based enquiry into the verbal overshadowing effect,

19.

Brand, A. & Hahn, U., Evaluating the validity of internet experiments: verbal overshadowing as a case study,

20.

Buchanan, T., (2003) Internet-based questionnaire assessment: appropriate use in clinical contexts, Cognitive Behavior Therapy

21.

Buchanan, T., (1999) Research on the internet: validation of a World-Wide-Web mediated personality scale, Behavior Research Methods Instruments and Computer

22.

Buchanan, T., (2002) Development of a behavioural measure of self-disclosure for use in online research, German Online Research' 02. Hohenheim

23.

Carlbring, P., (2007) Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research, Computers in Human Behavior

24.

Carlbring, P., (2005) Treatment of panic disorder: live therapy vs. self-help via the internet, Behaviour Research and Therapy

25.

Chapanis, A. , (1970) The relevance of laboratory studies to practical situation in The science of psychology: critical reflections, Appleton Century Crofts

26.

Conners, C. K., (1999) Self-ratings of ADHD symptoms in Adults I: Factor structure and normative data, Journal of Attention Disorder

27.

Conners, C. K., (1999) Conners' adult ADHD rating scales, technical manual, Multi-Health Systems

28.

Cook, T. D., (1990) Quasi-experimentation in Handbook of industial and organizational psychology , Consulting Psychologists Press

29.

Krantz, J. H., (2000) Validity of web-based psychological research in Psychological experiments on the internet , Academic Press

30.

Krantz, J. H., (2000) On belief bias in syllogistic reasoning, Psychological Review

31.

Krantz, J. H., (1997) Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness, Behavior Research Methods Instruments and Computers

32.

Musch, J., (2000) A brief history of Web experimenting in Psychological experiments on the internet , Academic Press

33.

Orne, M. T., (1962) On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications, American Psychologist

34.

Pagani, D., (2000) An intercultural examination of facial features communicating surprise in Psychological experiments on the internet , Academic Press

35.

Pohl, R. F., (2002) Hindsight bias around the world, Experimental Psychology

36.

Reips, U. D., (1997) Das psychologische experimentieren im Internet [Psychological experimenting on the Internet] in Internet for psychologen , Hogrefe

37.

Reips, U. D., (2000) The web experiment method: advantages, disadvantages, and solutions in Psychological experiments on the Internet , Academic Press

38.

Reips, U. D., (2002) Standards for internet-based experimenting, Experimental Psychology

39.

Reips, U. D., Morger, V., & Meier B., Funfe gerade sein lassen: listenkontexteffekte beim Kategorisieren [Letting five be equal: list context effects in categorization],

40.

Richard, J., (2003) Internet-based treatment for panic disorder, Cognitive Behavior Therapy

41.

Rosenberg. M. , (1965) Society and adolescent self- image, Princeton University press

42.

Rosenthal, R., (1973) The effect of experimenter bias on the performance of the albino rat, Behavioral Science

43.

Rosenthal, R., (1969) The volunteer subject in Artifact in behavioral research, Academic Press

44.

Smart, R., (1966) Subject selection bias in psychological research, Canadian Psychologist

45.

Tseng, H., (1997) Computer anxiety and measurement of mood change, Computers in Human Behavior

바로가기메뉴

논문 상세

Vol.20 No.4

웹 기반 심리 평가의 타당화

Validation of Web-based Psychological Assessments

초록

Abstract

참고문헌

한국심리학회지: 인지 및 생물