바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Validation of Web-based Psychological Assessments

The Korean Journal of Cognitive and Biological Psychology / The Korean Journal of Cognitive and Biological Psychology, (P)1226-9654; (E)2733-466X
2008, v.20 no.4, pp.321-337
https://doi.org/10.22172/cogbio.2008.20.4.007



Abstract

This study compared data from web-based psychological experiments and self-reporting questionnaires with data from laboratory experiments and paper-pencil tests to verify the validity of web-based psychological assessment. In study 1, a total of 14 subjects participated in a comparative experiment, in which each participant performed both laboratory and two types of web-based attention tasks(IOR and CPT). The results of paired-sample t-test, there were no significant differences between the measurements for two different formats. This result may show the equivalence of the results from the two types of experiments(lab-based and web-based). In study 2, we examined paired-sample t-test and test-retest pearson correlation of each self-reported questionnaire subscale to evaluate if there were statistically significant differences between paper-pencil and web-based formats. The results revealed that mean subscales for two formats were not significantly different and subscale scores were highly correlated with each other. This results also suggested that web-based questionnaire data can be dealt equivalently with paper-pencil administered data.

keywords
웹 기반 실험, 웹 기반 설문 평가, 타당도, web-based experiment, web-based questionnaire, validity, web-based experiment, web-based questionnaire, validity

Reference

1.

곽호완 ; 장문선, (2007) 성인 ADHD 경향성에 대한 웹기반 실험신경심리 연구: 회귀억제, 스트룹 및 내생-외생 주의과제, 한국심리학회지 임상

2.

곽호완, (1996) 회귀억제효과로 본 억제적 주의과정의 기제, 한국심리학회지: 실험 및 인지

3.

곽호완, 신경심리평가 (Neuropsychological Testing),

4.

김영환, (1995) 회귀억제효과로 본 알쯔하이머 형 노인치매환자의 억제적 주의장애, 한국심리학회지: 실험 및 인지

5.

김영환, (2002) 대인관계문제검사 매뉴얼, 학지사

6.

김호영 ; 이임순 ; 김지혜 ; 이주영 ; 조상수, (2005) 한국판 Conners 성인 ADHD 평정척도의 신뢰도 및 타당도 연구: 대학생 표본을 중심으로, 한국심리학회지 임상

7.

서현주, (2001) 웹을 이용한 초등학생 심리검사 시스템의 설계 및 구현, 한국정보교육학회 논문지

8.

이영호, (1993) 귀인양식, 생활사건, 사건귀인 및 무망감과 우울의 관계: 공변량 구조모형을 통한 분석, 서울대학교

9.

이영호, (1991) BDI, SDS, MMPI-D 척도의 신뢰도 및 타당도에 대한 연구, 한국심리학회지: 임상

10.

정진영 ; 곽호완 ; 장문선, (2008) 성인 ADHD 성향군의 회귀억제와 반응억제 결함, 한국심리학회지:일반

11.

채선희, (1995) 컴퓨터화된 개별적응검사와 지필식 검사에 있어서 문항 모수값의 동등성 검증, 교육평가연구

12.

Andersson, G., (2003) Internet administration of the Hospital Anxiety & Depression Scale in a sample of tinnitus patients, Journal of Psychosomatic Research

13.

Barak, A., (2003) Internet-Based Psychological Testing and Assessment in Online Counseling: A Handbook for Mental Health Professionals, Academic Press

14.

Barkley, R. A., (1998) Attention-Deficit Hyperactivity Disorder: A Clinical workbook, Guilford Press

15.

Birnbaum, M. H., (2000) Validity of web-based psychological research in Psychological experiments on the Internet , Academic Press

16.

Birnbaum, M. H., (2001) Introduction to behavioral research on the Internet in Introduction to behavioral research on the Internet , Prentice-Hall

17.

Brand, A., A web experiment based enquiry into the verbal overshadowing effect,

18.

Brand, A., A web experiment based enquiry into the verbal overshadowing effect,

19.

Brand, A. & Hahn, U., Evaluating the validity of internet experiments: verbal overshadowing as a case study,

20.

Buchanan, T., (2003) Internet-based questionnaire assessment: appropriate use in clinical contexts, Cognitive Behavior Therapy

21.

Buchanan, T., (1999) Research on the internet: validation of a World-Wide-Web mediated personality scale, Behavior Research Methods Instruments and Computer

22.

Buchanan, T., (2002) Development of a behavioural measure of self-disclosure for use in online research, German Online Research' 02. Hohenheim

23.

Carlbring, P., (2007) Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research, Computers in Human Behavior

24.

Carlbring, P., (2005) Treatment of panic disorder: live therapy vs. self-help via the internet, Behaviour Research and Therapy

25.

Chapanis, A. , (1970) The relevance of laboratory studies to practical situation in The science of psychology: critical reflections, Appleton Century Crofts

26.

Conners, C. K., (1999) Self-ratings of ADHD symptoms in Adults I: Factor structure and normative data, Journal of Attention Disorder

27.

Conners, C. K., (1999) Conners' adult ADHD rating scales, technical manual, Multi-Health Systems

28.

Cook, T. D., (1990) Quasi-experimentation in Handbook of industial and organizational psychology , Consulting Psychologists Press

29.

Krantz, J. H., (2000) Validity of web-based psychological research in Psychological experiments on the internet , Academic Press

30.

Krantz, J. H., (2000) On belief bias in syllogistic reasoning, Psychological Review

31.

Krantz, J. H., (1997) Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness, Behavior Research Methods Instruments and Computers

32.

Musch, J., (2000) A brief history of Web experimenting in Psychological experiments on the internet , Academic Press

33.

Orne, M. T., (1962) On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications, American Psychologist

34.

Pagani, D., (2000) An intercultural examination of facial features communicating surprise in Psychological experiments on the internet , Academic Press

35.

Pohl, R. F., (2002) Hindsight bias around the world, Experimental Psychology

36.

Reips, U. D., (1997) Das psychologische experimentieren im Internet [Psychological experimenting on the Internet] in Internet for psychologen , Hogrefe

37.

Reips, U. D., (2000) The web experiment method: advantages, disadvantages, and solutions in Psychological experiments on the Internet , Academic Press

38.

Reips, U. D., (2002) Standards for internet-based experimenting, Experimental Psychology

39.

Reips, U. D., Morger, V., & Meier B., Funfe gerade sein lassen: listenkontexteffekte beim Kategorisieren [Letting five be equal: list context effects in categorization],

40.

Richard, J., (2003) Internet-based treatment for panic disorder, Cognitive Behavior Therapy

41.

Rosenberg. M. , (1965) Society and adolescent self- image, Princeton University press

42.

Rosenthal, R., (1973) The effect of experimenter bias on the performance of the albino rat, Behavioral Science

43.

Rosenthal, R., (1969) The volunteer subject in Artifact in behavioral research, Academic Press

44.

Smart, R., (1966) Subject selection bias in psychological research, Canadian Psychologist

45.

Tseng, H., (1997) Computer anxiety and measurement of mood change, Computers in Human Behavior

The Korean Journal of Cognitive and Biological Psychology