바로가기메뉴

본문 바로가기 주메뉴 바로가기

Korean Journal of Psychology: General

ISSN : 1229-067X

Article Contents

Prev Next
e-Submission

Vol.28 No.3
Citation Share

A Theoretical and Empirical Comparison between Intraclass Correlation and Generalizability

Korean Journal of Psychology: General / Korean Journal of Psychology: General, (P)1229-067X; (E)2734-1127
2009, v.28 no.3, pp.659-686



& (2009). A Theoretical and Empirical Comparison between Intraclass Correlation and Generalizability. Korean Journal of Psychology: General, 28(3), 659-686.
  • Downloaded
  • Viewed
PDF Download

Abstract

Researches report many different measures of reliability to establish accuracy of measurement. Intraclass correlation coefficient and generalizability theory are based on classical test theory and widely used for obtaining reliability measurement. They share some communality, however, they have different assumptions for estimation of reliability measures. If was observed that some measures rooted in different assumptions yield identical values. Also, it was found that definitions of reliability are different across different researchers in the context of intraclass correlation coefficients. In the present study we examined two studies defining the intraclass correlation differently. Also relationships between the reliability measures provided by intraclass correlation coefficient and generalizzbility theory are interpreted in the context of reliability alpha coefficient that is most widely used for a reliability measure.

keywords
신뢰도, 신뢰도 계수, 급내 상관, 일반화가능도 이론, reliability index, Cronbach의, Intraclass Correlation Coefficient, Generalizability

Reference

1.

강승호, 김양분 (2004). 신뢰도. 서울: 교육과학사.

2.

김성숙, 김양분 (2001). 일반화가능도 이론. 서울: 교육과학사.

3.

김성숙 (1993). 관찰을 통한 교수 평가 체계에 대한 측정의 일반화 가능도 연구. 교육학연구, 31(1), 23-40.

4.

양지승, 이규민 (2007). 일반화가능도 이론을 적용한 단위검사 구성 검사점수의 신뢰도 추정. 교육평가연구, 20(1), 119-139.

5.

이규민 (2003). 단위검사 개념의 적용-일반화가능도 이론을 중심으로-. 교육평가연구, 16(1), 53-70.

6.

이규민 (2006). 학생들의 동료평가를 활용한 수행평가 결과의 일반화가능도 분석. 교육평가연구, 19(3), 107-121.

7.

이종성 (1989). 일반화가능도 이론. 연세대학교출판부.

8.

이종구 (2001). SAS와 통계자료 분석. 학지사.

9.

Allen, M. J & Yen, W. M. (1979). Introduction to Measurement Theory (1st ed.). Long Grove, Illinois: Waveland Press. Inc.

10.

Anastasi, Anne (1982). Psychological Testing (6th ed.). NY: Macmillan.

11.

Brennan, R. L. (2001). Generalizability theory. NY: Springer.

12.

Brennan, R. L. (1983). Elements of generalizability theory. Iowa City, IA: American College Testing Program.

13.

Buros, O. K. (1963). Schematization of old and new concepts of test reliability based upon parametric models. New Brunswick, NJ: Gryphon Press.

14.

Clark, H. H. (1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12(4), 335-359.

15.

Cook, C. (2000). A review of intraclass correlation. The Annual Meeting of the Southwest Educational Research Association. (Dallas, Tx, January 27-29, 2000). 1-35.

16.

Crick, J. E. & Brennan, R. L. (1983). Mannual for GENOVA : A generalized analysis of variation system. Mid-Western Educational Researcher, v9. n2 p.2-4 Spr.

17.

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297-334..

18.

Croncach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. NY : Wiley.

19.

Ebel, R. L. (1951). Estimation of the reliability of ratings. Psychometrika, 16(4), 407-424.

20.

Fagot, R. F. (1991). Reliability of rating for multiple judges: Intraclass correlation and metric scales, Applied Psychological Measurement. 15(1), 1-11.

21.

Guttman, L. (1945). A basis for analyzing test- retest reliability. Psychometrika, 10, 255-282.

22.

Haggard, E. A. (1958). Intraclass correlation and the analysis of variance. NY: The Dryden Press.

23.

McDonald, R. P. (1999). Test Theory: A unified treatment. Mahwah, NJ: Erlbaum.

24.

McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30-46.

25.

Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420-428.

26.

Weir, J. P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Conditioning Research, 19(1), 231-240.

27.

Winer, B. J. (1971). Statistical principles in experimental design (2nd ed.). NY: McGraw- Hill.

Korean Journal of Psychology: General

e-Submission OA Policy