The Korean Journal of Health Psychology
- KOREAN
- P-ISSN1229-070X
- E-ISSN2713-9581
- KCI
Two measurement models of testing measurement equivalence: an example of Child Behavior Checklist
E. Michael Foster (University of North Carolina at Chapel Hill)
Michael J. Rovine (The Pennsylvania State University)
Abstract
In children's mental health, many psychological assessments are critical to measure end outcomes. And equally valid measures are essential for health services outcome research in diverse populations. Examination of equal validity in tests measuring the emotional, motivational, attitudinal, and interpersonal characteristics of children can be achieved with factor analytic tools. Factor analysis assumes a particular measurement model, effect indicator model. However, some psychological measures such as Child Behavior Checklist are not clear whether effect indicator model is assumed. In this paper, an alternative measurement model, causal indicator model, was introduced. Measurement equivalence of CBCL was tested using multiple group analysis based on effect indicator model and using principal component analysis based on causal indicator model. The results showed that measurement equivalence tests based on the two measurement models in CBCL led to similar conclusions. We conclude that the two measurement models could be complementary for explaining differential validity of psychological measures across sub-populations.
- keywords
- effect indicator, causal indicator, measurement equivalence, CBCL†Corresponding author : Eun-Jeong Kang, Korea Institute for Health and Social Affairs, San 42-14 Bulkwang-dong, Eunpyong-gu, Seoul, E-mail: marchej@kihasa.re.krIn children's mental hea, 효과 지표 모형, 인과 지표 모형, 측정 동등성, CBCLAppendix., effect indicator, causal indicator, measurement equivalence, CBCL†Corresponding author : Eun-Jeong Kang, Korea Institute for Health and Social Affairs, San 42-14 Bulkwang-dong, Eunpyong-gu, Seoul, E-mail: marchej@kihasa.re.krIn children's mental hea
Reference
Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 Profile: Department of Psychiatry, University of Vermont.
Achenbach, T. M., & McConaughy, S. H. (1997). Empirically Based Assessment of Child and Adolescent Psychopathology: Practical Applications (2 ed.) (Vol. 13). Thousand Oaks, CA: SAGE publications.
Afifi, A. A., & Clark, V. (1996). Computer-aided multivariate analysis (3 ed.). New York, NY: Chapman & Hall.
Ben-Porath, Y. S. (1990). Cross-cultural assessment of personality: The case for replicatory factor analysis. In J. N. Butcher, Spielberger, C.D. (Ed.), Advances in personlity assessment (Vol. 8, pp. 27-85). Hillsdale, NJ: Lawrence Erlbaum Associates.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(238-246).
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606.
Bird, H. R. (1996). Epidemiology of childhood disorders in a cross-cultural context. Journal of Child Psychology and Psychiatry, 37(1), 35-49.
Blalock, H. M. (1964). Causal inferences in nonexperimental research. Chapel Hill: University of North Carolina Press.
Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: a structural equation perspective. Psychological Bulletin, 110(2), 305-314.
Borsboom, D., Mellenbergh, G. J., & Heerden, J. v. (2003). The theoretical status of latent variables. Psychological Review, 110(2), 203-219
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230-258.
Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456-466.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255.
Cohen, P., & Kasen, S. (1999). The context of assessment: Culture, race, and socioeconomic status as influences on the assessment of children. In D. Shaffer, Lucas, C.P., Richters, J.E. (Ed.), Diagnostic assessment in child and adolescent psychopathology (pp. 299-318). New York, NY: The Guilford Press.
Cole, N. S., & Moss, P. A. (1989). Bias in Test Use. In L. L. Robert (Ed.), Educational Measurement (3 ed., pp. 201-219). New York, NY: Macmillan.
Dedrick, R. F., Greenbaum, P. E., Friedman, R. M., Wetherington, C. M., & Knoff, H. M. (1997). Testing the structure of the Child Behavior Checklist/4-18 using confirmatory factor analysis. Educational and Psychological Measurement, 57(2), 306-313.
DeGroot, A., Koot, H. M., & Verhulst, F. C. (1994). Cross-cultural generalizability of the Child Behavior Checklist cross-informant syndromes.
Edwards, J. R., & Bagozzi, R. P. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5(2), 155-174.
Fayers, P. M., & Hand, D. J. (1997). Factor analysis, causal indicators and quality of life. Quality of Life Research, 6, 139-150.
Fornell, C., & Bookstein, F. L. (1982). Two structural equation models: LISREL and PLS applied to consumer exit-voice theory. Journal of Marketing Research, 19, 440-452
Hartman, C. A., Hox, J., Auerbach, J., Erol, N., Fonseca, A. C., Mellenbergh, G. J., Novik, T. S., Oosterlaan, J., Roussos, A. C., Shalev, R. S., & Zilber, N. (1999). Syndrome dimensions of the Child Behavior Checklist and the Teacher Report Form: A critical empirical evaluation. Journal of Child Psychology and Psychiatry, 40(7), 1095-1116.
Hu, L., & Bentler, P. M. (1999). Cutoff criterion for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Hudziak, J. J., Wadsworth, M. E., Heath, A. C., & Achenbach, T. M. (1999). Latent class analysis of Child Behavior Checklist attention problems. Journal of American Academy of Child and Adolescent Psychiatry, 38(8), 985-991.
Lambert, M. C., Schmitt, N., Samms-Vaughan, M. E., An, J. S., Fairclough, M., & Nutter, C. A. (2003). Is it prudent to administer all items for each Child Behavior Checklist Cross-Informant syndrome? Evaluating the psychometric properties of the Youth Self-Report dimensions with confirmatory factor analysis and item response theory. Psychological Assessment, 15(4), 550-568.
Loeber, R., Farrington D. P., Stouthamer-Loeber M., & Van Kammen, W. B. (1998) Antisocial behavior and mental health problems. Explanatory factors in childhood and adolescence. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
MacCallum, R. C., & Browne, M. W. (1993). The use of causal indicators in covariance structure models: some practical issues. Psychological Bulletin, 114(3), 533-541.
Macro International Inc. (1997). Annual Report To Congress on the Evaluation of the Comprehensive Community Mental Health Services For Children and Their Families Program . Atlanta, GA: Macro International Inc.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543.
Meredith, W. (1964). Notes on factorial invariance. Psychometrika, 29(2), 177-185.
Muthen, B. O., Hasin, D., & Wisnicki, K. S. (1993). Factor analysis of ICD-10 symptom items in the 1988 National Health Interview Survey on alcohol
Muthen, L. K., & Muthen, B. O. (1998-2001). Mplus User's Guide (2 ed.). Los Angeles, CA: Muthen & Muthen.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3 ed.). New York: McGroaw-Hill, Inc.
Reynolds, C. R., & Paget, K. D. (1981). Factor analysis of the Revised Children's Manifest Anxiety Scale for Blacks, Whites, Males, and Females with a national normative sample. Journal of Counseling and Clinical Psychology, 49(3), 352-359.
Song, L., Sing, J., & Singer, M. (1994). The Youth Self-report Inventory: A study of its measurement fidelity. Psychological Assessment, 6(3), 236-245.
Spector, P. E. (1992). Summated rating scale construction (Vol. 82). Newbury Park: SAGE.
Steiger, J. H. (1990). Structural model evaluation and modification: an interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
Stewart, A. L., & Napoles-Springer, A. (2000). Health-related quality-of-life assessments in diverse population groups in the United States. Medical Care, 38(9 Supplement II), II102-II124
Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1-10.
Vandenberg, R. J. (2002). Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures. Organizational Research Methods, 5(2), 139-158.
Vanderberg, R. J., & Lance, C. E. (2000). A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organizational Research Methods, 3(1), 4-69.
Wadsworth, M. E., Hudziak, J. J., Heath, A. C., & Achenbach, T. M. (2001). Latent class analysis of Child Behavior Checklist anxiety/depression in children and adolescents. Journal of American Academy of Child and Adolescent Psychiatry, 40(1), 106-114.
- Downloaded
- Viewed
- 0KCI Citations
- 0WOS Citations