The Validation of the Korean Version of the Knowledge of Evidence-based Services Questionnaire

Chad, E. , & (2014). The Validation of the Korean Version of the Knowledge of Evidence-based Services Questionnaire. The Korean Journal of Health Psychology, 19(1), 119-146, https://doi.org/10.17315/kjhp.2014.19.1.007

copy

Abstract

In the present study, we made several necessary improvements of the Knowledge of Evidence-Based Services Questionnaire (KEBSQ)— a measure designed for measure Evidence-Based Practice (EBP) knowledge across various youth problem areas. First, we identified the presence of “bad” items that need to be discarded. Second, we identified the presence of two distinct KEBSQ item types: (1) items associated with “high coverage” and (2) items associated with “low coverage”. Results based on exploratory factor analysis, confirmatory factor analysis, and internal consistency estimates clearly showed that these “low coverage” and “high coverage” items have unique properties and should not be combined together to form a total score. Instead, their contrasting properties suggest that “low coverage” and “high coverage” items should comprise of two different versions of the KEBSQ tests. We also significantly reduced the length of KEBSQ by eliminating the “bad” items which create two separate 12-item and 18-item tests to assess knowledge on “low coverage” and “high coverage” treatment practices, respectively. Study implications and additional necessary research efforts are also discussed.

keywords: Assessment, Psychometrics, Standardization, Evidence-Based Treatments, Child Adolescent treatment, 측정, 심리측정학, 표준화, 근거기반치료, 아동청소년치료

Reference

Becker, K. D., Nakamura, B. J., Young, J., & Chorpita, B. F. (2009). What better place than here? What better time than now? ABCT's burgeoning role in the dissemination and implementation of evidence-based practices. The Behavior Therapist, 32, 89-96.

Bentler, P. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.

Brislin, R. (1970). Back-Translation for Cross-Cultural Research. Journal of Cross-Cultural Psychology, 1(3), 185-216.

Browne, M., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-159). Newbury Park, CA:Sage.

Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.

Chorpita, B. F. & Daleiden, E. L. (2009). 2009Biennial Report: Effective psychosocial interventions for youth with behavioral and emotional needs. Child and Adolescent Mental Health Division, Honolulu: Hawaii Department of Health.

Chorpita, B. F. & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322randomized trials. Journal of Consulting and Clinical Psychology, 77, 566-579.

Chorpita, B., Daleiden, E., Ebesutani, C., Young, J., Becker, K., Nakamura, B. J., Phillips, L., Ward, A., Lynch, R., Trent, L., Smith, R. L., Okamura, K., & Starace, N. (2011). Evidence Based Treatments for Children and Adolescents: An Updated Review of Indicators of Efficacy and Effectiveness. Clinical Psychology: Science and Practice, 18(2), 154-172.

Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Modularity in the design and application of therapeutic interventions. Applied and Preventive Psychology, 11(3), 141-156.

10.

Chorpita, B. F. & Regan, J. (2009). Dissemination of effective mental health treatment procedures:Maximizing the return on a significant investment. Behaviour Research & Therapy, 47, 990-993.

11.

Chorpita, B. F., Weisz, J. R., Daleiden, E. L., Schoenwald, S. K., Palinkas, L. A., Miranda, J., Higa-McMillan, C. K., Nakamura, B. J., Austin, A. A., Borntrager, C. F., Ward, A., Wells, K. C., & Gibbons, R. D. (2013). Long-term outcomes for the Child STEPs randomized effectiveness trial: A comparison of modular and standard treatment designs with usual care. Journal of Consulting And Clinical Psychology, 81(6), 999.

12.

Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A., Amundsen, M. J., McGee, C., Serrano, A., Yates, A., Burns, J. A., & Morelli, P. (2002). Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology:Science and Practice, 9(2), 165-190.

13.

Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, Available Online:http://pareonline.net/getvn.asp?v=10&n=7.

14.

Daleiden, E., Lee, J., & Tolman, R. (2008). Annual evaluation report: Fiscal year 2004. Honolulu, HI: Hawaii Department of Health, Child and Adolescent Mental Health Division 2004. Retrieved February 25, 2008, from http://hawaii.gov/health/mental-health/camhd/l ibrary/pdf/rpteval/ge/ge/ge011.pdf

15.

Daleiden, E., & Chorpita, B. F. (2005). From Data to Wisdom: Quality Improvement Strategies Supporting Large-scale Implementation of Evidence-Based Services. Child and Adolescent Psychiatric Clinics of North America, 14,(2), 329-349,

16.

Ebesutani, C., Bernstein, A., Chorpita, B., & Weisz, J. (2012). A transportable assessment protocol for prescribing youth psychosocial treatments in "real world" settings: Reducing assessment burden via self-report scales. Psychological Assessment, 24(1), 141-155.

17.

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. A., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Research Institute, The National Implementation Research Network, 2005. (FMHI Publication #231).

18.

Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179-1189.

19.

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis:Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

20.

Lonigan, C., Elbert, J., & Johnson, S. (1998). Empirically supported psychosocial interventions for children: An overview. Journal of Clinical Child Psychology, 27, 138-145.

21.

Muthen, L. K., & Muthen, B. O. (2010). Mplus User's Guide (4th Ed.). Los Angeles, CA:Author.

22.

Nakamura, B. J., Higa-McMillan, C. K., Okamura, K. H., & Shimabukuro, S. (2011). Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 287-300.

23.

Okamura, K. H., Nakamura, B. J., Mueller, C., Hayashi, K., & Higa-McMillan, C. K. (in press). An exploratory factor analysis of the knowledge of evidence-based services questionnaire. Journal of Behavioral Health Services and Research.

24.

Park, B. C., & Lester, D. (2006). Social integration and suicide in South Korea. Journal of Crisis Intervention and Suicide Prevention, 27(1), 48.

25.

Reise, S., Morizot, J., & Hays, R. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16, 19-31.

26.

Rogers, E. M. (2003). Diffusion of innovations (5th ed.). New York: Free Press.

27.

Steiger, J. H. (1990). Structural model evaluation and modification: an interval estimation approach. Multivariate Behavioral Research, 25, 173-180.

28.

Stumpf, R., Higa-McMillan, C., & Chorpita, B. (2009). Implementation of Evidence-Based Services for Youth: Assessing Provider Knowledge. Behavior Modification, 33, 48-65.

29.

Task Force on Promotion and Dissemination of Psychological Procedures. (1995). Training in and dissemination of empirically-validated psychological treatments: Report and recommendations. Clinical Psychologist, 48, 3-23.

30.

Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.

31.

Weersing, R. V., Weisz, J. R.., & Donenberg G. R. (2002). Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child Psychology, 31, 168-180.

32.

Weissman, M. M., Bland, R. C., Canino, G. J., Greenwald, S., Hwu, H. G., Joyce, P. R., Karam, E. G., Lee, C.-K., Lellouch J., Lepine, J.-P., Newman, S. C., Rubio-stipec, M., Wells, J. E., W ickramaratne, P. J., Wittchen, H.-U., & Yeh, E. K. (1999). Prevalence of suicide ideation and suicide attempts in nine countries. Psychological medicine, 29(1), 9-17.

33.

Weist, M., Lever, N., Stephan, S., Youngstrom, E., Moore, E., Harrison, B., Anthony, L., Rogers, K., Hoagwood, K., Ghunney, A., Lewis, K., & Stiegler, K. (2009). Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health, 1(4), 196-211.

34.

Yu, C., & Muthen, B. (2002). Evaluation of model fit indices for latent variable models with categorical and continuous outcomes. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.

바로가기메뉴

Article Contents

Vol.19 No.1

The Validation of the Korean Version of the Knowledge of Evidence-based Services Questionnaire

Abstract

Reference

The Korean Journal of Health Psychology