바로가기메뉴

본문 바로가기 주메뉴 바로가기

Korean Journal of Social and Personality Psychology

ISSN : 1229-0653

Article Contents

Prev
e-Submission

Vol.32 No.2

Citation Share

Inter-rater reliability in assessing the credibility of allegedly sexually abused child victims’ statements: Focusing on the CBCA expert group

Korean Journal of Social and Personality Psychology / Korean Journal of Social and Personality Psychology, (P)1229-0653;
2018, v.32 no.2, pp.67-83
https://doi.org/10.21193/kjspp.2018.32.2.004

(2018). Inter-rater reliability in assessing the credibility of allegedly sexually abused child victims’ statements: Focusing on the CBCA expert group. Korean Journal of Social and Personality Psychology, 32(2), 67-83, https://doi.org/10.21193/kjspp.2018.32.2.004

Abstract

Criteria-Based Contents Analysis(CBCA) is a statement-analysis technique that determines the veracity of sexually abused child victims’ statements. It consists of the 19 criteria that are most likely to exist in statements of children who are telling the truth. This study examined the inter-rater reliability of nine CBCA experts working for the Korean Police Agency. The experts evaluated the existing 19 CBCA criteria with five child sexual abuse cases. They were also asked to make a final decision as to whether the children’s statements were reliable or not. The results showed that 11 out of the 19 criteria indicated adequate inter-rater reliabilities, with coefficients of criterion 2(Unstructured production), 8(Unusual details), 9(Superfluous details), 11(Related associations), and 14(Spontaneous corrections) being low. The agreement coefficient of the overall judgments of the reliability of the children’s statements was .511, showing an adequate level of reliability. The implications of these findings for the use of CBCA reports in making credibility decisions in the forensic contexts are discussed.

keywords
진술분석, 진술타당도평가, 준거기반내용분석, CBCA, 진술분석전문가, 평가자간 신뢰도, Statement Validity Assessment, Criteria-Based Content Analysis, expert testimony, inter-rater reliability

Reference

1.

경찰청 (2017). 진술분석가 의견 작성 매뉴얼. 경찰청.

2.

고은영, 채규만 (2011). 성폭력 피해 아동의 진술에 대한 준거기반 내용분석의 활용 가능성 연구. 한국범죄심리연구, 7(3), 5-22.

3.

김현정 (2010). CBCA와 RM을 이용한 성폭력 피해 아동이 진술신빙성 평가. 한국심리학회지: 여성, 15(3), 355-379.

4.

박광배, 엄진섭 (1996). 평가자간 일치도를 파악하기 위한 통계절차들. 한국심리학회 학술대회 자료집, 1996(1), 623-642.

5.

박노섭, 조은경, 이미선 (2013). 성폭력 근절 관련 대책의 개선방안. 경찰청.

6.

박종선 (2013). 전문가 의견조회의 성과와 발전방안: 판검사 설문조사를 중심으로. 형사법의 신동향 통권 제 41호 86-117.

7.

성태제 (2002). 타당도와 신뢰도. 학지사.

8.

이미선 (2004). 성폭력 피해 아동진술에 대한 준거기반 내용분석의 타당화를 위한 연구. 한림대학교 석사 학위 논문.

9.

이수정 (2010). 성폭력 피해 진술에 대한 신빙성 분석도구들의 타당도 연구. 한국심리학회지: 사회 및 성격, 24(2), 105-116.

10.

이수정 (2011). 아동 및 장애인에 대한 성폭력 사건에서 경찰단계에서의 전문가 참여가 기소율과 유죄판결률에 미치는 영향. 한국범죄학, 5(1), 111-138.

11.

Amado, B. G., Arce, R., & Fariña, F. (2015). Undeutsch hypothesis and Criteria Based Content Analysis: A meta-analytic review. The European Journal of Psychology Applied to Legal Context, 7(1), 3-12.

12.

Anson, D. A., Golding, S. L., & Gully, K. J. (1993). Child sexual abuse allegations: Reliability of criteria-based content analysis. Law and Human Behavior, 17(3), 331-341.

13.

Akehurst, L., Manton, S., & Quandte, S. (2011). Careful calculation or a leap of faith? A field study of the translation of CBCA ratings to final credibility judgements. Applied Cognitive Psychology, 25(2), 236-243.

14.

Bartko, J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological reports, 19(1), 3-11.

15.

Boychuk, T. (1991). Criteria-Based Content Analysis of children’s statements about sexual abuse: a field based validation study. Doctoral dissertation. Arizona State University.

16.

Ceci, S. J., & Bruck, M. (1993). Suggestibility of the child witness: a historical review and synthesis. Psychological bulletin, 113(3), 403-439.

17.

Craing, R., Scheibe, R., Raskin, D. C., Kircher, J. C., & Dodd, D. H., (1999). Interviewer questions and content analysis of children’s statements of sexual abuse. Applied Developmental Science, 3, 77-85.

18.

Conger, A. J. (1980). Integration and generalization of kappas for multiple raters. Psychological Bulletin, 88(2), 322-328.

19.

Esplin, P. W., Boychuk T., & Raskin, D. C. (1988). A field validity study of Criteria-based content analysis of children’s statements in sexual abuse cases. Paper presented at the NATO Advanced Study Institute on credibility assessment in Maaratea, Italy, June, 1988.

20.

Fivush, R., Gray, J. T., & Fromhoff, F. A. (1987). Two-year-old talk about the past. Cognitive development, 2(4), 393-409.

21.

Fleiss, J. L. (1981). Balanced incomplete block designs for inter-rater reliability studies. Applied Psychological Measurement, 5(1), 105-112.

22.

Frick, T., & Semmel, M. I. (1978). Observer agreement and reliabilities of classroom observational measures. Review of Educational Research, 48(1), 157-184.

23.

Gamer, M., Lemon, J., Fellows, I., & Singh, P. (2015). Package ‘irr’ http://www.r-project.org

24.

Gödert, H. W., Gamer, M., Rill, H. G., & Vossel, G. (2005). Statement validity assessment: Inter‐rater reliability of criteria‐based content analysis in the mock‐crime paradigm. Legal and criminological psychology, 10(2), 225-245.

25.

Hauch, V., Sporer, S. L., Masip, J., & Blandón-Gitlin, I. (2017). Can credibility criteria be assessed reliably? A meta-analysis of criteria- based content analysis. Psychological Assessment, 29(6), 819-834.

26.

Horowitz, S. W., Lamb, M. E., Esplin, P. W., Boychuk, T. D., Krispin, O., & Reiter‐Lavery, L. (1997). Reliability of criteria‐based content analysis of child witness statements. Legal and Criminological Psychology, 2(1), 11-21.

27.

Lamb, M. E., Hershkowitz, I., Orbach, Y., & Esplin, P. W. (2011). Tell me what happened: Structured investigative interviews of child victims and witnesses (Vol. 56). John Wiley & Sons.

28.

Lamb, M. E., Sternberg, K. J., Esplin, P. W., Jershkowitz, I., Orbach, Y., & Hovav, M. (1997). Criterion-based content analysis: A field validation study. Child Abuse and Neglect, 21, 255-264.

29.

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. biometrics, 159-174.

30.

Maxwell, A. E. (1997). Coefficients of agreement between observers and their interpretation. British Journal of Psychiatry, 130, 79-83.

31.

Mazzoni, G., & Ambrosio, K. (2003). L’analisi del resoconto testimoniale in bambini: impiego del metodo di analisi del contenuto CBCA in bambini di 7 anni. Disponibile online: http://www. psicologiagiuridica. com/numero, 20006.

32.

Niveau, G., Lacasa, M. J., Berclaz, M., & Germond, M. (2015). Inter‐rater reliability of criteria based content analysis of children's statements of abuse. Journal of forensic sciences, 60(5), 1247-1252.

33.

Oberlader, V. A., Naefgen, C., Koppehele-Gossel, J., Quinten, L., Banse, R., & Schmidt, A. F. (2016). Validity of content-based techniques to distinguish true and fabricated statements: A meta-analysis. Law and human behavior, 40(4), 440-457.

34.

Spitznagel, E. L., & Helzer, J. E. (1985). A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry, 42(7), 725-728.

35.

Steller, M. (1989). Commentary: Rehabilitation of the Child Witness. In J. Doris (Ed.) The suggestibility of children’s recollections. Washington, DC: American Psychological Association.

36.

Steller, M., & Koehnken, G. (1989). Criteria-based content analysis. In D. C. Raskin (Ed.), Psychological methods in criminal investigation and evidence. New York, NJ: Springer-Verlag.

37.

Vrij, A. (2005). Criteria-Based Content Analysis: A qualitative review of the first 37 studies. Psychology, Public Policy, and Law, 11(1), 3-41.

38.

Vrij, A. (2008). Detecting lies and deceit: Pitfalls and opportunities. (2nd ed.) West Sussex, England: John Wiley & Sons.

39.

Whipple, G. M. (1912). Psychology of testimony and report. Psychological Bulletin, 9(7), 264-269.

40.

Winkel, F. W., Vrij, A., Koppelaar, L., & Van der Steen, J. (1991). Reducing secondary victimzation risks and skilled police intervention: Enhancing the quality of police rape victim encounters through training programmes. Journal of Police and Criminal Psychology, 7, 2-411.

Korean Journal of Social and Personality Psychology

e-Submission OA Policy