바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Is the t-test insensitive than the bootstrap method in the P300-based concealed information test?

Abstract

In P300-based concealed information test (P300 CIT), it evaluates whether the P300 amplitude for the probe is significantly greater than that of the irrelevant to determine if the suspect is telling a lie. An independent sample t-test or a bootstrap method can be used as a statistical test to make that decision. Rosenfeld et al. (2004) used the bootstrap method, claiming that “t tests on single sweeps are too insensitive to use to compare mean probe and irrelevant P300s within individuals” and their method has been accepted to date. The purpose of the study is to evaluate whether the power of t-test is lower than that of the bootstrap method in the P300 CIT. The Monte Carlo study was conducted by using EEG collected from 39 participants. The results showed that the type I error rates of the t-test and the percentile bootstrap method were similar and the power of the percentile bootstrap method was slightly higher than that of the t-test. The type I error rates of the t-test and the percentile bootstrap method were slightly lower than the significance level and the powers of the two tests were also slightly lower than that of the theoretical t-test. On the other hand, the type I error rate and power of the standard error Bootstrap method were the same as those of the theoretical t-test and its power was .012 ~ .081 higher than that of t-test depending on experimental conditions.

keywords
P300, 숨긴정보검사, t 검증, 부트스트랩, P300, concealed information test, t-test, bootstrap

Reference

1.

송인욱, 김혜민, 이경은, 장은희, 김현택 (2018). P300-CIT 부트스트랩 분석 비교. 한국심리학회지: 법, 9(2), 75-99.

2.

엄진섭, 음영지, 장은정, 정이내, 손진훈 (2015). P300 숨긴정보검사와 대응수단. 감성과학, 18(1), 39-48.

3.

엄진섭, 전하정, 손진훈 (2018). P300 숨긴정보검사의 오류긍정률. 한국심리학회지: 인지 및 생물, 30(3), 241-259.

4.

전하정, 손진훈, 박광배, 엄진섭 (2017). 반응양식이 P300 숨긴정보검사의 정확도에 미치는 영향. 감성과학, 20(3), 109-118.

5.

정은경, 김영윤 (2013). P300-기반 거짓지식검사의 탐지정확률 비교. 한국심리학회지: 인지 및 생물, 25(1), 75-92.

6.

Abootalebi, V., Moradi, M. H., & Khalilzadeh, M. A. (2009). A new approach for EEG feature extraction in P300-based lie detection. Computer methods and programs in biomedicine, 94(1), 48-57.

7.

Ahad, N. A., Abdullah, S., & Lai, C. H. (2012). Relative power performance of t-test and bootstrap procedure for two-sample. Pertanika Journal of Science & Technology, 20(1), 43-52.

8.

Ambach, W., Bursch, S., Stark, R., & Vaitl, D. (2010). A Concealed Information Test with multimodal measurement. International Journal of Psychophysiology, 75(3), 258-267.

9.

Bablani, A., & Tripathi, D. (2018). A Review on Methods Applied on P300-Based Lie Detectors. In Advances in Machine Learning and Data Science (pp. 251-257). Springer, Singapore.

10.

Bergström, Z. M., Anderson, M. C., Buda, M., Simons, J. S., & Richardson-Klavehn, A. (2013). Intentional retrieval suppression can conceal guilty knowledge in ERP memory detection tests. Biological psychology, 94(1), 1-11.

11.

Bowman, H., Filetti, M., Alsufyani, A., Janssen, D., & Su, L. (2014). Countering countermeasures: Detecting identity lies by detecting conscious breakthrough. PloS one, 9(3), e90595.

12.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge.

13.

Cutmore, T. R., Djakovic, T., Kebbell, M. R., & Shum, D. H. (2009). An object cue is more effective than a word in ERP-based detection of deception. International Journal of Psychophysiology, 71(3), 185-192.

14.

Dwivedi, A. K., Mallawaarachchi, I., & Alvarado, L. A. (2017). Analysis of small sample size studies using nonparametric bootstrap test with pooled resampling method. Statistics in medicine, 36(14), 2187-2205.

15.

Efron, B. (1992). Bootstrap methods: another look at the jackknife. In Breakthroughs in statistics (pp. 569-593). Springer, New York, NY.

16.

Efron, B., & Tibshirani, R. (1986). Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical science, 1(1), 54-75.

17.

Efron, B., & Tibshirani, R. (1994). An Introduction to the Bootstrap. CRC Press.

18.

Ellwanger, J., Rosenfeld, J. P., Sweet, J. J., & Bhatt, M. (1996). Detecting simulated amnesia for autobiographical and recently learned information using the P300 event-related potential. International Journal of Psychophysiology, 23(1-2), 9-23.

19.

Farwell, L. A. & Donchin, E. (1991). The truth will out: Interrogative polygraphy (“lie detection”) with event-related Potentials. Psychophysiology, 28(5), 531-547.

20.

Fernández, T., Harmony, T., Rodríguez, M., Bernal, J., Silva, J., Reyes, A., & Marosi, E. (1995). EEG activation patterns during the performance of tasks involving different components of mental calculation. Electroencephalography and clinical neurophysiology, 94(3), 175-182.

21.

Good, P. (2005). Permutation, parametric and bootstrap tests of hypotheses. Springer.

22.

Hanslmayr, S., Klimesch, W., Sauseng, P., Gruber, W., Doppelmayr, M., Freunberger, R., Pecherstrofer, T., & Birbaumer, N. (2006). Alpha phase reset contributes to the generation of ERPs. Cerebral Cortex, 17(1), 1-8.

23.

Hernández, W., Calderón-Córdova, C., González- Posada, V., Parra-Cerrada, Á., Jiménez, J. L., González-Garcia, J. E., ... & Sergiyenko, O. Y. (2017). Bootstrap-based frequency estimation method. Measurement, 95, 193-200.

24.

Konietschke, F., & Pauly, M. (2014). Bootstrapping and permuting paired t-test type statistics. Statistics and Computing, 24(3), 283-296.

25.

Kubo, K., & Nittono, H. (2009). The role of intention to conceal in the P300-based concealed information test. Applied Psychophysiology and Biofeedback, 34(3), 227-235.

26.

Lefebvre, C. D., Marchand, Y., Smith, S. M., & Connolly, J. F. (2009). Use of event-related brain potentials (ERPs) to assess eyewitness accuracy and deception. International Journal of Psychophysiology, 73(3), 218-225.

27.

Luck, S. J. (2014). An introduction to the event-related potential technique. MIT press.

28.

Lukács, G., Grządziel, A., Kempkes, M., & Ansorge, U. (2019). Item Roles Explored in a Modified P300-Based CTP Concealed Information Test. Applied psychophysiology and biofeedback, 44(3), 195-209.

29.

Lukács, G., Weiss, B., Dalos, V. D., Kilencz, T., Tudja, S., & Csifcsák, G. (2016). The first independent study on the complex trial protocol version of the P300-based concealed information test: Corroboration of previous findings and highlights on vulnerabilities. International Journal of Psychophysiology, 110, 56-65.

30.

Marchand, Y., Inglis-Assaff, P. C., & Lefebvre, C. D. (2013). Impact of stimulus similarity between the probe and the irrelevant items during a card-playing deception detection task: The “irrelevants” are not irrelevant. Journal of clinical and experimental neuropsychology, 35(7), 686-701.

31.

Mathewson, K. J., Hashemi, A., Sheng, B., Sekuler, A. B., Bennett, P. J., & Schmidt, L. A. (2015). Regional electroencephalogram (EEG) alpha power and asymmetry in older adults: a study of short-term test-retest reliability. Frontiers in aging neuroscience, 7, 177.

32.

Matsuda, I., Nittono, H., & Ogawa, T. (2011). Event‐related potentials increase the discrimination performance of the autonomic‐based concealed information test. Psychophysiology, 48(12), 1701-1710.

33.

Meijer, E. H., Smulders, F. T., Merckelbach, H. L., & Wolf, A. G. (2007). The P300 is sensitive to concealed face recognition. International Journal of Psychophysiology, 66(3), 231-237.

34.

Meixner, J. B., & Rosenfeld, J. P. (2014). Detecting knowledge of incidentally acquired, real-world memories using a P300-based concealed-information test. Psychological science, 25(11), 1994-2005.

35.

Mertens, R., & Allen, J. J. (2008). The role of psychophysiology in forensic assessments: Deception detection, ERPs, and virtual reality mock crime scenarios. Psychophysiology, 45(2), 286-298.

36.

Rosenfeld, J. P., & Donchin, E. (2015). Resampling (bootstrapping) the mean: A definite do. Psychophysiology, 52(7), 969-972.

37.

Rosenfeld, J. P., Angell, A., Johnson, M., & Qian, J. (1991). An ERP-based control-question lie detector analog: Algorithms for discriminating effects within individuals's average waveforms. Psychophysiology, 28(3), 319-335.

38.

Rosenfeld, J. P., Davydova, E., Labkovsky, E., & Ward, A. C. (2019). Financial Incentive does not affect P300 in the Complex Trial Protocol (CTP) version of the Concealed Information Test (CIT) in malingering detection. II. Uninstructed subjects. Frontiers in psychiatry, 10, 189.

39.

Rosenfeld, J. P., Labkovsky, E., Winograd, M., Lui, M. A., Vandenboom, C., & Chedid, E. (2008). The Complex Trial Protocol (CTP): A new, countermeasure‐resistant, accurate, P300‐based method for detection of concealed information. Psychophysiology, 45(6), 906-919.

40.

Rosenfeld, J. P., Shue, E., & Singer, E. (2007). Single versus multiple probe blocks of P300-based concealed information tests for self-referring versus incidentally obtained information. Biological psychology, 74(3), 396- 404.

41.

Rosenfeld, J. P., Soskins, M., Bosh, G., & Ryan, A. (2004). Simple, effective countermeasures to P300-based tests of detection of concealed information. Psychophysiology, 41(2), 205-219.

42.

Rosenfeld, J. P., Sweet, J. J., Chuang, J., Ellwanger, J., & Song, L. (1996). Detection of simulated malingering using forced choice recognition enhanced with event- related potential recording. The Clinical Neuropsychologist, 10(2), 163-179.

43.

Semlitsch, H. V., Anderer, P., Schuster, P., & Presslich, O. (1986). A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. Psychophysiology, 23(6), 695-703.

44.

Verleger, R. (1993). Valid identification of blink artefacts: are they larger than 50 μV in EEG records?. Electroencephalography and clinical Neurophysiology, 87(6), 354-363.

45.

Verschuere, B., Rosenfeld, J. P., Winograd, M. R., Labkovsky, E., & Wiersema, R. (2009). The role of deception in P300 memory detection. Legal and Criminological Psychology, 14(2), 253-262.

logo