바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

Inversion Effects on Face Emoticon Processing: An ERP Study

The Korean Journal of Cognitive and Biological Psychology / The Korean Journal of Cognitive and Biological Psychology, (P)1226-9654; (E)2733-466X
2018, v.30 no.2, pp.113-139
https://doi.org/10.22172/cogbio.2018.30.2.003



  • Downloaded
  • Viewed

Abstract

Emoticons are widely used for various offline and online communication. To investigate whether the perceptual encoding of face emoticon relies on the face-specific configural processing, we examined how stimulus inversion affects the amplitude and peak latency of face-sensitive ERP component N170 which is known to be larger and delayed in response to inverted than to upright human face (N170-face inversion effect; N170-FIE) as well as ERP component P1 which is known to be sensitive to low-level visual features. ERPs were recorded to upright and inverted face emoticons, face photos, and house icons which were surrounded by oval-shaped outline. Participants had to judge the relative height of two gaps on the outline. N170 was enhanced for face emoticons and face photos relative to house icons (face-sensitive N170 effect), and showed no amplitude difference between face emoticons and face photos. N170 amplitude was not affected by inversion for all types of experimental stimuli. N170 was delayed for face photos relative to face emoticons as well as house icons, and showed no latency difference between face emoticons and house icons. The aforesaid latency difference among experimental stimuli were found only for inverted stimuli. For face emoticons and face photos, N170 was delayed for inverted relative to upright faces (N170-FIE), but, no N170 peak latency-related inversion effect was found for house icons. However, the magnitude of inversion effect was largest for face photos, and showed no difference between face emoticons and house icons. The amplitude and peak latency of P1 showed neither face-sensitive effect nor FIE, and only showed the effect of low-level visual differences among experimental stimuli. These findings show that perceptual encoding of upright face emoticons can rely on face-sensitive configural processing mechanisms to a less degree than face photos, but perceptual encoding of inverted face emoticons can rely on object-sensitive perceptual mechanisms like house icons.

keywords
face emoticon, face inversion effect (FIE), face-sensitive effect, N170, P1, 얼굴이모티콘, 얼굴역전효과, 얼굴-민감효과, N170, P1

Reference

1.

Allison, T., Puce, A., Spencer, D. D., & McCarthy, G. (1999). Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cerebral Cortex, 9(5), 415-430.

2.

Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8(6), 551-565.

3.

Bentin, S., Taylor, M. J., Rousselet, G. A., Itier, R. J., Caldara, R., Schyns, P. G., Jacques, C., & Rossion, B. (2007). Controlling interstimulus perceptual variance does not abolish N170 face sensitivity. Nature Neuroscience, 10, 801-802; author reply 802- 803.

4.

Boehm, S. G., Dering, B., & Thierry, G. (2011). Category-sensitivity in the N170 range: a question of topography and inversion, not one of amplitude. Neuropsychologia, 49(7), 2082- 2089.

5.

Bötzel, K., Schulze, S., & Stodieck, S. R. G. (1995). Scalp topography and analysis of intracranial sources of face-evoked potentials. Experimental Brain Research, 104, 135-143.

6.

Carmel, D., & Bentin, S. (2002). Domain specificity versus expertise: factors influencing distinct processing of faces. Cognition, 83(1), 1-29.

7.

Cauquil, A. S., Edmonds, G. E., & Taylor, M. J. (2000). Is the face-sensitive N170 the only ERP not affected by selective attention? Neuroreport, 11(10), 2167-2171.

8.

Churches, O., Nicholls, M., Thiessen, M., Kohler, M., & Keage, H. (2014). Emoticons in mind: An event-related potential study. Social Neuroscience, 9(2), 196-202.

9.

Dering, B., Martin, C. D., Moro, S., Pegna, A. J., & Thierry, G. (2011). Face-sensitive processes one hundred milliseconds after picture onset. Frontiers in Human Neuroscience, 5:93. doi: 10.3389/fnhum.2011.00093.

10.

Eimer, M. (2000). The face-specific N170 component reflects late stages in the structural encoding of faces. Neuroreport, 11(10), 2319- 2324.

11.

Eimer, M. (2011). The face-sensitive N170 component of the event-related brain potential. In The Oxford Handbook of Face Perception (pp. 329-344). Oxford: Oxford University Press.

12.

Eimer, M., & Holmes, A. (2002). An ERP study on the time course of emotional face processing. Neuroreport, 13(4), 427-431.

13.

Gauthier, I., Curran, T., Curby, K. M., & Collins, D. (2003). Perceptual interference supports a nonmodular account of face processing. Nature Neuroscience, 6, 428-432.

14.

Gratton, G., Coles, M. G., & Donchin, E. (1983). A new method for offline removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55(4), 468-484.

15.

Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4(6), 223-233.

16.

Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2002). Human neural systems for face recognition and social communication. Biological Psychiatry, 51(1), 59-67.

17.

Henson, R. N., Goshen-Gottstein, Y., Ganel, T., Otten, L. J., Quayle, A., & Rugg, M. D. (2003). Electrophysiological and haemodynamic correlates of face perception, recognition and priming. Cerebral Cortex, 13(7), 793-805.

18.

Herrmann, M. J., Ehlis, A. C., Ellgring, H., & Fallgatter, A. J. (2005). Early stages (P100) of face perception in humans as measured with event-related potentials (ERPs). Journal of Neural Transmission. 112, 1073-1081.

19.

Itier, R. J., & Taylor, M. J. (2004). N170 or N1? Spatiotemporal differences between object and face processing using ERPs. Cerebral Cortex, 14(2), 132-142.

20.

Itier, R. J., Alain, C., Sedore, K., & McIntosh, A. R. (2007). Early face processing specificity: It’s in the eyes! Journal of Cognitive Neuroscience, 19, 1815-1826 .

21.

Itier, R. J., Latinus, M., & Taylor, M. J. (2006). Face, eye and object early processing: What is the face specificity? NeuroImage, 29, 667-676.

22.

Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17(11), 4302-4311.

23.

Kappenman, E. S., & Luck, S. J. (2012). The Oxford Handbook of Event-Related Potential Components. Oxford University Press.

24.

Kendall, L. N., Raffaelli, Q., Kingstone, A., & Todd, R. M. (2016). Iconic faces are not real faces: enhanced emotion detection and altered neural processing as faces become more iconic. Cognitive Research: Principles and Implications, 1:19. doi: 10.1186/s41235-016-0021-8.

25.

Krombholz, A, Schaefer, F, & Boucsein, W. (2007). Modification of N170 by different emotional expression of schematic faces. Biological Psychology, 76, 156-162.

26.

Kuefner, D., deHeering, A., Jacques, C., Palmero-Soler, E., & Rossion, B. (2010). Early visually evoked electrophysiological responses over the human brain (P1, N170) show stable patterns of face-sensitivity from 4 years to adulthood. Frontiers in Human Neuroscience, 3:67. doi: 10.3389/neuro.09.067.2009

27.

McCarthy, G., Puce, A. Belger, A., & Allison, T. (1999). Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. Cerebral Cortex, 9, 431-444.

28.

Nakashima, T., Kaneko, K., Goto, Y., Abe, T., Mitsudo, T., Ogata, K, Makinouchi, A., & Tobimatsu, S. (2008). Early ERP components differentially extract facial features: Evidence for spatial frequency-and-contrast detectors. Neuroscience Research, 62, 225-235.

29.

Oken, B. S., Chiappa, K. H., & Gill, E. (1987). Normal temporal variability of the P100. Electroencephalography and Clinical Neurophysiology/ Evoked Potentials, 68(2), 153-156.

30.

Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R. Jr., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., & Taylor, M. J. (2000). Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology, 37, 27-152.

31.

Rakover, S. S. (2013). Explaining the face-inversion effect: the face-scheme incompatibility (FSI) model. Psychonomic Bulletin, 20, 665-692.

32.

Rhodes, G., Brake, S., & Atkinson, A. P. (1993). What’s lost in inverted faces. Cognition, 47, 25-57.

33.

Rosburg, T., Ludowig, E., Dümpelmann, M., Alba-Ferrara, L., Urbach, H., & Elger, C. E. (2010). The effect of face inversion on intracranial and scalp recordings of event-related potentials. Psychophysiology, 47, 147-157.

34.

Rossion, B., & Jacques, C. (2008). Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. NeuroImage, 39(4), 1959-1979.

35.

Rossion, B., Delvenne, J. F., Debatisse, D., Goffaux, V., Bruyer, R., Crommelinck, M., & Guerit, J. M. (1999). Spatio-temporal localization of the face inversion effect: An event-related potentials study. Biological Psychology, 50, 173-189.

36.

Rossion, B., Gauthier, I., Tarr, M. J., Despland, P., Bruyer, R., Linotte, S., et al. (2000). The N170 occipito-temporal component is delayed and enhanced to inverted faces but not to inverted objects: An electrophysiological account of face specific processes in the human brain. NeuroReport, 11, 69-74.

37.

Rossion, B., Joyce, C. A., Cottrell, G. W., & Tarr, M. J. (2003). Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. Neuroimage, 20, 1609-1624.

38.

Rossion, B., Kung, C. C., Tarr, M. J. (2004). Visual expertise with nonface objects leads to competition with the early perceptual processing of faces in the human occipitotemporal cortex. Proceedings Of The National Academy Of Sciences Of The United States Of America, 101(40), 14521-14526.

39.

Sadeh, B., & Yovel, G. (2010). Why is the N170 enhanced for inverted faces? An ERP competition experiment. Neuroimage, 53, 782-789.

40.

Sagiv, N., & Bentin, S. (2001). Structural encoding of human and schematic faces: Holistic and part-based processes. Journal of Cognitive Neuroscience, 13, 937-951.

41.

Suzuki, M., & Noguchi, Y. (2013). Reversal of the face-inversion effect in N170 under unconscious visual processing. Neuropsychologia, 51, 400-409.

42.

Taylor, M. J., Edmonds, G. E., McCarthy, G., & Allison, T. (2001). Eyes first! Eye processing develops before face processing in children. Neuroreport, 12(8), 1671-1676.

43.

Tecce, J. J. (1972). Contingent negative variation (CNV) and psychological processes in man. Psychological Bulletin, 77, 73-108.

44.

Thierry, G., Martin, C. D., Downing, P., & Pegna, A. J. (2007). Controlling for interstimulus perceptual variance abolishes N170 face selectivity. Nature Neuroscience. 10, 505-511.

45.

Van Belle, G., De Graef, P., Verfaillie, K., Rossion, B., & Lefèvre, P. (2010). Face inversion impairs holistic perception: Evidence from gaze-contingent stimulation. Journal of Vision, 10(5), 1-13.

46.

van Rijn, H., Kononowicz, T. W., Meck, W. H., Ng, K. K., & Penney, T. B. (2011). Contingent negative variation and its relation to time estimation: a theoretical evaluation. Frontiers in Integrative Neuroscience, 5:91. doi: 10.3389/fnint.2011.00091.

47.

Walter, W. G., Cooper, R., Aldridge, V. J., McCallum, W. C., & Winter, A. L. (1964). Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature, 203, 380-384.

48.

Wang, M. Y., Kuo, B. C., & Cheng, S. K. (2011). Chinese characters elicit face-like N170 inversion effects. Brain & Cognition. 77, 419-431.

49.

Woodman, G. F. (2010). A brief introduction to the use of event-related potentials (ERPs) in studies of perception and attention. Attention and Perceptual Psychophysiology, 72(8), 1-29.

50.

Woodman, G. F. (2010). A brief introduction to the use of event-related potentials (ERPs) in studies of perception and attention. Attention, Perception, & Psychophysics, 72(8), 2031-2046.

51.

Young, A. W,, Hellawell, D., & Hay, D. C. (1987). Configurational information in face perception. Perception. 16(6), 747-59.

52.

Yovel, G., & Kanwisher, N. (2005). The neural basis of the face-inversion effect. Current Biology, 15, 2256-2262.

The Korean Journal of Cognitive and Biological Psychology