바로가기메뉴

본문 바로가기 주메뉴 바로가기

Korean Journal of Psychology: General

Influences of Semantic Congruence of Cue and Target Stimuli on Modality Shift Effect

Korean Journal of Psychology: General / Korean Journal of Psychology: General, (P)1229-067X; (E)2734-1127
2009, v.28 no.1, pp.103-113


  • Downloaded
  • Viewed

Abstract

The study examined the effects of semantic congruence of cue and target stimuli on modality shift effect(MSE). We measured the correct response time of target when digits 1, 2, 3, and 4 were presented as visual and auditory cues and targets. The results showed that in both Experiment 1 and 2 with different ISI between cue and target, the visual dominance effect was revealed, while the modality shift effect changed according to different ISI and semantic congruence of cue and target. In condition of short ISI, the modality shift effect was found when cue was congruent with target semantically, but the reverse modality shift effect was found when cue was incongruent with target semantically. In condition of long ISI, however, the modality shift effect took place in the semantically congruent condition but in the semantically incongruent condition, the modality shift effect disappeared. It was suggested that the visual information would be dominant over auditory information and that the original and reverse modality shift effect could be modulated by the semantic congruence conditions of cue and target stimuli. Besides, if cue was congruent with target semantically, modality shift effect remained in spite of ISI, no matter how ISI was short or long.

keywords
Cue, ISI, Semantic Congruence, Visual Dominance Effect, Modality Shift Effect, Cue, ISI, Semantic Congruence, Visual Dominance Effect, Modality Shift Effect, 단서자극, ISI, 의미적 일치성, 시각 우세성 효과, 양상 변화 효과

Reference

1.

김보성, 민윤기 (2008). 자극과 반응양상 부합성이 선택적 대상-기반 주의에 미치는 영향. Journal of The Korean Data Analysis Society, 10, 819-831.

2.

김보성, 민윤기 (2009). 시각과 청각 정보의 의미적 일치성에 따른 시각 우세성 효과의 변화. 인지과학, 20, in press.

3.

김보성, 민윤기, 범린 (2008). 다중 정보 제시 상황에서 공간, 시각, 청각 정보의 정보 양상 우세성 관계: 디스플레이와 제어장치 설계를 위한 함의. 한국심리학회지: 실험, 20, 95-107.

4.

민윤기, 김보성, 정종욱 (2008). 대상- 및 공간-기반 주의가 작업기억에 미치는 영향. 인지과학, 19, 125-142.

5.

정진옥, 민윤기, 김보성 (2007). 단서의 감각양상에 따른 시각탐색과제 수행의 차이. Journal of The Korean Data Analysis Society, 9, 2521-2531.

6.

Boulter, L. R. (1977). Attention and reaction times to signals of uncertain modality. Journal of Experimental Psychology: Human Perception and Performance, 3, 379-388.

7.

Egeth, H. E., and Sager, L. C. (1977). On the locus of visual dominance. Perception and Psychophysics, 22, 77-86.

8.

Gondan, M., Volberg, D., & Greenlee, M. W. (2007). Modality shift effects mimic multisensory interactions: An event-related potential study. Experimental Brain Research, 182, 199-214.

9.

Koppen, C., Alsius, A., & Spence, C. (2008). Semantic congruency and the Colavita visual dominance effect. Experimental Brain Research, 184, 533-546.

10.

Laurienti, P. J., Kraft, R. A., Maldjian, J. A., Burdette, J. H., & Wallace, M. T. (2004). Semactic congruence is a critical factor in multisensory behavioral performance. Experimental Brain Research, 158, 405-414.

11.

Molholm, S., Ritter, W., Javitt, D. C., & Foxe, J. J. (2004). Multisensory visual-auditory object recognition in humans: A high-density electrical mapping study. Cerebral Cortex, 14, 452-465.

12.

Moore, J. J., & Massaro, D. W. (1973). Attention and processing capacity in auditory recognition. Journal of Experimental Psychology, 99, 49-54.

13.

Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: An information -processing account of its origins and significance. Psychological Review, 83, 157-171.

14.

Roadway, P. (2005). The modality shift effect and the effectiveness of warning signals in different modalities. Acta Psychologica, 120, 199-226.

15.

Sinnett, S., Spence, C., & Soto-Fraco, S. (2007). Visual dominance and attention: The Colavita effect revisited. Perception and Psychophysics, 69, 673-686.

16.

Spence, C. (2007). Audiovisual multisensory integration. Acoustical Science and Technology, 28, 61-70.

17.

Spence, C., & Driver, J. (1997). On measuring selective attention to an expected sensory modality. Perception and Psychophysics, 59, 384-403.

18.

Turatto, M., Benso, F., Galfano, G., & Umiltà, C. (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception and Performance, 28, 628-639.

Korean Journal of Psychology: General