바로가기메뉴

본문 바로가기 주메뉴 바로가기

logo

ISSN : 1226-9654

Article Contents

Prev Next
e-Submission

Vol.20 No.2

Citation Share

Interactions of spatial, visual, auditory information in multiple information presentation: Implications for display and control design

The Korean Journal of Cognitive and Biological Psychology / The Korean Journal of Cognitive and Biological Psychology, (P)1226-9654; (E)2733-466X
2008, v.20 no.2, pp.95-107
https://doi.org/10.22172/cogbio.2008.20.2.004



& (2008). Interactions of spatial, visual, auditory information in multiple information presentation: Implications for display and control design. The Korean Journal of Cognitive and Biological Psychology, 20(2), 95-107, https://doi.org/10.22172/cogbio.2008.20.2.004

Abstract

This study was to examine dominance of information modality in the presentation with combination of different types of information. Accuracy and reaction time were measured in the tasks with 2 or 3 types of information presented synchronously in semantically congruent or incongruent conditions. The results showed that spatial information dominated over visual and auditory information and relative to auditory information, visual dominance took place. It is suggested that as to the design of system display and control, spatial information should be considered in the first place; however, on the basis of previous results that task performance changed according to different response modalities, stimulus-response compatibility should be primarily satisfied as a precondition. Although the results supported the hypothesis that visual information dominated auditory information, because of the physical space limitation of display, the visual information arrangement should be considered in the system with spatial and visual information combined together rather than presented independently.

keywords
display, control, multiple information, dominance of information modality, modality compatibility, display, control, multiple information, dominance of information modality, modality compatibility, 디스플레이, 제어, 다중 정보, 정보 양상 우세성, 감각양상 부합성

Reference

1.

민윤기, 김보성 (2005). 자극-반응 부합성 연구와 적용. 사회과학연구(충남대학교 사회과학연구소), 16, 71-82.

2.

Bronkhorst, A. W., Veltman, J. A., and van Breda, L. (1996). Application of a three-dimensional auditory display in a flight task. Human Factors, 38, 23-33.

3.

Chan, K. W. L., and Chan, A. H. S. (2005). Spatial S-R compatibility of visual and auditory signals: Implications for human- machine interface design. Display, 26, 109-119.

4.

Chan, K. W. L., and Chan, A. H. S. (2006). Synchronous and asynchronous presentations of auditory and visual signals: Implications for control console design. Applied Ergonomics, 37(2), 131-140.

5.

Chapanis, A., and Linderbaum, L. E. (1959). A reaction time study of four control-display linkages. Human Factors, 1, 1-7.

6.

Dinadis, N., and Vicenta, K. J. (1999). Designing functional visualizations for aircraft systems status displays. International Journal of Activation Psychology, 9(3), 241-269.

7.

Fitts, P. M., and Seeger, C. M. (1953). S-R compatibility: Spatial characteristics of stimulus and response codes. Journal of Experimental Psychology, 46, 199-210.

8.

Giard, M. H., and Peronnet, F. (1999). Auditory- visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11(5), 473-490.

9.

Heron, J., Whitaker, D., and McGraw, P. V. (2004). Sensory uncertainty governs the extent of audio-visual interaction. Vision Research, 44, 2875-2884.

10.

Lee, F. C. H., and Chan, A. H. S. (2007). Attending visual and auditory signals: Ergonomics recommendations with consideration of signal modality and spatial stimulus-response(S-R) compatibility. International Journal of Industrial Ergonomics, 37, 197-206.

11.

Lee, F. C. H., and Chan, A. H. S. (2008). Ergonomics recommendations for simultaneous and delayed presentation of visual and auditory signals. Displays, 29(2), 124-131.

12.

Nanthavanij, S., and Yenradee, P. (1999). Predicting the optimum number, location, and signal sound level of auditory warning devices for manufacturing facilities. International Journal of Industrial Ergonomics, 24, 569–578.

13.

Posner, M. I., Nissen, M. J., and Klein, R. M. (1976). Visual dominance: An information- processing account of its origins and significance. Psychological Review, 83(2), 157-171.

14.

Proctor, R. W., and Vu, K. -P. L. (2006). Stimulus-response compatibility principles: Data, theory, and application. NY: CRC press.

15.

Simon, J. R. (1969). Reaction toward the source of stimulation. Journal of Experimental Psychology, 81(1), 174-176.

16.

Stewart, L., Walsh, V., and Frith, U. (2004). Reading music modifies spatial mapping in pianist. Perception and Psychophysics, 66(2), 183-195.

17.

Vroomen, J., and de Gelder, B. (2000). Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance, 26, 1583-1590.

18.

Wang, Dong-yuan. D., Proctor, R. W., and Pick, D. F. (2003). The simon effect with wheel-rotation responses. Journal of Motor Behavior, 35(3), 261-273.

19.

Wang, H., and Proctor, R. W. (1996). Stimulus-response compatibility as a function of stimulus code and response modality. Journal of Experimental Psychology: Human Perception and Performance, 22, 1201-1217.

20.

Welford, A. T. (1980). Reaction times. NY: Academic press.

21.

Wickens, C. D., Gordon, S. E., and Liu, Y. (1998). An introduction to human factors engineering. NY: Addison-Wesley Longman.

The Korean Journal of Cognitive and Biological Psychology

e-Submission OA Policy