- P-ISSN1013-0799
- E-ISSN2586-2073
- KCI
Toward a Key-frame Automatic Extraction Method for Video Storyboard Surrogates Based on Users' EEG Signals and Discriminant Analysis
Abstract
This study proposed a key-frame automatic extraction method for video storyboard surrogates based on users’ cognitive responses, EEG signals and discriminant analysis. Using twenty participants, we examined which ERP pattern is suitable for each step, assuming that there are five image recognition and process steps (stimuli attention, stimuli perception, memory retrieval, stimuli/memory comparison, relevance judgement). As a result, we found that each step has a suitable ERP pattern, such as N100, P200, N400, P3b, and P600. Moreover, we also found that the peak amplitude of left parietal lobe (P7) and the latency of FP2 are important variables in distinguishing among relevant, partial, and non-relevant frames. Using these variables, we conducted a discriminant analysis to classify between relevant and non-relevant frames.
- keywords
- 뇌파측정기술, 사건관련유발전위, 키프레임, 판별분석, 적합성, EEG, ERP, key-frame, discriminant analysis, relevance
Reference
권준수. (2000). 인지기능연구에서의 사건관련전위의 이용. 인지과학작업, 1(1), 79-98.
김명선. (2000). 즉각적 재인 기억과 지연 재인 기억이 사건관련전위에 미치는 영향. 한국인지과학회논문지, 11(3-4), 83-93.
김현희. (2015). 이용자 기반의 비디오 키프레임 자동 추출을 위한 뇌파측정기술(EEG) 적용. 한국문헌정보학회지, 49(1), 443-464. http://dx.doi.org/10.4275/KSLIS.2015.49.1.443.
이지영. (2006). 연구방법론을 통해 살펴본 음악 처리과정 연구- 음악과 언어, 음악과 정서를 중심으로. 낭만음악, 18(3), 69-146.
이충연 외. (2011). EEG 기반 뇌기능 분석을 이용한 영화 장면- 대사 기억 게임에서의 인지 학습 특성. 38(1), 210-213.
임용수. (2010). 정신분열병 환자에서 생물학적 지표로서 N100, P300과 정량화뇌파의 적용. 대한정신약물학회지, 21(2), 78-86.
장윤석. (2014). 시각자극 과제에 의한 집중 시의 뇌파분석. 한국전자통신학회 논문지, 9(5), 589-594.
Andreassi, J. L.. (2006). Psychophysiology: Human behavior and physiological response:Psychology Press.
Baddeley, A.. (1997). Human memory: Theory and practice:Psychology Press.
Banich, M. T.. (2011). Cognitive neuroscience:Wadsworth.
강연욱. (2014). 인지 신경과학:박학사.
Davidson, R. J.. (1999). The functional neuroanatomy of emotion and affective style. Trends in Cognitive Science, 3, 11-21.
DeFrance, J. F.. (1997). Age-related changes in cognitive ERPs of attenuation. Brain Topography, 9(4), 283-293.
Donchin, E.. (1988). Is the P300 component a manifestation of context updating?. Behavioral and Brain Science, 11, 357-374.
Elias, L.. (2009). 임상 및 실험 신경심리학:시그마프레스.
Hamann, S. B.. (1997). Intact perceptual memory in the absence of conscious memory. Behavioral Neuroscience, 111, 850-854.
Hillyard, S.. (1973). Electrical signs of selective attention in the human brain. Science, 182(4108), 177-179.
Hillyard, S.. (1979). Handbook of behavioral neurobiology: Vol 2. Neuropsychology:Plenum Press.
Iyer, H.. (2007). Prioritization strategies for video storyboard keyframes. Journal of the American Society for Information Science and Technology, 58(5), 629-644.
Jung, H.. (2012). Reduced source activity of event-related potentials for affective facial pictures in schizophrenia patients. Schizophrenia Research, 136, 150-159.
Kapoor, A.. (2008). Combining brain computer interfaces with vision for object categorization (1-8). IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
Kim, H.. (2010). Toward a conceptual framework of key-frame extraction and storyboard display for video summarization. Journal of the American Society for Information Science and Technology, 61(5), 927-939.
Koelstra, S.. (2009). EEG analysis for implicit tagging of video data (-). Proceeding of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. IEEE Computer Society Press.
Kutas, M.. (1980). Reading senseless sentences: Brain potentials reflect semantic incongruity. Science, 207, 203-208.
Moscovitch, M.. (1992). Memory and working-with-memory: A component process model based on modules and central systems. Journal of Cognitive Neuroscience, 4, 257-267.
Naatanen, R.. (1982). Stimulus deviance and evoked potentials. Biological Psycology, 14, 53-98.
Naghavi, H.. (2005). Common fronto-parietal activity in attention, memory, and consciousness: Shared demands on integration?. Consciousness and Cognition, 14(2), 390-425.
Picton, T.. (1988). Dynamics of sensory and cognitive processing by the brain:Springer-Verlag.
Picton, T.. (1978). Attention and performance: Ⅶ:Wiley.
Smith, M. E.. (1993). Neurophysiological manifestations of recollective experience during recognition memory judgments. Journal of Cognitive Neuroscience, 5, 1-13.
Smith, E. E.. (1999). Storage and executive processes in the frontal lobes. Science, 283, 1657-1661.
Song, Y.. What are the most eye-catching and ear-catching features in the video?.
Tulving, E.. (1994). Hemispheric encoding / retrieval asymmetry in episodic memory: Position emission tomography findings (2016-2020). Proceedings of the National Academy of Sciences of the United States of America.
Yuji Hakoda. (2014). 인지심리학:한국뇌기반교육연구소.
Wang, Y.. (2009). A cognitive informatics theory for visual information processing (-). Proc. 7th IEEE International Conference on Cognitive Informatics. Stanford University.
- Downloaded
- Viewed
- 0KCI Citations
- 0WOS Citations