Towards the Generation of Language-based Sound Summaries Using Electroencephalogram Measurements
Journal of the Korean Society for Information Management / Journal of the Korean Society for Information Management, (P)1013-0799; (E)2586-2073
2019, v.36 no.3, pp.131-148
https://doi.org/10.3743/KOSIM.2019.36.3.131
&
(2019). Towards the Generation of Language-based Sound Summaries Using Electroencephalogram Measurements. Journal of the Korean Society for Information Management, 36(3), 131-148, https://doi.org/10.3743/KOSIM.2019.36.3.131
Abstract
This study constructed a cognitive model of information processing to understand the topic of a sound material and its characteristics. It then proposed methods to generate sound summaries, by incorporating anterior-posterior N400/P600 components of event-related potential (ERP) response, into the language representation of the cognitive model of information processing. For this end, research hypotheses were established and verified them through ERP experiments, finding that P600 is crucial in screening topic-relevant shots from topic-irrelevant shots. The results of this study can be applied to the design of classification algorithm, which can then be used to generate the content-based metadata, such as generic or personalized sound summaries and video skims.
- keywords
-
인지적 모형,
사건관련유발전위,
전후측 N400,
전후측 P600,
사운드 요약,
비디오 스킴,
인공신경망,
내용 기반 메타데이터,
cognitive model,
event-related potential response,
anterior-posterior N400,
anterior-posterior P600,
sound summaries,
video skims,
artificial neural networks,
content-based metadata