바로가기메뉴

본문 바로가기 주메뉴 바로가기

Journal of the Korean Society for Library and Information Science

ISSN : 1225-598X

Article Contents

Prev Next
e-Submission

Vol.56 No.1
Citation Share

Video Summarization Using Eye Tracking and Electroencephalogram (EEG) Data

Journal of the Korean Society for Library and Information Science / Journal of the Korean Society for Library and Information Science, (P)1225-598X; (E)2982-6292
2022, v.56 no.1, pp.95-117
https://doi.org/10.4275/KSLIS.2022.56.1.095


& (2022). Video Summarization Using Eye Tracking and Electroencephalogram (EEG) Data. Journal of the Korean Society for Library and Information Science, 56(1), 95-117, https://doi.org/10.4275/KSLIS.2022.56.1.095
  • Downloaded
  • Viewed
PDF Download

Abstract

This study developed and evaluated audio-visual (AV) semantics-based video summarization methods using eye tracking and electroencephalography (EEG) data. For this study, twenty-seven university students participated in eye tracking and EEG experiments. The evaluation results showed that the average recall rate (0.73) of using both EEG and pupil diameter data for the construction of a video summary was higher than that (0.50) of using EEG data or that (0.68) of using pupil diameter data. In addition, this study reported that the reasons why the average recall (0.57) of the AV semantics-based personalized video summaries was lower than that (0.69) of the AV semantics-based generic video summaries. The differences and characteristics between the AV semantics-based video summarization methods and the text semantics-based video summarization methods were compared and analyzed.

keywords
EEG, Eye Tracking, Video Summarization, Audio-visual Semantics, Text Semantics, 뇌파, 시선추적, 비디오 요약, 오디오-비주얼 시맨틱스, 텍스트 시맨틱스

Journal of the Korean Society for Library and Information Science

e-Submission OA Policy