A Study on Shot Segmentation and Indexing of Language Education Videos by Content-based Visual Feature Analysis

As IT technology develops rapidly and the personal dissemination of smart devices increases, video material is especially used as a medium of information transmission among audiovisual materials. Video as an information service content has become an indispensable element, and it has been used in various ways such as unidirectional delivery through TV, interactive service through the Internet, and audiovisual library borrowing. Especially, in the Internet environment, the information provider tries to reduce the effort and cost for the processing of the provided information in view of the video service through the smart device. In addition, users want to utilize only the desired parts because of the burden on excessive network usage, time and space constraints. Therefore, it is necessary to enhance the usability of the video by automatically classifying, summarizing, and indexing similar parts of the contents. In this paper, we propose a method of automatically segmenting the shots that make up videos by analyzing the contents and characteristics of language education videos and indexing the detailed contents information of the linguistic videos by combining visual features. The accuracy of the semantic based shot segmentation is high, and it can be effectively applied to the summary service of language education videos.

keywords: shot segmentation, keyframe extraction, content-based summary, language education video, shot indexing, 샷 구분, 키프레임 추출, 내용기반 요약, 교육용 어학 영상, 샷 색인

참고문헌

Basu, S.. (2016). Fuzzy clustering of lecture videos based on topic modeling (1-6). Proceedings of the 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI).

Cieplinski, L.. Visual working draft 4.0. ISO/IEC JTC1/SC29/WG11 N, 3399.

Cieplinski, L.. Text of ISO/IEC 15938-3/FCD information technology-multimedia content description interface-part 3 visual.

Divakaran, A.. (2003). Video summarization using mpeg-7 motion activity and audio descriptors. Video Mining, 6, 91-121. http://dx.doi.org/10.1007/978-1-4757-6928-9_4.

Mengjuan Fei. (2017). Memorable and rich video summarization. Journal of Visual Communication and Image Representation, 42, 207-217. http://dx.doi.org/10.1016/j.jvcir.2016.12.001.

Weiming Hu. (2011). A Survey on Visual Content-Based Video Indexing and Retrieval. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 41(6), 797-819. http://dx.doi.org/10.1109/TSMCC.2011.2109710.

Lee, H. K.. (2002). Video contents summary using the combination of multiple MPEG-7 metadata (227-232). Proceedings of the Korean Institute of Broadcast and Media Engineers Conference.

Manjunath, B. S.. (2002). Introduction to MPEG-7: multimedia content description interface:John Wiley & Sons.

Padmavathi Mundur. (2006). Keyframe-based video summarization using Delaunay clustering. International Journal on Digital Libraries, 6(2), 219-232. http://dx.doi.org/10.1007/s00799-005-0129-9.

10.

Chong-Wah Ngo. (2005). Video summarization and scene detection by graph modeling. IEEE Transactions on Circuits and Systems for Video Technology, 15(2), 296-305. http://dx.doi.org/10.1109/TCSVT.2004.841694.

11.

Peker, K. A.. (2001). Automatic measurement of intensity of motion activity of video segments. Progress in Biomedical Optics and Imaging, (4315), 341-351.

12.

jiang peng. (2009). Keyframe-based Video Summarization using Visual Attention Clue. IEEE Multimedia, 17(2), 64-73. http://dx.doi.org/10.1109/MMUL.2009.65.

13.

Ro, Y. M.. Texture description using radon transform.

14.

P. Salembier. (2001). MPEG-7 multimedia description schemes. IEEE Transactions on Circuits and Systems for Video Technology, 11(6), 748-759. http://dx.doi.org/10.1109/76.927435.

15.

Sudhir, G.. (1998). Automatic classification of tennis video for high-level content-based retrieval (81-90). Proceedings of the 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

16.

K.S. Thakre. (2016). Video Partitioning and Secured Keyframe Extraction of MPEG Video. Procedia Computer Science, 78, 790-798. http://dx.doi.org/10.1016/j.procs.2016.02.058.

17.

Walker, T.. (1999). Proposal for a video summary description scheme (1559-1562). Proceedings of the 2000 IEEE International Conference.

18.

Yamada, A.. MPEG-7 visual part of experimentation model. Version 9.0-Part 3 Dominant Color.

19.

Zhong, D.. (1997). Video object model and segmentation for content-based video indexing (1492-1495). Proceedings of the 1997 IEEE International Symposium on Circuits and Systems.

바로가기메뉴

논문 상세

Vol.34 No.1

교육용 어학 영상의 내용 기반 특징 분석에 의한 샷 구분 및 색인에 대한 연구

A Study on Shot Segmentation and Indexing of Language Education Videos by Content-based Visual Feature Analysis

Abstract

참고문헌

정보관리학회지