Creation of Video Summary with the Extracted Salient Frames using Color Moment, Color Histogram and Speeded up Robust Features

Full Text (PDF, 1009KB), PP.22-30

Views: 0 Downloads: 0

Author(s)

Md. Ashiqur Rahman 1,* Shamim Hasan 1 S.M. Rafizul Haque 1

1. Computer Science and Engineering Discipline, Khulna University, Khulna-9208, Bangladesh

* Corresponding author.

DOI: https://doi.org/10.5815/ijitcs.2018.07.03

Received: 27 Jan. 2018 / Revised: 10 Apr. 2018 / Accepted: 6 Jun. 2018 / Published: 8 Jul. 2018

Index Terms

Video summarization, color moment, speeded up robust features, color histogram, Euclidean distance

Abstract

Over the last few years, the amount of video data has increased significantly. So, the necessity of video summarization has reached a new level. Video summarization is summarizing a large video with a fewer number of frames keeping the semantic content same. In this paper, we have proposed an approach which takes all the frames from a video and then shot boundaries are detected using the color moment and SURF (Speeded Up Robust Features). Then the redundancy of the similar frames is eliminated using the color histogram. Finally, a summary slide is generated with the remaining frames which are semantically similar to the total content of the original video. Our experimental result is calculated on the basis of a questionnaire-based user survey which shows on average 78% positive result whereas 3.5% negative result. This experimental result is quite satisfactory in comparison with the existing techniques.

Cite This Paper

Ashiqur Rahman, Shamim Hasan, S.M. Rafizul Haque, "Creation of Video Summary with the Extracted Salient Frames using Color Moment, Color Histogram and Speeded up Robust Features", International Journal of Information Technology and Computer Science(IJITCS), Vol.10, No.7, pp.22-30, 2018. DOI:10.5815/ijitcs.2018.07.03

Reference

[1]Gygli, Michael, Helmut Grabner, Hayko Riemenschneider, and Luc Van Gool. "Creating summaries from user videos."In European conference on computer vision, pp. 505-520. Springer International Publishing, 2014.

[2]Lee, Yong Jae, Joydeep Ghosh, and Kristen Grauman. "Discovering important people and objects for egocentric video summarization." Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012

[3]Banalata Das and Taznin Jahan. “DWT and Color Moment Based Video Content Extraction for Poster Generation with Relevance Feedback” (Bachelor Thesis, 2013, Khulna University, Khulna, Bangladesh) - Unpublished

[4]Lu, Zheng, and Kristen Grauman. "Story-driven summarization for egocentric video." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2013.

[5]Oh, Jung, et al. "Video abstraction." Video data management and information retrieval (2004): 321-346. 

[6]S. Mangijao Singh and K. Hemachandran. “Content Based Image Retrieval using Color Moment and Gabor Texture Feature”. In Proceedings of International Journal of Computer Science Issues (IJCSI), 2012.

[7]S.M. Mohidul Islam. “Implementation and Comparison among Feature Extraction and Similarity Measurement Methods for Image Retrieval Using Visual Contents” (Masters’ Thesis, 2016, Khulna University, Khulna, Bangladesh) - Unpublished

[8]Rafael C. Gonzalez, Richard E. Woods, “Digital Image Processing”, 3rd Edition. Pearson Education, 2009.

[9]Lowe, David G. "Object recognition from local scale invariant features." Computer vision, 1999. The proceedings of the seventh IEEE international conference on. Vol. 2. Ieee, 1999.

[10]Wikipedia, “Scale invariant feature transform”, https://en.wikipedia.org/wiki/Scale_invariant_feature_transform. Accessed on 30 July, 2017

[11]Bay, erbert, Tinne Tuytelaars, and Luc Van Gool. "Surf: Speeded robust features." Computer vision–ECCV 2006 (2006): 404-417.

[12]Wikipedia, “Speeded up robust features”, https://en.wikipedia.org/wiki/Speeded_up_robust_features, Accessed on 15 December 2017

[13]Zhuang, Y., Rui, Y., Huang, T. S., & Mehrotra, S. (1998, October). Adaptive key frame extraction using unsupervised clustering. In Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on (Vol.1, pp. 866-870). IEEE.

[14]Yang, Shuping, and Xinggang Lin. "Key frame extraction using unsupervised clustering based on a statistical model." Tsinghua Science & Technology 10.2 (2005): 169-173.

[15]Dhagdi, Mr Sandip T., and P. R. Deshmukh. "Keyframe based video summarization using automatic threshold & edge matching rate." International Journal of Scientific and Research Publications 2.7 (2012): 1-12.