International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 13, No. 1, 8 Feb. 2021
Cover page and Table of Contents: PDF (size: 404KB)
Emotion Recognition from Faces Using Effective Features Extraction Method
Full Text (PDF, 404KB), PP.50-57
Views: 0 Downloads: 0
Author(s)
Index Terms
Artificial Intelligent (AI), BOVW, Facial Emotion Recognition (FER), JAFEE, Local Features, SIFT, SVM, VLAD
Abstract
With the rapid development and requirement of application with Artificial Intelligent (AI) technologies, the researches related to human-computer interaction are always active and the emotional status of the users is very essential for most of the environment. Facial Emotion Recognition, FER is one of the important visual information providers for the AI systems. This paper proposes a FER system using an effective feature extraction methodology and classification technologies. Local features of the face are more effective features for recognition and Scale Invariant Feature Transform, SIFT can give a better representation of the face. The bag of the visual word (BOVW) is the good encoding method and the advancement of that model Vector of Locally Aggregate Descriptor, VLAD provides the better encoder for SIFT features and used these benefits for feature extraction environments. The power of SVM includes unknown class recognition problems and this advantage is used for classification. This system used the standard basement JAFEE dataset to measure the success of the proposed methods and prepared to compare with other systems. The proposed system achieves the better result when it compared with some of the other previous systems because of the combination of effective feature extraction and encoding method.
Cite This Paper
Htwe Pa Pa Win, Phyo Thu Thu Khine, Zon Nyein Nway, " Emotion Recognition from Faces Using Effective Features Extraction Method", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.13, No.1, pp. 50-57, 2021. DOI: 10.5815/ijigsp.2021.01.05
Reference
[1]Kim, J., Kim, B, Roy, P., P., and Jeong, D., “Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure”, IEEE Access. DOI:10.1109/ACCESS.2019.2907327
[2]Balasubramanian, B., Diwan, P., Nadar, R., and Bhatia, A., “Analysis of Facial Emotion Recognition”, Proceedings of the Third International Conference on Trends in Electronics and Informatics (ICOEI 2019), IEEE Xplore Part Number: CFP19J32-ART; ISBN: 978-1-5386-9439-8
[3]Bouzakraoui, M. S., Sadiq, A. and Ala, A., Y., “Appreciation of Customer Satisfaction through analysis Facial Expressions and Emotions Recognition”,
[4]Taha, B., and Hatzinakos, D., “Emotion Recognition from 2D Facial Expressions”, IEEE Canadian Conference of Electrical and Computer Engineering (CCECE), 2019. DOI: 10.1109/CCECE.2019.8861751
[5]Verma, G., Verma, H. Hybrid-Deep Learning Model for Emotion Recognition Using Facial Expressions. Rev Socionetwork Strat (2020). https://doi.org/10.1007/s12626-020-00061-6
[6]Kumari N., Bhatia R. (2020) Comparative Study and Analysis of Various Facial Emotion Recognition Techniques. In: Kapur P., Singh G., Klochkov Y., Kumar U. (eds) Decision Analytics Applications in Industry. Asset Analytics (Performance and Safety Management). Springer, Singapore. https://doi.org/10.1007/978-981-15-3643-4_11
[7]Yang, H., Cheng, G., and Chen, H., “High Efficient Local Feature Matching”, 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC 2018).DOI: 10.1109/IMCEC.2018.8469593
[8]Li, X., Li, X., Chen, X., Jian, Z. and Zheng, L., “Towards Optimal VLAD for Visual Recognition”, IEEE 6th International Conference on Cloud Computing and Intelligence Systems (CCIS), 2019. DOI: 10.1109/CCIS48116.2019.9073752
[9]Minaee, S., and Abdolrashidi, A., “Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network”, Computer Vision and Pattern Recognition (cs.CV), Mon, 4 Feb 2019. DOI: https://arxiv.org/abs/1902.01019v1
[10]S. A. M. Al-Sumaidaee, S. S. Dlay, W. L. Woo and J. A. Chambers, “Facial Expression Recognition using Local Gabor Gradient Code-Horizontal Diagonal Descriptor”, 2nd IET International Conference on Intelligent Signal Processing 2015 (ISP), 1-2 Dec. 2015. DOI: 10.1049/cp.2015.1766
[11]Hua,W.; Dai, F.; Huang, L.; Xiong, J.; Gui, G. HERO: Human emotions recognition for realizing intelligent Internet of Things. IEEE Access 2019, 7, 24321–24332. DOI: 10.1109/ACCESS.2019.2900231
[12]Viola, P.; Jones, M.J. Robust real-time face detection. Int. J. Comput. Vis. 2004, 57, 137–154.:VISI.0000013087.49260.fb.
[13]D.G. Lowe, Distinctive image features from scale-invariant keypoints, International Journal of Computer Vision, 60(2), pp. 91-110, 2004. DOI: https://doi.org/10.1023/B:VISI.0000029664.99615.94
[14]Karami, E., Prasad, S., and Shehata, M., “Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images”, In Proceedings of the 2015 Newfoundland Electrical and Computer Engineering Conference,St. johns, Canada, November, 2015, Computer Vision and Pattern Recognition (cs.CV).DOI: https://arxiv.org/abs/1710.02726v1
[15]Wei, M., and Xiwei, P., “WLIB-SIFT: A Distinctive Local Image Feature Descriptor”, 2nd IEEE International Conference on Information Communication and Signal Processing, 28-30 Sept. 2019. DOI: 10.1109/ICICSP48821.2019.8958587
[16]H. Jegou, F. Perronnin, M. Douze, J. S´anchez, P. Perez, and C. Schmid, “Aggregating local image descriptors into compact codes,” IEEE transactions on pattern analysis and machine intelligence, vol. 34, no. 9, pp. 1704–1716, 2012. DOI: 10.1109/TPAMI.2011.235
[17]Li, Q., Peng, Q., and Yan, C., “Multiple VLAD encoding of CNNs for image classification”, Computing in Science & Engineering (Volume: 20 , Issue: 2 , Mar./ Apr. 2018 ). DOI: 10.1109/MCSE.2018.108164530
[18]Zhigang Tu, Z., et.al, “Action-Stage Emphasized Spatio-Temporal VLAD for Video Action Recognition”, IEEE Transactions on Image Processing ( Volume: 28 , Issue: 6 , June 2019 ), DOI: 10.1109/TIP.2018.2890749
[19]Lyons, M.J.; Akamatsu, S.; Kamachi, M.; Gyoba, J.; Budynek, J. “The Japanese female facial expression (JAFFE) database”. In Proceedings of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan, 14–16 April 1998; pp. 14–16.