Facial Emotion Recognition using Concept Mapping and Feature Extraction

Authors

  • Dinesh Pawar  M.Tech Electronics and Telecommunication, VJTI , Mumbai, Maharashtra, India
  • Rajesh Patil  Associate Professor Electrical Engineering Dept, VJTI, Mumbai, Maharashtra, India

Keywords:

Facial Expression, Human-Computer Interaction(HCI), Video, Concept Map, Facial Action Units

Abstract

In recent years there has been a rapid growth in study of emotions. Humans use facial expression as a non-verbal communication channel. Human Computer Interaction(HCI) is a developing and interesting field and is useful for further development in recent technology. We have developed a computer vision system that recognizes human expressions based on various action units of upper and lower face parts. Firstly, the face is detected from the input video clip then preprocessing, feature extraction is done and the classification of expression is obtained. Six primary expressions happiness, sadness, fear, disgust, surprise and anger are classified using Facial Action Units. Our process considers Facial Action Coding System(FACs) for classification. Concept Map is used to improve the expression classification accuracy, speed of execution and to reduce the confusion between emotions.

References

  1. Kim, Jonathan C., and Mark A. Clements, "Multimodal affect classification at various temporal lengths," IEEE Transactions On Affective Computing 6.4, 2015, pp. 371-384.
  2. Li, Yang. "Novel face recognition algorithm based on adaptive 3D local binary pattern features and improved Singular Value Decomposition method." Inventive Computation Technologies (ICICT), International Conference on. Vol. 3. IEEE, 2016.
  3. Latif, Mohd, Shahrul Na'im Sidek, and Nazreen Rusli. "Texture descriptors based affective states recognition-frontal face thermal image." (2016): 1-6. 
  4. M. Z. Uddin; M. M. Hassan; A. Almogren; A. Alamri; M. AlRubaian; G. Fortino, "Facial Expression Recognition Utilizing Local Direction-based Robust Features and Deep Belief Network," in IEEE Access, vol.PP, no.99, pp.1-1.
  5. Matlovic, Tomas, et al. "Emotions detection using facial expressions recognition and EEG." Semantic and Social Media Adaptation and Personalization (SMAP), 2016 11th International Workshop on. IEEE, 2016.
  6. Mayya, Veena, Radhika M. Pai, and MM Manohara Pai. "Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences." Advances in Computing, Communications and Informatics (ICACCI), 2016 International Conference on. IEEE, 2016. 
  7. Das, Arundhati, Mameeta Pukhrambam, and Ashim Saha. "Realtime robust face detection and tracking using extended haar functions and improved boosting algorithm." Green Computing and Internet of Things (ICGCIoT), 2015 International Conference on. IEEE, 2015.
  8. Gaus, Yona Falinie A., et al. "Automatic affective dimension recognition from naturalistic facial expressions based on wavelet filtering and PLS regression." Automatic Face and Gesture Recognition (FG), 2015 11th IEEE International Conference and Workshops on. Vol. 5. IEEE, 2015.
  9. El Meguid, Mostafa K. Abd, and Martin D. Levine. "Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers." IEEE Transactions on Affective Computing 5.2 (2014): 141-154.
  10. Singh, Maninderjit, Anima Majumder, and Laxmidhar Behera. "Facial expressions recognition system using Bayesian inference." Neural Networks (IJCNN), 2014 International Joint Conference on. IEEE, 2014.
  11. Velusamy, Sudha, et al. "Improved feature representation for robust facial action unit detection." Consumer Communications and Networking Conference (CCNC), 2013 IEEE. IEEE, 2013.
  12. Özmen, Gonca. "Facial expression classification with haar features, geometric features and cubic bézier curves." (2013). 
  13. Wilson, Phillip Ian, and John Fernandez. "Facial feature detection using Haar classifiers." Journal of Computing Sciences in Colleges 21.4 (2006): 127-133.
  14. Viola, Paul, and Michael Jones. "Rapid object detection using a boosted cascade of simple features." Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. Vol. 1. IEEE, 2001.
  15. Guan, Peng, Yaoliang Yu, and Liming Zhang. "A novel facial feature point localization method on 3D faces." Image Processing, 2007. ICIP 2007. IEEE International Conference on. Vol. 3. IEEE, 2007.
  16. Punitha, A., and M. Kalaiselvi Geetha, "HMM Based Real Time Facial Expression Recognition," International Journal of Emergine Technology and Advanced Engineering 3.1 2013, pp. 180-185.
  17. Wang, Liwei, Yan Zhang, and Jufu Feng. "On the Euclidean distance of images." IEEE transactions on pattern analysis and machine intelligence 27.8 (2005): 1334-1339.
  18. Tian, Y-I., Takeo Kanade, and Jeffrey F. Cohn. "Recognizing action units for facial expression analysis." IEEE Transactions on pattern analysis and machine intelligence 23.2 (2001): 97-115.
  19. Lien, James J., et al. "Automated facial expression recognition based on FACS action units." Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on. IEEE, 1998.
  20. Novak, Joseph D., and Alberto J. Caas. ”The theory underlying concept maps and how to construct and use them.” (2008).

International Journal of Scientific Research in Science and Technology

Downloads

Published

2018-06-30

Issue

Volume 4, Issue 8, May-June-2018

Section

Research Articles

License

Copyright (c) IJSRST

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Dinesh Pawar, Rajesh Patil, " Facial Emotion Recognition using Concept Mapping and Feature Extraction, International Journal of Scientific Research in Science and Technology(IJSRST), Online ISSN : 2395-602X, Print ISSN : 2395-6011, Volume 4, Issue 8, pp.677-684, May-June-2018.