Pose Regularization Based Automatic Multi-View Face Recognition Method

Authors(2) :-Girishma Batra, Pramod Patil

Face recognition techniques encounters difficulty in handling arbitrary poses variations. Various approaches have been worked upon for face recognition across pose variations, wherein many methods either require manual landmark annotations or assume the face poses to be known. These constraints prevent many face recognition systems from working automatically. The proposed work presents a new fully automatic multi-view face recognition method via 3D model based pose regularization, and extends existing face recognition systems into multi-view scenarios. Unlike previous pose normalization approaches, where non-frontal face images were transformed into frontal images, the proposed 3D model based pose regularization method generates synthetic target images to resemble the pose variations in query images. We should point out that generating non-frontal views from frontal face images is much easier and more accurate than recovering frontal views from non-frontal face images. This is because it is difficult to automatically detect accurate landmarks under large pose variations which are required to build a 3D face model. Additionally, since many areas of a face are significantly occluded under large pose variations, it is problematic to recover the frontal view for the occluded facial regions.The proposed work follows the view rendering based on 3D GEM but uses a simplified 3D Morphable Model [6]. Additionally, instead of aligning the synthetic target images and testing face images based on eye positions, we perform face alignment using Procrustes analysis under large pose variations. Moreover, our face matching method with blocked MLBP features provides better robustness against face illumination and expression variations. Finally, we show the expansibility of the proposed approach by replacing our MLBP based face matcher with two state- of-the-art face matching systems.

Authors and Affiliations

Girishma Batra
Electronics and Telecommunication Department, Jhulelal Institute of Technology, Nagpur, Maharashtra, India
Pramod Patil
Electronics and Telecommunication Department, Jhulelal Institute of Technology, Nagpur, Maharashtra, India

Face recognition, pose regularization, feature point, 3D GEM, 3D Morphable Model

  1. Zahid Mahmood, Tauseef Ali, Samee U. Khan, Effects of pose and image resolution on automatic face recognition, IET Journal of Biometrics, 2016.
  2. Tal Hassner, Shai Harel, Eran Paz, Roee Enbar, Effective Face Frontalization in Unconstrained Images, IEEE 2015.
  3. Xiangyu Zhu Zhen Lei Junjie Yan Dong Yi Stan Z. Li, Pose and Expression Normalization for Face Recognition in the Wild, IEEE Transactions on Biometrics 2015.
  4. Hu Han, Member, IEEE and Anil K. Jain, Fellow, IEEE, Age, Gender and Race Estimation from Unconstrained Face Images, IEEE 2014.
  5. Lacey Best-Rowden, Hu Han, Member, IEEE, Charles Otto, Brendan Klare, Member, IEEE, and Anil K. Jain, Fellow, IEEE, Unconstrained Face Recognition: Identifying a Person of Interest from a Media Collection, IEEE Transactions on Information Forensics and Security, 2014.
  6. Koichiro Niinuma, Hu Han, and Anil K. Jain, Automatic Multi-view Face Recognition via 3D Model Based Pose Regularization, IEEE 6th International Conference on Biometrics USA, 2013.
  7. Lacey Best-Rowden , Brendan Klare , Joshua Klontz , Anil K. Jain, Establishing a Baseline for Unconstrained Face Recognition, IEEE Transactions on Biometrics 2013.
  8. S. R. Arashloo and J. Kittler. Energy normalization for pose-invariant face recognition based on MRF model image matching. IEEE Trans. PAMI, 33(6):1274–1280, 2011.
  9. A. Asthana, T. K. Marks, M. J. Jones, K. H. Tieu, and M. V. Rohith. Fully automatic pose invariant face recognition via 3D pose normalization. Proc. ICCV, pages 937–944, 2011.
  10. C. D. Castillo and D. W. Jacobs. Wide-baseline stereo for face recognition with large pose variation. Proc. IEEE CVPR, pages 537–544, 2011.
  11. Liu, Z., Lv, S., Lv, Y., et al.: ‘A natural visible and infrared facial expression database for expression recognition and emotion inference’, IEEE Trans. Multimedia, 2010, 12, (7), pp. 682–691
  12. A. B. Ashraf, S. Lucey, and T. Chen. Learning patch correspondences for improved viewpoint invariant face recognition. Proc. IEEE CVPR, pages 1–8, 2008.
  13. Huang, G., Ramesh, M., Berg, T., et al.: ‘Labeled faces in the wild: a database for studying face recognition in unconstrained environments’. Technical Report, 07–49, University of Massachusetts, Amherst, 2007.
  14. Xiujuan, C., Shiguang, S., Xilin, C., et al.: ‘Locally linear regression for pose-invariant face recognition’, IEEE Trans. Image Process., 2007, 16, (7),pp. 1716–1725
  15. Phillips, P.J., Flynn, P.J., Scruggs, T., et al.: ‘Overview of the face recognition grand challenge’, Comput. Vis. Pattern Recognit., 2005, (1), pp. 947–954
  16. Viola, P., Jones, M.: ‘Robust real-time face detection’, Int. J. Comput. Vis, 2004, 57, pp. 137–154
  17. V. Blanz and T. Vetter. Face recognition based on fitting a 3D morphable model. IEEE Trans. PAMI, 25(9):1063–1074, 2003.
  18. Volker, B., Thomas, V.: ‘Face recognition based on fitting a 3-D morphable model’, IEEE Trans. Pattern Anal. Mach. Intell., 2003, 25, (9), pp. 1063–1074
  19. Phillips, J., Wechsler, H., Huang, J.S., et al.: ‘The FERET database and evaluation procedure for face recognition algorithms’, Image Vis. Comput., 1998, pp. 295–306
  20. Turk, M., Pentland, A.: ‘Eigenfaces for recognition’, J. Cogn. Neurosci., 1991, 3, (1), pp. 71–86
  21. FaceVACS Software Developer Kit Cognitec Systems GmbH, http://www.cognitec-systems.de/.
  22. USF DARPA HumanID 3D Face Database. Sudeep Sarkar, University of South Florida.

Publication Details

Published in : Volume 3 | Issue 3 | March-April 2017
Date of Publication : 2017-04-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 577-585
Manuscript Number : IJSRST1733154
Publisher : Technoscience Academy

Print ISSN : 2395-6011, Online ISSN : 2395-602X

Cite This Article :

Girishma Batra, Pramod Patil, " Pose Regularization Based Automatic Multi-View Face Recognition Method ", International Journal of Scientific Research in Science and Technology(IJSRST), Print ISSN : 2395-6011, Online ISSN : 2395-602X, Volume 3, Issue 3, pp.577-585, March-April-2017.
Journal URL : http://ijsrst.com/IJSRST1733154

Article Preview