Person identification from heavily occluded face images

ABSTRACT

In numerous occasions there is need to identify subjects shown in heavily occluded face images. Typical examples include the recognition of criminals whose facial images are captured by surveillance cameras. In such cases a significant part of the subjects face is occluded making the process of identification extremely difficult, both for automatic face recognition systems and human observers. In this paper we propose a face recognition algorithm, which can be used for identifying individuals with hidden facial parts. During the face recognition procedure, occluded facial regions are detected so that the model-based face recognition algorithm implemented makes use of information only from the non-occluded facial regions. With our approach information from occluded facial regions is not utilized during the process of face recognition hence the occlusions do not destruct the recognition process and as a result the probability of achieving correct identification is improved.

REFERENCES

• 1: Timothy F. Cootes , Gareth J. Edwards , Christopher J. Taylor, Active Appearance Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.6, p.681-685, June 2001 [doi>10.1109/34.927467]
• 2: Edwards, G.J. Lanitis, A. Taylor, C.J. and Cootes, T.F. Statistical Face Models: Improving Specificity. Image and Vision Computing, 16 (3), pp 203--211, 1998.
• 3: Edwards, G.J. Cootes, T.F. and Taylor, C.J. "Advances in Active Appearance Models". In Procs of the 7th International Conference of Computer Vision, Vol I, pp 137--142, IEEE Computer Society Press, 1999.
• 4: Athinodoros S. Georghiades , Peter N. Belhumeur , David J. Kriegman, From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.6, p.643-660, June 2001 [doi>10.1109/34.927464]
• 5: Gross, R. and Brajovic, V. "An Image Preprocessing Algorithm for Illumination Invariant Face Recognition. IN Procs. of the 4th International Conference on Audio and Video-Based Biometric Person Identification, Lectue Notes in Computer Science Vol 2688, pp 10--18, eds Josef Kittler and M. Nixon, 2003.
• 6: Bon-Woo Hwang , Seong-Whan Lee, Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.3, p.365-372, March 2003 [doi>10.1109/TPAMI.2003.1182099]
• 7: Andreas Lanitis , Chris J. Taylor , Timothy F. Cootes, Automatic Interpretation and Coding of Face Images Using Flexible Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.7, p.743-756, July 1997 [doi>10.1109/34.598231]
• 8: A. Lanitis , C. J. Taylor , T. F. Cootes, Toward Automatic Simulation of Aging Effects on Face Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.4, p.442-455, April 2002 [doi>10.1109/34.993553]
• 9: Aleix M. Martínez, Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.6, p.748-763, June 2002 [doi>10.1109/TPAMI.2002.1008382]
• 10: Park, J. Oh, Y. Ahn S. and Lee, S. Glasses Removal from facial Image Using Recursive PCA Reconstruction. In Procs. of the 4th International Conference on Audio and Video-Based Biometric Person Identification, Lecture Notes in Computer Science Vol 2688, pp 369--376, eds Josef Kittler and M. Nixon, 2003.
• 11: Alex Pentland, Looking at People: Sensing for Ubiquitous and Wearable Computing, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.1, p.107-119, January 2000 [doi>10.1109/34.824823]
• 12: Turk, M. and Pentland, A. Eigenfaces for Recognition. Journal of Cognitive Neuroscience, 3, no 1, pp 71--86, 1991.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

General Terms:
Algorithms, Experimentation

Keywords:
face recognition, occluded faces, occlusion detection