Description and retrieval of 3D face models using iso-geodesic stripes

ABSTRACT

In this paper, we propose an original framework for description and matching of three dimensional faces for recognition purposes. Basic traits of a face are encoded by extracting iso-geodesic stripes from the surface of a face model. A compact representation is then constructed through a modeling technique capable to express the basic shape of iso-geodesic stripes and quantitatively measure their spatial relationships in a three dimensional space. This information is encoded in an attributed relational graph. In this way,the structural similarity between two face models is evaluated by matching their corresponding graphs.Experimental results on a 3D face database and baseline comparison show that the proposed solution attains high face recognition accuracy and is reasonably robust to facial expression and pose changes.

REFERENCES

• 1: G. Antini, S. Berretti, A. D. Bimbo, and P. Pala. 3d mesh partitioning for retrieval by parts applications. In In Proc. Int. Conf. on Multimedia and Expo Amsterdam, The Netherlands, July 2005.
• 2: G. Antini et al. 3d face identification based on arrangement of salient wrinkles. In Proc. International Conference Multimedia & Expo Toronto, Canada, July 2006.
• 3: S. Berretti, A. Del Bimbo,and E. Vicario. Weighted walkthroughs between extended entities for retrieval by spatial arrangement. IEEE Transactions on Multimedia 5(1):52--70, March 2003.
• 4: Volker Blanz , Thomas Vetter, Face Recognition Based on Fitting a 3D Morphable Model, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.9, p.1063-1074, September 2003 [doi>10.1109/TPAMI.2003.1227983]
• 5: Kevin W. Bowyer , Kyong Chang , Patrick Flynn, A Survey Of Approaches To Three-Dimensional Face Recognition, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1, p.358-361, August 23-26, 2004 [doi>10.1109/ICPR.2004.105]
• 6: Alexander M. Bronstein , Michael M. Bronstein , Ron Kimmel, Three-Dimensional Face Recognition, International Journal of Computer Vision, v.64 n.1, p.5-30, August 2005 [doi>10.1007/s11263-005-1085-y]
• 7: A. Bronstein, M. Bronstein, and R. Kimmel. Robust expression-invariant face recognition from partially missing data. In Proc. European Conference on Computer Vision pages 396--408, Gratz, Austria, May 2006.
• 8: Kyong I. Chang , KevinW. Bowyer , Patrick J. Flynn, Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, p.157, June 20-26, 2005 [doi>10.1109/CVPR.2005.567]
• 9: Kyong I. Chang , Kevin W. Bowyer , Patrick J. Flynn, Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.10, p.1695-1700, October 2006 [doi>10.1109/TPAMI.2006.210]
• 10: Jamie Cook , Vinod Chandran , Sridha Sridharan , Clinton Fookes, Face Recognition from 3D Data using Iterative Closest Point Algorithm and Gaussian Mixture Models, Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium on (3DPVT'04), p.502-509, September 06-09, 2004 [doi>10.1109/3DPVT.2004.57]
• 11: G. Gordon. Face recognition based on depth and curvature features. In Proc. Computer Vision and Pattern Recognition pages 108--110, June 1992.
• 12: Masaki Hilaga , Yoshihisa Shinagawa , Taku Kohmura , Tosiyasu L. Kunii, Topology matching for fully automatic similarity estimation of 3D shapes, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.203-212, August 2001 [doi>10.1145/383259.383282]
• 13: K. B. K. I. Chang and P. Flynn. Face recognition using 2d and 3d facial data. In Proc. Multimodal User Authentication Workshop pages 25--32, December 2003.
• 14: R. Kimmel and J. Sethian. Computing geodesic on manifolds. In Proc. US National Academy of Science volume 95, pages 8431--8435, 1998.
• 15: Eric Klassen , Anuj Srivastava , Washington Mio , Shantanu H. Joshi, Analysis of Planar Shapes Using Geodesic Paths on Shape Spaces, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.3, p.372-383, March 2004 [doi>10.1109/TPAMI.2004.1262333]
• 16: J. Lee and E. Milios. Matching range images of human faces. In Proc. Conference on Computer Vision pages 722--726, Osaka, Japan, 1990.
• 17: Xiaoguang Lu , Anil K. Jain , Dirk Colbry, Matching 2.5D Face Scans to 3D Models, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.1, p.31-43, January 2006 [doi>10.1109/TPAMI.2006.15]
• 18: Gérard Medioni , Roman Waupotitsch, Face Modeling and Recognition in 3-D, Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures, p.232, October 17-17, 2003
• 19: A. Mian, M. Bennamoun, and R. Owens. Region-based matching for robust 3d face recognition. In Proc. British Machine Vision Conference pages, Oxford, United Kingdom, September 2005.
• 20: J. Milnor. Morse Theory Princeton University Press, Princeton, NJ, 1963.
• 21: A. Moreno, Á. Sánchez,J. Vélez, and F.Díaz. Face recognition using 3d surface-extracted descriptor. In Proc. Irish Machine Vision and Image Processing Coleraine, Ireland, September 2003.
• 22: A. Moreno and A. Sanchez. Gavabdb: A 3d face database. In Proc. 2nd COST275 Workshop on Biometrics on the Internet pages 75--80, Vigo (Spain), March 2004.
• 23: Unsang Park , Hong Chen , Anil K. Jain, 3D Model-Assisted Face Recognition in Video, Proceedings of the The 2nd Canadian Conference on Computer and Robot Vision (CRV'05), p.322-329, May 09-11, 2005 [doi>10.1109/CRV.2005.2]
• 24: P. Jonathon Phillips , Patrick J. Flynn , Todd Scruggs , Kevin W. Bowyer , Jin Chang , Kevin Hoffman , Joe Marques , Jaesik Min , William Worek, Overview of the Face Recognition Grand Challenge, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.947-954, June 20-26, 2005 [doi>10.1109/CVPR.2005.268]
• 25: C. Samir, A. Srivastava, and M. Daoudi. 3d face recognition using shapes of facial curves. In Proc. International Conference on Acoustics, Speech, and Signal Processing Toulouse, France, May 2006.
• 26: Chafik Samir , Anuj Srivastava , Mohamed Daoudi, Three-Dimensional Face Recognition Using Shapes of Facial Curves, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.11, p.1858-1863, November 2006 [doi>10.1109/TPAMI.2006.235]
• 27: F. Tsalakanidou , D. Tzovaras , M. G. Strintzis, Use of depth and colour eigenfaces for face recognition, Pattern Recognition Letters, v.24 n.9-10, p.1427-1435, 01 June 2003 [doi>10.1016/S0167-8655(02)00383-5]
• 28: Y. Wang, C. Chua, and Y. Ho. Facial feature detection and face recognition from 2d and 3d images.Pattern Recognition Letters 23(10):1191--1202, August 2002.
• 29: Y. Wang, G. Pan, Z. Wu, and Y. Wang. Exploring facial expression effects in 3d face recognition using partialicp. In Proc. Asian Conference on Computer Vision pages 581--590, Hyderabad, India, 2006.
• 30: W. Zhao , R. Chellappa , P. J. Phillips , A. Rosenfeld, Face recognition: A literature survey, ACM Computing Surveys (CSUR), v.35 n.4, p.399-458, December 2003 [doi>10.1145/954339.954342]
• 31: S. Zlatanova, On 3D Topological Relationships, Proceedings of the 11th International Workshop on Database and Expert Systems Applications, p.913, September 06-08, 2000
• 32: S. Zlatanova, A. A. Rahman, and W. Shi. Topology for 3d spatial objects. In Int. Symp. and Exhibition on Geoinformation Kuala Lumpur, Malaysia, October 2002.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Theory

Keywords:
3D face recognition, expression invariance, geodesic distance, spatial relationships, weighted walkthroughs