Eye localization for face matching: is it always useful and under what conditions?

ABSTRACT

In this paper we address the influence of eye localization accuracy on face matching performance in the case of low resolution image and video content. By means of a broad experimental evaluation involving several base-line eye localizers and face matching algorithms we investigated to which extent and under what conditions the eye localization accuracy will benefit the face matching performance, both in terms of effectiveness and efficiency. Our evaluation showed that (1) worst-case eye localization errors have a big impact on face matching performance, (2) in respect to that and under a minimum required accuracy, eye localization can boost performance of naive face matchers, (3) eye localization allows for more efficient face matching without degrading performance.

REFERENCES

• 1: BioID face database. website: http://www.bioid.com/downloads/facedb/index.php.
• 2: CSU face identification evaluation system. website: http://www.cs.colostate.edu/evalfacerec/index.html.
• 3: Open Source Computer Vision Library. website: http://sourceforge.net/projects/opencvlibrary.
• 4: Sven Behnke, Learning Face Localization Using Hierarchical Recurrent Networks, Proceedings of the International Conference on Artificial Neural Networks, p.1319-1324, August 28-30, 2002
• 5: T. N. Bhaskar, F. T. Keat, S. Ranganath, and Y. V. Venkatesh. Blink detection and eye tracking for eye localization. In TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region, volume 2, pages 821--824, Oct. 2003.
• 6: M. Bianchini and L. Sarti. An eye detection system based on neural autoassociators. In Artificial Neural Networks in Pattern Recognition, volume 4087/2006, pages 244--252. Springer Berlin / Heidelberg, 2006.
• 7: Manuele Bicego , Andrea Lagorio , Enrico Grosso , Massimo Tistarelli, On the Use of SIFT Features for Face Authentication, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p.35, June 17-22, 2006 [doi>10.1109/CVPRW.2006.149]
• 8: P. Campadelli, R. Lanzarotti, and G. Lipori. Precise eye localization through a general-to-specific model definition. In Proceedings of the British Machine Vision Conference, pages 187--198, 2006.
• 9: D. Chen, X. Tang, Z. Ou, and N. Xi. A hierarchical floatboost and mlp classifier for mobile phone embedded eye location system. In ISSN, pages 20--25, 2006.
• 10: Gintautas Daunys , Nerijus Ramanauskas, The accuracy of eye tracking using image processing, Proceedings of the third Nordic conference on Human-computer interaction, p.377-380, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028074]
• 11: T. D'Orazio , M. Leo , G. Cicirelli , A. Distante, An Algorithm for Real Time Eye Detection in Face Images, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3, p.278-281, August 23-26, 2004 [doi>10.1109/ICPR.2004.148]
• 12: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 13: Mark Everingham , Andrew Zisserman, Regression and Classification Approaches to Eye Localization in Face Images, Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, p.441-448, April 10-12, 2006 [doi>10.1109/FGR.2006.90]
• 14: A. Fathi and M. T. Manzuri. Eye detection and tracking in video streams. In Communications and Information Technology, 2004. ISCIT 2004. IEEE International Symposium on, volume 2, pages 1258--1261, Oct. 2004.
• 15: Yoav Freund, Boosting a weak learning algorithm by majority, Information and Computation, v.121 n.2, p.256-285, Sept. 1995 [doi>10.1006/inco.1995.1136]
• 16: H.-C. Fu, P. S. Lai, R. S. Lou, and H. T. Pao. Face detection and eye localization by neural network based color segmentation. In Neural Networks for Signal Processing X, 2000. Proceedings of the 2000 IEEE Signal Processing Society Workshop, volume 2, pages 507--516, Sydney, NSW, Dec. 2000.
• 17: Athinodoros S. Georghiades , Peter N. Belhumeur , David J. Kriegman, From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.6, p.643-660, June 2001 [doi>10.1109/34.927464]
• 18: Craig Hennessey , Borna Noureddin , Peter Lawrence, A single camera eye-gaze tracking system with free head motion, Proceedings of the 2006 symposium on Eye tracking research & applications, March 27-29, 2006, San Diego, California [doi>10.1145/1117309.1117349]
• 19: W. Huang, C. W. Kwan, and L. C. De Silva. Eye tracking with statistical learning and sequential monte carlo sampling. In Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint Conference of the Fourth International Conference on, volume 3, pages 1873--1878, Dec. 2003.
• 20: Weimin Huang , Qibin Sun , Chian-Prong Lam , Jian-Kang Wu, A Robust Approach to Face and Eyes Detection from Images with Cluttered Background, Proceedings of the 14th International Conference on Pattern Recognition-Volume 1, p.110, August 16-20, 1998
• 21: Oliver Jesorsky , Klaus J. Kirchberg , Robert Frischholz, Robust Face Detection Using the Hausdorff Distance, Proceedings of the Third International Conference on Audio- and Video-Based Biometric Person Authentication, p.90-95, June 06-08, 2001
• 22: J.-K. Kamarainen, V. Kyrki, and H. Kälviäinen. Invariance properties of gabor filter-based features-overview and applications. IEEE Transactions on Image Processing, 15:1088--1099, 2006.
• 23: S. Kawato and J. Ohya. Two-step approach for real-time eye tracking with a new filteringtechnique. In Systems, Man, and Cybernetics, 2000 IEEE International Conference on, volume 2, pages 1366--1371, Nashville, TN, USA, 2000.
• 24: Nikunj Kela , Ajita Rattani , Phalguni Gupta, Illumination Invariant Elastic Bunch Graph Matching for Efficient Face Recognition, Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p.42, June 17-22, 2006 [doi>10.1109/CVPRW.2006.97]
• 25: H. Kim, J. H. Lee, and S. C. Kee. A fast eye localization method for face recognition. In Robot and Human Interactive Communication, 2004. ROMAN 2004. 13th IEEE International Workshop on, pages 241--245, Sept. 2004.
• 26: S. Kim, S.-T. Chung, S. Jung, D. Oh, J. Kim, and S. Cho. Multi-scale gabor feature based eye localization. In Proceedings of World Academy of Science, volume 21, pages 483--487, Jan. 2007.
• 27: Susan M. Kolakowski , Jeff B. Pelz, Compensating for eye tracker camera movement, Proceedings of the 2006 symposium on Eye tracking research & applications, March 27-29, 2006, San Diego, California [doi>10.1145/1117309.1117348]
• 28: B. Kroon , A. Hanjalic , S. Boughorbel, Comparison of face matching techniques under pose variation, Proceedings of the 6th ACM international conference on Image and video retrieval, p.272-279, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282323]
• 29: Dahua Lin , Xiaoou Tang, Recognize High Resolution Faces: From Macrocosm to Microcosm, Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.1355-1362, June 17-22, 2006 [doi>10.1109/CVPR.2006.243]
• 30: T. Liu and S. Zhu. Eyes detection and tracking based on entropy in particle filter. In Control and Automation, 2005. ICCA '05. International Conference on, volume 2, pages 1002--1007, June 2005.
• 31: K. Ma and X. Tang. Face recognition using discrete wavelet graph. In International Conference on Acoustics, Speech, and Signal Processing, 2003.
• 32: J. Min, K. W. Bowyer, and P. J. Flynn. Eye perturbation approach for robust recognition of inaccurately aligned faces. In Audio- and Video-Based Biometric Person Authentication, volume 3546/2005, pages 41--50. Springer Berlin / Heidelberg, 2005.
• 33: M. Motwani, R. Motwani, and F. C. H. Jr. Eye detection using wavelets and ann. In Proceedings of GSPx, 2004.
• 34: Zhiheng Niu , Shiguang Shan , Shengye Yan , Xilin Chen , Wen Gao, 2D Cascaded AdaBoost for Eye Localization, Proceedings of the 18th International Conference on Pattern Recognition, p.1216-1219, August 20-24, 2006 [doi>10.1109/ICPR.2006.1194]
• 35: Ilkwon Park , Jung-Ho Ahn , Hyeran Byun, Efficient Measurement of Eye Blinking under Various Illumination Conditions for Drowsiness Detection Systems, Proceedings of the 18th International Conference on Pattern Recognition, p.383-386, August 20-24, 2006 [doi>10.1109/ICPR.2006.476]
• 36: K. Peng, L. Chen, S. Ruan, and G. Kukharev. A robust and efficient algorithm for eye detection on gray intensity face. In Pattern Recognition and Image Analysis, volume 3687/2005, pages 302--308. Springer Berlin / Heidelberg, 2005.
• 37: E. Rentzeperis, A. Stergiou, A. Pnevmatikakis, and L. Polymenakos. Impact of face registration errors on recognition. In Artificial Intelligence Applications and Innovations, 2006.
• 38: Terry Riopka , Terrance Boult, The eyes have it, Proceedings of the 2003 ACM SIGMM workshop on Biometrics methods and applications, November 08, 2003, Berkley, California [doi>10.1145/982507.982510]
• 39: M. R. M. Rizk and A. Taha. Analysis of neural networks for face recognition systems with feature extraction to develop an eye localization based method. In Electronics, Circuits and Systems, 2002. 9th International Conference on, volume 3, pages 847--850, Sept. 2002.
• 40: Rajinda Senaratne , Saman Halgamuge, Optimised Landmark Model Matching for Face Recognition, Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition, p.120-125, April 10-12, 2006 [doi>10.1109/FGR.2006.85]
• 41: J. Sivic, M. Everingham, and A. Zisserman. Person spotting: video shot retrieval for face sets. In International Conference on Image and Video Retrieval, 2005.
• 42: A. C. Talay. An approach for eye detection using parallel genetic algorithm. In Computational Science -- ICCS 2005, volume 3516/2005, pages 1004--1007. Springer Berlin / Heidelberg, 2005.
• 43: X. Tang, Z. Ou, T. Su, H. Sun, and P. Zhao. Robust precise eye location by adaboost and svm techniques. In J. Wang, X. Liao, and Z. Yi, editors, ISNN (2), volume 3497 of Lecture Notes in Computer Science, pages 93--98. Springer, 2005.
• 44: Johan W. H. Tangelder , Ben A. M. Schouten, Learning a Sparse Representation from Multiple Still Images for On-Line Face Recognition in an Unconstrained Environment, Proceedings of the 18th International Conference on Pattern Recognition, p.10867-1090, August 20-24, 2006 [doi>10.1109/ICPR.2006.747]
• 45: L. Tao and H. K. Kwan. Automatic localization of human eyes in complex background. In Circuits and Systems, 2002. ISCAS 2002. IEEE International Symposium on, volume 5, May 2002.
• 46: M. A. Turk and A. P. Pentland. Face recognition using eigenfaces. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1991.
• 47: P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Precceedings of Computer Vision and Pattern Recognition, volume 1, pages 511--518, 2001.
• 48: J.-W. Wang and C.-C. Kuo. A robust two stage approach for eye detection. In Image Analysis and Processing -- ICIAP 2005, volume 3617/2005, pages 431--437. Springer Berlin / Heidelberg, 2005.
• 49: Peng Wang , Matthew B. Green , Qiang Ji , James Wayman, Automatic Eye Detection and Its Validation, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, p.164, June 20-26, 2005 [doi>10.1109/CVPR.2005.570]
• 50: Z. Wencong, C. Hong, Y. Peng, L. Bin, and Z. Zhenquan. Precise eye localization with adaboost and fast radial symmetry. In Computational Intelligence and Security, 2006 International Conference on, volume 1, pages 725--730, Guangzhou, Nov. 2006.
• 51: Laurenz Wiskott , Jean-Marc Fellous , Norbert Krüger , Christoph von der Malsburg, Face recognition by elastic bunch graph matching, Intelligent biometric techniques in fingerprint and face recognition, CRC Press, Inc., Boca Raton, FL, 1999
• 52: Junwen Wu , Mohan M. Trivedi, A Binary Tree for Probability Learning in Eye Detection, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, p.170, June 20-26, 2005 [doi>10.1109/CVPR.2005.562]
• 53: Zhang Xingming , Zhan Huangyuan, An Illumination Independent Eye Detection Algorithm, Proceedings of the 18th International Conference on Pattern Recognition, p.392-395, August 20-24, 2006 [doi>10.1109/ICPR.2006.248]
• 54: P. Yang, B. Du, S. Shan, and W. Gao. A novel pupil localization method based on gaboreye model and radial symmetry operator. In Image Processing, 2004. ICIP '04. 2004 International Conference on, volume 1, pages 67--70, Oct. 2004.
• 55: J. Zhang and Z. Zhang. Application of a strong tracking finite-difference extended kalman filter to eye tracking. In ICIC (1), pages 1170--1179, 2006.
• 56: W. Zhao , R. Chellappa , A. Krishnaswamy, Discriminant Analysis of Principal Components for Face Recognition, Proceedings of the 3rd. International Conference on Face & Gesture Recognition, p.336, April 14-16, 1998
• 57: W. Zhao , R. Chellappa , P. J. Phillips , A. Rosenfeld, Face recognition: A literature survey, ACM Computing Surveys (CSUR), v.35 n.4, p.399-458, December 2003 [doi>10.1145/954339.954342]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

General Terms:
Experimentation

Keywords:
eye localization, face detection, face matching, face recognition