A wearable face recognition system for individuals with visual impairments

ABSTRACT

This paper describes the iCare Interaction Assistant, an assistive device for helping the individuals who are visually impaired during social interactions. The research presented here addresses the problems encountered in implementing real-time face recognition algorithms on a wearable device. Face recognition is the initial step towards building a comprehensive social interaction assistant that will identify and interpret facial expressions, emotions and gestures. Experiments conducted for selecting a face recognition algorithm that works despite changes in facial pose and illumination angle are reported. Performance details of the face recognition algorithms tested on the device are presented along with the overall performance of the system. The specifics of the hardware components used in the wearable device are mentioned and the block diagram of the wearable system is explained in detail.

REFERENCES

• 1: W. Zhao, R. Chellappa, and A. Rosenfeld. Face Recognition: A Literature Survey. Technical Report CAR-TR948, UMD CfAR, 2000.
• 2: M. Turk, and A. Pentland. Face recognition using Eigenfaces, Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 586--591, 1991.
• 3: K. Etemad, and R. Chellappa. Discriminant analysis for recognition of human face images. Journal of Optical Society of America, pp. 1724--1733, 1997.
• 4: Baback Moghaddam , Alex Pentland, Probabilistic Visual Learning for Object Representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.7, p.696-710, July 1997 [doi>10.1109/34.598227]
• 5: A. Nefian, and M H Hayes III. Hidden markov models for face detection and recognition. IEEE International Conference on Image Processing, vol. 1, pp. 141--145, October 1998.
• 6: J. Black, M. Gargesha, K. Kahol, P. Kuchi, and S. Panchanathan. A framework for performance evaluation of face recognition algorithms. ITCOM, Internet Multimedia Systems II, Boston, July 2002.
• 7: Laurenz Wiskott , Jean-Marc Fellous , Norbert Krüger , Christopher von der Malsburg, Face Recognition by Elastic Bunch Graph Matching, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.7, p.775-779, July 1997 [doi>10.1109/34.598235]
• 8: P. J. Phillips, P. Rauss, and S. Der. FERET (Face Recognition Technology) Recognition Algorithm Development and Test Report. Technical Report ARL-TR 995, U. S. Army Research Laboratory.
• 9: P. Jonathon Phillips , Hyeonjoon Moon , Patrick Rauss , Syed A. Rizvi, The FERET Evaluation Methodology for Face-Recognition Algorithms, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.137, June 17-19, 1997
• 10: P. J. Phillips, H. Moon, S. A. Rizvi, and P. Rauss. The FERET Testing Protocol. Face Recognition: From Theory to Applications. (H. Wechsler, P. J. Phillips, V. Bruce, F. F. Soulie, and T. S. Huang, eds.) Berlin: Springer-Verlag. Pp. 224--261, 1998.
• 11: K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre. XM2VTSDB: The Extended M2VTS Database. Proc. International Conference on Audio- and Video-based Person Authentication. pp. 72--77, 1999.
• 12: G. Gordon. Face Recognition Based on Depth Maps and Surface Curvature. SPIE Proc. Vol. 1570: Geometric Methods in Computer Vision. pp. 234--247, 1992.
• 13: J. Wilder , P. J. Phillips , Cunhong Jiang , S. Wiener, Comparison of visible and infra-red imagery for face recognition, Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96), p.182, October 14-16, 1996
• 14: K. G. Bahadir, U. B. Aziz, Y. Altunbasak, H. H. Monson III, and Russell M. Mersereau. Eigenface-Domain Super-Resolution for Face Recognition. IEEE Trans. On Image Processing, Vol. 12, No. 5, May 2003.
• 15: O. Yamaguchi , K. Fukui , K. Maeda, Face Recognition Using Temporal Image Sequence, Proceedings of the 3rd. International Conference on Face & Gesture Recognition, p.318, April 14-16, 1998
• 16: Xin Chen , Patrick J. Flynn , Kevin W. Bowyer, PCA-Based Face Recognition in Infrared Imagery: Baseline and Comparative Studies, Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures, p.127, October 17-17, 2003
• 17: Fu Jie Huang , Tsuhan Chen , Zhihua Zhou , Hong-Jiang Zhang, Pose Invariant Face Recognition, Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, p.245, March 26-30, 2000
• 18: B. Gökberk , E. Alpaydýn, Feature Selection for Pose Invariant Face Recognition, Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4, p.40306, August 11-15, 2002
• 19: Sami Romdhani , Volker Blanz , Thomas Vetter, Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.3-19, May 28-31, 2002
• 20: iCARE Projects. http://cubic.asu.edu.
• 21: The vOICe. http://www.seeingwithsound.com.
• 22: The EyeTap. http://eyetap.org/
• 23: P. Viola, and M. Jones. Robust Real-time Object Detection. Second International Workshop on Statistical and Computational Theories of Vision - Modeling, Learning, Computing, and Sampling, Vancouver, Canada, July 13, 2001.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.0 GENERAL

General Terms:
Design, Experimentation, Performance

Keywords:
assistive device for visually impaired, face recognition, social interaction aide, wearable computing