Calibration-free gaze tracking using a binocular 3D eye model

ABSTRACT

This paper presents a calibration-free method for estimating the point of gaze (POG) on a display by using two pairs of stereo cameras. By using one pair of cameras and two light sources, the optical axis of the eye and the position of the center of the cornea can be estimated. This estimation is carried out by using a spherical model of the cornea. One pair of cameras is used for the estimation of the optical axis of the left eye, and the other pair is used for the estimation of the optical axis of the right eye. The point of intersection of optical axis with the display is termed the point of the optical axis (POA). The POG is approximately estimated as the midpoint of the line joining POAs of both the eyes with the display. We have developed a prototype system based on this method and demonstrated that the midpoint of POAs was closer to the fiducial point that the user gazed at than each POA.

REFERENCES

• 1: Andrew T. Duchowski, Eye Tracking Methodology: Theory and Practice, Springer-Verlag New York, Inc., Secaucus, NJ, 2007
• 2: Guestrin, E.D. and Eizenman, M. General Theory of Remote Gaze Estimation Using the Pupil Center and Corneal Reflections IEEE Transactions on Biomedical Engineering, 53 (6) (2006), 1124--1133.
• 3: Guestrin, E.D. and Eizenman, M. Remote Point-of-Gaze Estimation with Free Head Movements Requiring a Single-Point Calibration. in Proceedings of the 29th Annual International Conference of the IEEE EMBS (2007), 4556--4560.
• 4: Intel Open Source Computer Vision Library. http://www.intel.com/technology/computing/opencv/index.htm
• 5: Robert J. K. Jacob, The use of eye movements in human-computer interaction techniques: what you look at is what you get, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.152-169, April 1991 [doi>10.1145/123078.128728]
• 6: Nagamatsu, T., Kaieda, Y., Kamahara, J. and Shimada, H. Development of a Skill Acquisition Support System Using Expert's Eye Movement. in Proceedings of HCI International 2007, 9 (2007), 430--439.
• 7: Takashi Nagamatsu , Junzo Kamahara , Takumi Iko , Naoki Tanaka, One-point calibration gaze tracking based on eyeball kinematics using stereo cameras, Proceedings of the 2008 symposium on Eye tracking research & applications, March 26-28, 2008, Savannah, Georgia [doi>10.1145/1344471.1344496]
• 8: Nagamatsu, T., Kamahara, J. and Tanaka, N. 3D Gaze Tracking with Easy Calibration Using stereo Cameras for Robot and Human Communication. in Proceedings of IEEE ROMAN 2008 (2008), 59--64.
• 9: Osaka, R. Experimental psychology of eye movements (in Japanese) The University of Nagoya Press., Nagoya,Japan (1993).
• 10: Shih, S.-W. and Liu, J. A novel approach to 3D gaze tracking using stereo cameras IEEE Transactions on Systems, Man, and Cybernetics, Part B, 34 (1) (2004), 234--245.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Ergonomics

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Measurement

Keywords:
calibration-free, eye model, eye movement, gaze tracking