EyePoint: practical pointing and selection using gaze and keyboard

ABSTRACT

We present a practical technique for pointing and selection using a combination of eye gaze and keyboard triggers. EyePoint uses a two-step progressive refinement process fluidly stitched together in a look-press-look-release action, which makes it possible to compensate for the accuracy limitations of the current state-of-the-art eye gaze trackers. While research in gaze-based pointing has traditionally focused on disabled users, EyePoint makes gaze-based pointing effective and simple enough for even able-bodied users to use for their everyday computing tasks. As the cost of eye gaze tracking devices decreases, it will become possible for such gaze-based techniques to be used as a viable alternative for users who choose not to use a mouse depending on their abilities, tasks and preferences.

REFERENCES

• 1: IPRIZE: a $1,000,000 Grand Challenge designed to spark advances in eye-tracking technology through competition, 2006. http://hcvl.hci.iastate.edu/IPRIZE/
• 2: Arnon Amir , Lior Zimet , Alberto Sangiovanni-Vincentelli , Sean Kao, An embedded system for an eye-detection sensor, Computer Vision and Image Understanding, v.98 n.1, p.104-123, April 2005 [doi>10.1016/j.cviu.2004.07.009]
• 3: Michael Ashmore , Andrew T. Duchowski , Garth Shoemaker, Efficient eye pointing with a fisheye lens, Proceedings of Graphics Interface 2005, May 09-11, 2005, Victoria, British Columbia
• 4: Beymer, D., S. P. Farrell, and S. Zhai. System and method for selecting and activating a target object using a combination of eye gaze and key presses. USA Patent 2005, International Business Machines Corporation.
• 5: Card, S. K., W. K. English, and B. J. Burr. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT. Ergonomics 21(8). pp. 601--13, 1978.
• 6: Sarah A. Douglas , Anant Kartik Mithal, The effect of reducing homing time on the speed of a finger-controlled isometric pointing device, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.411-416, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191805]
• 7: Farrell, S. P. and S. Zhai. System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking. USA Patent 2005, International Business Machines Corporation.
• 8: David Fono , Roel Vertegaal, EyeWindows: evaluation of eye-controlled zooming windows for focus selection, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1054994]
• 9: Dan Witzner Hansen , David J. C. MacKay , John Paulin Hansen , Mads Nielsen, Eye tracking off the shelf, Proceedings of the 2004 symposium on Eye tracking research & applications, p.58-58, March 22-24, 2004, San Antonio, Texas [doi>10.1145/968363.968375]
• 10: Robert J. K. Jacob, The use of eye movements in human-computer interaction techniques: what you look at is what you get, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.152-169, April 1991 [doi>10.1145/123078.128728]
• 11: Jacob, R. J. K. and K. S. Karn, Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises, in The Mind's eye: Cognitive and Applied Aspects of Eye Movement Research, J. Hyona, R. Radach, and H. Deubel, Editors. Elsevier Science: Amsterdam. pp. 573--605, 2003.
• 12: Kumar, M., GUIDe: Gaze-enhanced User Interface Design, 2006. Stanford. http://hci.stanford.edu/research/GUIDe
• 13: Kumar, M., Reducing the Cost of Eye Tracking Systems. Technical Report CSTR 2006-08, Stanford University, Stanford, April 2006. http://hci.stanford.edu/cstr/reports/2006-08.pdf
• 14: Chris Lankford, Effective eye-gaze input into Windows, Proceedings of the 2000 symposium on Eye tracking research & applications, p.23-27, November 06-08, 2000, Palm Beach Gardens, Florida, United States [doi>10.1145/355017.355021]
• 15: Päivi Majaranta , I. Scott MacKenzie , Anne Aula , Kari-Jouko Räihä, Auditory and visual feedback during eye typing, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765979]
• 16: Päivi Majaranta , Kari-Jouko Räihä, Twenty years of eye typing: systems and design issues, Proceedings of the 2002 symposium on Eye tracking research & applications, March 25-27, 2002, New Orleans, Louisiana [doi>10.1145/507072.507076]
• 17: Michael McGuffin , Ravin Balakrishnan, Acquisition of expanding targets, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503388]
• 18: Darius Miniotas , Oleg Špakov , Ivan Tugoy , I. Scott MacKenzie, Speech-augmented eye gaze interaction with small closely spaced targets, Proceedings of the 2006 symposium on Eye tracking research & applications, March 27-29, 2006, San Diego, California [doi>10.1145/1117309.1117345]
• 19: Norman, D. A., Emotional Design: Why we love (or hate) everyday things. New York: Basic Books. 256 pp. 2004.
• 20: Dario D. Salvucci , John R. Anderson, Intelligent gaze-added interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.273-280, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332444]
• 21: Dario D. Salvucci , Joseph H. Goldberg, Identifying fixations and saccades in eye-tracking protocols, Proceedings of the 2000 symposium on Eye tracking research & applications, p.71-78, November 06-08, 2000, Palm Beach Gardens, Florida, United States [doi>10.1145/355017.355028]
• 22: Linda E. Sibert , Robert J. K. Jacob, Evaluation of eye gaze interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.281-288, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332445]
• 23: Tobii Technology, AB, Drift Effects, in User Manual: Tobii Eye Tracker and ClearView Analysis Software. Tobii Technology AB. p. 15, 2006.
• 24: Tobii Technology, AB, Tobii 1750 Eye Tracker, 2006. Sweden. http://www.tobii.com
• 25: Jingtao Wang , Shumin Zhai , Hui Su, Chinese input with keyboard and eye-tracking: an anatomical study, Proceedings of the SIGCHI conference on Human factors in computing systems, p.349-356, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365298]
• 26: Masatake Yamato , Katsuro Inoue , Akito Monden , Koji Torii , Ken-ichi Matsumoto, Button selection for general GUIs using eye and hand together, Proceedings of the working conference on Advanced visual interfaces, p.270-273, May 2000, Palermo, Italy [doi>10.1145/345513.345339]
• 27: Shumin Zhai , Stéphane Conversy , Michel Beaudouin-Lafon , Yves Guiard, Human on-line response to target expansion, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642644]
• 28: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Human Factors

Keywords:
eye pointing, eye tracking, gaze-enhanced user interface design, pointing and selection