Speech-augmented eye gaze interaction with small closely spaced targets

ABSTRACT

Eye trackers have been used as pointing devices for a number of years. Due to inherent limitations in the accuracy of eye gaze, however, interaction is limited to objects spanning at least one degree of visual angle. Consequently, targets in gaze-based interfaces have sizes and layouts quite distant from "natural settings". To accommodate accuracy constraints, we developed a multimodal pointing technique combining eye gaze and speech inputs. The technique was tested in a user study on pointing at multiple targets. Results suggest that in terms of a footprint-accuracy tradeoff, pointing performance is best (~93%) for targets subtending 0.85 degrees with 0.3-degree gaps between them. User performance is thus shown to approach the limit of practical pointing. Effectively, developing a user interface that supports hands-free interaction and has a design similar to today's common interfaces is feasible.

REFERENCES

• 1: Robert J. K. Jacob, Eye tracking in advanced interface design, Virtual environments and advanced interface design, Oxford University Press, Inc., New York, NY, 1995
• 2: David B. Koons , Carlton J. Sparrell , Kristinn R. Thorisson, Integrating simultaneous input from speech, gaze, and hand gestures, Intelligent multimedia interfaces, American Association for Artificial Intelligence, Menlo Park, CA, 1993
• 3: Sharon Oviatt, Mutual disambiguation of recognition errors in a multimodel architecture, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.576-583, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303163]
• 4: Katsumi Tanaka, A robust selection system using real-time multi-modal user-agent interactions, Proceedings of the 4th international conference on Intelligent user interfaces, p.105-108, January 05-08, 1999, Los Angeles, California, United States [doi>10.1145/291080.291099]
• 5: Colin Ware , Harutune H. Mikaelian, An evaluation of an eye tracker as a device for computer input2, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.183-188, April 05-09, 1987, Toronto, Ontario, Canada
• 6: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]
• 7: Qiaohui Zhang , Atsumi Imamiya , Kentaro Go , Xiaoyang Mao, Resolving ambiguities of a gaze and speech interface, Proceedings of the 2004 symposium on Eye tracking research & applications, p.85-92, March 22-24, 2004, San Antonio, Texas [doi>10.1145/968363.968383]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
eye tracking, eye-based interaction, human performance, pointing