Interacting with eye movements in virtual environments

ABSTRACT

Eye movement-based interaction offers the potential of easy, natural, and fast ways of interacting in virtual environments. However, there is little empirical evidence about the advantages or disadvantages of this approach. We developed a new interaction technique for eye movement interaction in a virtual environment and compared it to more conventional 3-D pointing. We conducted an experiment to compare performance of the two interaction types and to assess their impacts on spatial memory of subjects and to explore subjects' satisfaction with the two types of interactions. We found that the eye movement-based interaction was faster than pointing, especially for distant objects. However, subjects' ability to recall spatial information was weaker in the eye condition than the pointing one. Subjects reported equal satisfaction with both types of interactions, despite the technology limitations of current eye tracking equipment.

REFERENCES

• 1: Richard A. Bolt, Gaze-orchestrated dynamic windows, ACM SIGGRAPH Computer Graphics, v.15 n.3, p.109-119, August 1981
• 2: Richard A. Bolt, Eyes at the interface, Proceedings of the 1982 conference on Human factors in computing systems, p.360-362, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801811]
• 3: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 4: Rudolph P. Darken , John L. Sibert, Wayfinding strategies and behaviors in large virtual worlds, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.142-149, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238459]
• 5: William J. Doll , Gholamreza Torkzadeh, The measurement of end-user computing satisfaction, MIS Quarterly, v.12 n.2, p.259-274, June 1988 [doi>10.2307/248851]
• 6: Andrew Forsberg , Kenneth Herndon , Robert Zeleznik, Aperture based selection for immersive virtual environments, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.95-96, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237105]
• 7: Glenn, F.A., and others, Eye-voice-controlled Interface, Proc. 30th Annual Meeting of the Human Factors Society, pp. 322-326, Santa Monica, Calif., 1986.
• 8: Robert J. K. Jacob, The use of eye movements in human-computer interaction techniques: what you look at is what you get, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.152-169, April 1991 [doi>10.1145/123078.128728]
• 9: Robert J. K. Jacob, Eye tracking in advanced interface design, Virtual environments and advanced interface design, Oxford University Press, Inc., New York, NY, 1995
• 10: Robert J. K. Jacob, A Visual Language for Non-WIMP User Interfaces, Proceedings of the 1996 IEEE Symposium on Visual Languages, p.231, September 03-06, 1996
• 11: Robert J. K. Jacob , Leonidas Deligiannidis , Stephen Morrison, A software model and specification language for non-WIMP user interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.1, p.1-46, March 1999 [doi>10.1145/310641.310642]
• 12: David R. Koller , Mark R. Mine , Scott E. Hudson, Head-tracked orbital viewing: an interaction technique for immersive virtual environments, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.81-82, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237103]
• 13: Mark R. Mine , Frederick P. Brooks, Jr. , Carlo H. Sequin, Moving objects in space: exploiting proprioception in virtual-environment interaction, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.19-26, August 1997 [doi>10.1145/258734.258747]
• 14: Jakob Nielsen, Noncommand user interfaces, Communications of the ACM, v.36 n.4, p.83-99, April 1993 [doi>10.1145/255950.153582]
• 15: Ivan Poupyrev , Mark Billinghurst , Suzanne Weghorst , Tadao Ichikawa, The go-go interaction technique: non-linear mapping for direct manipulation in VR, Proceedings of the 9th annual ACM symposium on User interface software and technology, p.79-80, November 06-08, 1996, Seattle, Washington, United States [doi>10.1145/237091.237102]
• 16: Shneiderman, B., Norman, K., Questionnaire for User Interface Satisfaction (QUIS), Designing the User Interface, Strategies for Effective Human-Computer Interaction, Second Edition, Addison-Wesley press (1992).
• 17: Linda E. Sibert , Robert J. K. Jacob, Evaluation of eye gaze interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.281-288, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332445]
• 18: India Starker , Richard A. Bolt, A gaze-responsive self-disclosing display, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.3-10, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97245]
• 19: Colin Ware , Harutune H. Mikaelian, An evaluation of an eye tracker as a device for computer input2, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.183-188, April 05-09, 1987, Toronto, Ontario, Canada

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

General Terms:
Design, Experimentation, Human Factors, Management, Measurement, Performance, Theory

Keywords:
Polhemus tracker, eye movements, eye tracking, interaction techniques, virtual environments, virtual reality