Intelligent gaze-added interfaces

ABSTRACT

We discuss a novel type of interface, the intelligent gaze-added interface, and describe the design and evaluation of a sample gaze-added operating-system interface. Gaze-added interfaces, like current gaze-based systems, allow users to execute commands using their eyes. However, while most gaze-based systems replace the functionality of other inputs with that of gaze, gaze-added interfaces simply add gaze functionality that the user can employ if and when desired. Intelligent gaze-added interfaces utilize a probabilistic algorithm and user model to interpret gaze focus and alleviate typical problems with eye-taking data. We extended a standard WIMP operating-system interface into a new interface, IGO, that incorporates intelligent gaze-added input. In a user study, we found that users quickly adapted to the new interface and utilized gaze effectively both alone and with other inputs.

REFERENCES

• 1: Anderson, J.R., & Lebiere, C. (1998). The atomic components of thought. Hillsdale, NJ: Lawrence Erlbaum Associates.
• 2: Frey, L.A., White, K.P., & Hutchinson, T.E. (1990). Eye-gaze word processing. IEEE Transactions on Systems, Man, and Cybernetics, 20, 944-950.
• 3: James Gips, On Building Intelligence into EagleEyes, Assistive Technology and Artificial Intelligence, Applications in Robotics, User Interfaces and Natural Language Processing, p.50-58, January 1998
• 4: Goldberg, J.H., & Schryver, J.C. (1995). Eye-gaze determination of user intent at the computer interface. In J. M. Findlay, R. Walker, & R. W. Kentridge (Eds.), Eye Movement Research: Mechanisms, Processes, and Applications (pp. 491-502). New York: Elsevier Science Publishing.
• 5: Hutchinson, T.E., White, K.P., Martin, W.N., Reichert, K.C., & Frey, L.A. (1989). Humancomputer interaction using eye-gaze input. 1EEE Transactions on Systems, Man, and Cybernetics, 19, 1527-1534.
• 6: Robert J. K. Jacob, Eye tracking in advanced interface design, Virtual environments and advanced interface design, Oxford University Press, Inc., New York, NY, 1995
• 7: Robert J. K. Jacob , Leonidas Deligiannidis , Stephen Morrison, A software model and specification language for non-WIMP user interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.1, p.1-46, March 1999 [doi>10.1145/310641.310642]
• 8: Bonnie E. John, Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.107-116, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97262]
• 9: Dario Dino Salvucci , John R. Anderson, Mapping eye movements to cognitive processes, 1999
• 10: Dario D. Salvucci, Inferring intent in eye-based interfaces: tracing eye movements with process models, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.254-261, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303055]
• 11: Stampe, D.M., & Reingold, E. M. (1995). Selection by looking: A novel computer interface and its application to psychological research. In J. M. Findlay, R. Walker, & R. W. Kentridge (Eds.), Eye Movement Research: Mechanisms, Processes, and Applications (pp. 467-478). New York: Elsevier Science Publishing.
• 12: Holly A. Yanco, Wheelesley: A Robotic Wheelchair System: Indoor Navigation and User Interface, Assistive Technology and Artificial Intelligence, Applications in Robotics, User Interfaces and Natural Language Processing, p.256-268, January 1998
• 13: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Cognitive simulation

General Terms:
Design, Human Factors, Management, Measurement, Performance, Theory

Keywords:
eye movements, gaze-added interfaces, gaze-based interfaces, intelligent interfaces, user models