Button selection for general GUIs using eye and hand together

ABSTRACT

This paper proposes an efficient technique for eye gaze interface suitable for the general GUI environments such as Microsoft Windows. Our technique uses an eye and a hand together: the eye for moving cursors onto the GUI button (move operation), and the hand for pushing the GUI button (push operation). We also propose the following two techniques to assist the move operation: (1) Automatic adjustment and (2) Manual adjustment. In the automatic adjustment, the cursor automatically moves to the closest GUI button when we push a mouse button. In the manual adjustment, we can move the cursor roughly by an eye, then move it a little more by the mouse onto the GUI button. In the experiment to evaluate our method, GUI button selection by manual adjustment showed better performance than the selection by a mouse even in the situation that has many small GUI buttons placed very closely each other on the GUI.

REFERENCES

• 1: Howarth, P. Keeping an eye on your interface: The potential for eye-based control of graphical user interfaces (G.U.I's), Proc. HCI'94 (1994).
• 2: Robert J. K. Jacob, What you look at is what you get: eye movement-based interaction techniques, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.11-18, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97246]
• 3: Kuno, Y., Yagi, T., Fuji, H., Koga, K. and Uchikawa, Y. Development of eye-gaze input interface using EOG, Transactions of Information Processing Society of Japan, vol. 39, no. 5 (1998), 1455-1462. (in Japanese)
• 4: Ohno, T. Quick menu selection yask with eye mark, Transactions of Information Processing Society of Japan, vol. 40, no. 2 (1999), 602-612. (in Japanese)
• 5: Dario D. Salvucci, Inferring intent in eye-based interfaces: tracing eye movements with process models, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.254-261, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303055]
• 6: Roel Vertegaal, The GAZE groupware system: mediating joint attention in multiparty communication and collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.294-301, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303065]
• 7: Yamato, M., Monden, A., Takada, Y., Matsumoto, K. and Torii, K. Scrolling the text windows by looking, Transactions of Information Processing Society of Japan, vol. 40, no. 2 (1999), 613-622. (in Japanese)
• 8: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

General Terms:
Design, Experimentation, Human Factors, Management, Measurement, Performance, Theory

Keywords:
GUI button selection, eye gaze interface, eye tracking device, user interface