Combining head tracking and mouse input for a GUI on multiple monitors

ABSTRACT

The use of multiple LCD monitors is becoming popular as prices are reduced, but this creates problems for window management and switching between applications. For a single monitor, eye tracking can be combined with the mouse to reduce the amount of mouse movement, but with several monitors the head is moved through a large range of positions and angles which makes eye tracking difficult. We thus use head tracking to switch the mouse pointer between monitors and use the mouse to move within each monitor. In our experiment users required significantly less mouse movement with the tracking system, and preferred using it, although task time actually increased. A graphical prompt (flashing star) prevented the user losing the pointer when switching monitors. We present discussions on our results and ideas for further developments.

REFERENCES

• 1: M. Czerwinski, G. Smith, T. Regan, B. Meyers, G. Robertson, and G. Starkweather. Toward Characterizing the Productivity Benefits of Very Large Displays. In Proc. Interact 2003, pages 9--16, 2003.
• 2: H. Goosssens and A. V. Opstal. Human Eye-Head Coordination in Two Dimensions Under Different Sensorimotor Conditions. Exp. Brain Research, 114:542--560, 1997.
• 3: Jonathan Grudin, Partitioning digital worlds: focal and peripheral awareness in multiple monitor use, Proceedings of the SIGCHI conference on Human factors in computing systems, p.458-465, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365312]
• 4: R. J. Jacob. Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, chapter Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces, pages 151--190. Ablex Publishing Co., 1993.
• 5: Kotaro Kitajima , Yoichi Sato , Hideki Koike, Vision-based face tracking system for window interface: prototype application and empirical studies, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634279]
• 6: K. Oka, Y. Sato, Y. Nakanishi, and H. Koike. Head Pose Estimation System Based on Particle Filtering with Adaptive Diffusion Control. In Proc. MVA 2005, 2005.
• 7: Dario D. Salvucci , Joseph H. Goldberg, Identifying fixations and saccades in eye-tracking protocols, Proceedings of the 2000 symposium on Eye tracking research & applications, p.71-78, November 06-08, 2000, Palm Beach Gardens, Florida, United States [doi>10.1145/355017.355028]
• 8: Luca Vacchetti , Vincent Lepetit , Pascal Fua, Stable Real-Time 3D Tracking Using Online and Offline Information, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.10, p.1385-1391, October 2004 [doi>10.1109/TPAMI.2004.92]
• 9: Roel Vertegaal , Ivo Weevers , Changuk Sohn , Chris Cheung, GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642702]
• 10: Shumin Zhai , Carlos Morimoto , Steven Ihde, Manual and gaze input cascaded (MAGIC) pointing, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.246-253, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303053]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Keywords:
attentive user interface, gaze-contingent display, head tracking, multiple monitors