One-handed behind-the-display cursor input on mobile devices

ABSTRACT

Behind-the-display interaction has gained popularity for interactions on handheld devices as researchers have demonstrated the viability of such interactions on small devices. However, most designs have investigated the use of direct input behind the screen. We demonstrate that behind-the-display interaction with cursor input is promising and can be a useful augmentation to handheld devices. We developed a prototypical system on a PDA to which we affixed a wireless mouse. The mouse is mounted on the rear of the PDA with the optical sensor facing outwards. The system is designed to be used with one hand, and prevents occlusion and finger-reach. Through several applications we propose the benefits associated with behind-the-display cursor interaction. A preliminary user evaluation indicates that users can benefit from such an interaction when operating a handheld using one hand.

REFERENCES

• 1: Pär-Anders Albinsson , Shumin Zhai, High precision touch screen interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642631]
• 2: Patrick Baudisch , Mike Sinclair , Andrew Wilson, Soap: a pointing device that works in mid-air, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166261]
• 3: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 4: Alan Esenther , Kathy Ryall, Fluid DTMouse: better mouse support for touch-based interactions, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133289]
• 5: Daniel Fällmana , Andreas Lund , Mikael Wiberg, ScrollPad: Tangible Scrolling with Mobile Devices, Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 9, p.90286.3, January 05-08, 2004
• 6: A. Karlson and B. Bederson (2007). Thumbspace: Generalized one-handed input for touchscreen-based mobile devices. In Proc. Interact'07, pages 201--210.
• 7: Amy K. Karlson , Benjamin B. Bederson , John SanGiovanni, AppLens and launchTile: two designs for one-handed thumb use on small devices, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055001]
• 8: A. Karlson, B. Bederson, and J. Contreras-Vidal (2006). Understanding single-handed mobile device interaction. In Tech Report HCIL.
• 9: A. Olwal and S. Feiner. Rubbing the fisheye: precise touch-screen interaction with gestures and fisheye views. In Conf. Supp. UIST'03, pages 105--112.
• 10: Masanori Sugimoto , Keiichi Hiroki, HybridTouch: an intuitive manipulation technique for PDAs using their front and rear surfaces, Proceedings of the 8th conference on Human-computer interaction with mobile devices and services, September 12-15, 2006, Helsinki, Finland [doi>10.1145/1152215.1152243]
• 11: Daniel Vogel , Patrick Baudisch, Shift: a technique for operating pen-based interfaces using touch, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240727]
• 12: Daniel Wigdor , Clifton Forlines , Patrick Baudisch , John Barnwell , Chia Shen, Lucid touch: a see-through mobile device, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294259]
• 13: Jacob O. Wobbrock , Brad A. Myers , Htet Htet Aung, The performance of hand postures in front- and back-of-device interaction for mobile computing, International Journal of Human-Computer Studies, v.66 n.12, p.857-875, December, 2008 [doi>10.1016/j.ijhcs.2008.03.004]
• 14: Koji Yatani , Kurt Partridge , Marshall Bern , Mark W. Newman, Escape: a target selection technique using visually-cued gestures, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357104]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Human Factors

Keywords:
behind-the-display interaction, relative positioning.