SideSight: multi-"touch" interaction around small devices

ABSTRACT

Interacting with mobile devices using touch can lead to fingers occluding valuable screen real estate. For the smallest devices, the idea of using a touch-enabled display is almost wholly impractical. In this paper we investigate sensing user touch around small screens like these. We describe a prototype device with infra-red (IR) proximity sensors embedded along each side and capable of detecting the presence and position of fingers in the adjacent regions. When this device is rested on a flat surface, such as a table or desk, the user can carry out single and multi-touch gestures using the space around the device. This gives a larger input space than would otherwise be possible which may be used in conjunction with or instead of on-display touch input. Following a detailed description of our prototype, we discuss some of the interactions it affords.

REFERENCES

• 1: Arnaut, L. Y. & Greenstein, J. S. Human Factors Considerations in the Design and Selection of Computer Input Devices. In Sol Sherr (Ed.), Input Devices. Boston: Academic Press, 73--74. 1988.
• 2: Ken Hinckley , Jeff Pierce , Mike Sinclair , Eric Horvitz, Sensing techniques for mobile interaction, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.91-100, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354417]
• 3: Steve Hodges , Shahram Izadi , Alex Butler , Alban Rrustemi , Bill Buxton, ThinSight: versatile multi-touch sensing for thin form-factor displays, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294258]
• 4: Hollemans, G. et al., Entertaible: Multi-user multi-object concurrent input, UIST '06 Adjunct Proceedings.
• 5: LightGlove, http://www.lightglove.com/White%20Paper.htm
• 6: RPO, http://www.rpo.biz/DWT_White_Paper.pdf
• 7: Joshua Smith , Tom White , Christopher Dodge , Joseph Paradiso , Neil Gershenfeld , David Allport, Electric Field Sensing For Graphical Interfaces, IEEE Computer Graphics and Applications, v.18 n.3, p.54-60, May 1998 [doi>10.1109/38.674972]
• 8: Virtual Keyboard, http://www.vkb-support.com/index.php
• 9: Daniel Vogel , Patrick Baudisch, Shift: a technique for operating pen-based interfaces using touch, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240727]
• 10: Daniel Wigdor , Clifton Forlines , Patrick Baudisch , John Barnwell , Chia Shen, Lucid touch: a see-through mobile device, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294259]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Algorithms, Design, Human Factors

Keywords:
mobile device interaction, multi-touch, novel hardware, proximity sensing