Designing user interfaces for multi-touch and gesture devices

ABSTRACT

Initially Designers only had a keyboard and lines of text to design. Then, the mouse enabled a richer design ecosystem with two dimensional plains of UI. Now the Design and Research communities have access to multi-touch and gestural interfaces which have been released on a mass market scale. This allows them to design and develop new, unique, and richer design patterns and approaches. These methods are no longer confined to research projects or innovation labs, but are now offered on a large scale to millions of consumers. With these new interface behaviors, in combination with multiple types of hardware devices that can affect the interface, there are new problems and patterns that have increased the complexity of designing interfaces.

The aim of this SIG is to provide a forum for Designers, Researchers, and Usability Professionals to discuss this new and emerging technology trends for multi-touch and gesture interfaces, as well as discuss current design patterns within these interfaces. Our goal is to cross pollinate ideas and current solutions from practitioners and researchers across communities to help drive awareness of this new field for those interested in, just starting in, or currently involved in the design of these systems.

REFERENCES

• 1: Pär-Anders Albinsson , Shumin Zhai, High precision touch screen interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642631]
• 2: Hrvoje Benko , Andrew D. Wilson , Patrick Baudisch, Precise selection techniques for multi-touch screens, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124963]
• 3: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
• 4: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 5: Alan Esenther , Kathy Ryall, Fluid DTMouse: better mouse support for touch-based interactions, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133289]
• 6: Clifton Forlines , Chia Shen, DTLens: multi-user tabletop spatial data exploration, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095055]
• 7: Clifton Forlines , Daniel Vogel , Ravin Balakrishnan, HybridPointing: fluid switching between absolute and relative pointing with a direct input device, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166286]
• 8: Tovi Grossman , Daniel Wigdor , Ravin Balakrishnan, Multi-finger gestural interaction with 3d volumetric displays, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029644]
• 9: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 10: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 11: Andrew Sears , Ben Shneiderman, High precision touchscreens: design strategies and comparisons with a mouse, International Journal of Man-Machine Studies, v.34 n.4, p.593-613, April 1991 [doi>10.1016/0020-7373(91)90037-8]
• 12: Tang, A., Neustaedter, C., Greenberg, S. (2004). VideoArms: Supporting Remote Embodiment in Groupware. Video Proceedings of CSCW '04.
• 13: John C. Tang , Scott L. Minneman, VideoDraw: a video interface for collaborative drawing, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.313-320, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97302]
• 14: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 15: Daniel Vogel , Ravin Balakrishnan, Distant freehand pointing and clicking on very large, high resolution displays, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095041]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Human Factors

Keywords:
NUI, direct manipulation, gesture, multi-touch, natural user interface, tabletop, touch, touch screen