Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

ABSTRACT

Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points of input from several users simultaneously. However, apart from a few demonstration techniques [17], current user interfaces do not take advantage of this increased input bandwidth. We present a variety of multifinger and whole hand gestural interaction techniques for these displays that leverage and extend the types of actions that people perform when interacting on real physical tabletops. Apart from gestural input techniques, we also explore interaction and visualization techniques for supporting shared spaces, awareness, and privacy. These techniques are demonstrated within a prototype room furniture layout application, called RoomPlanner.

REFERENCES

• 1: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 2: William A. S. Buxton, Chunking and phrasing and the design of human-computer dialogues, Human-computer interaction: toward the year 2000, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1995
• 3: 3. Buxton, W., Living in augmented reality: Ubiquitous Media and Reactive Environments, in Video Mediated Communication, K. Finn, Sellen, A., Wilber, S., Editor. 1997, Erlbaum: Hillsdale, NJ. p. 363-384.
• 4: 4. Callahan, J., Hopkins, D., Weiser, M., & Shneiderman, B. (1988). A comparative analysis of pie menu performance. ACM CHI Conference.
• 5: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 6: 6. Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4). p. 486-517.
• 7: 7. Krueger, M., VIDEOPLACE and the interface of the future, in The art of human computer interface design, B. Laurel, Editor. 1991, Addison Wesley: Menlo Park, CA. p. 417-422.
• 8: Gordon Kurtenbach , William Buxton, The limits of expert performance using hierarchic marking menus, Proceedings of the SIGCHI conference on Human factors in computing systems, p.482-487, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169426]
• 9: Gordon Kurtenbach , George Fitzmaurice , Thomas Baudel , Bill Buxton, The design of a GUI paradigm based on tablets, two-hands, and transparency, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-42, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258574]
• 10: Nobuyuki Matsushita , Yuji Ayatsuka , Jun Rekimoto, Dual touch: a two-handed interface for pen-based PDAs, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.211-212, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354774]
• 11: 11. Myers, B. (1990). All the widgets. ACM SIGRAPH Video Review, CHI'90 Special Issue, 57.
• 12: 12. Olsen, G., & Olsen, J. (2000). Distance matters. Human-Computer Interaction, 15(2&3). p. 139-178.
• 13: Jeffrey S. Pierce , Brian C. Stearns , Randy Pausch, Voodoo dolls: seamless interaction at multiple scales in virtual environments, Proceedings of the 1999 symposium on Interactive 3D graphics, p.141-145, April 26-29, 1999, Atlanta, Georgia, United States [doi>10.1145/300523.300540]
• 14: Stuart Pook , Eric Lecolinet , Guy Vaysseix , Emmanuel Barillot, Control menus: excecution and control in a single interactor, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633446]
• 15: Matthias Rauterberg , Morten Fjeld , Helmut Krueger , Martin Bichsel , Uwe Leonhardt , Markus Meier, BUILD-IT: a planning tool for construction and design, CHI 98 conference summary on Human factors in computing systems, p.177-178, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286657]
• 16: Jun Rekimoto, Multiple-computer user interfaces: "beyond the desktop" direct manipulation environments, CHI '00 extended abstracts on Human factors in computing systems, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/633292.633297]
• 17: Jun Rekimoto, SmartSkin: an infrastructure for freehand manipulation on interactive surfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503397]
• 18: Chia Shen , Neal B. Lesh , Frederic Vernier , Clifton Forlines , Jeana Frost, Sharing and building digital group histories, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587124]
• 19: Jason Stewart , Benjamin B. Bederson , Allison Druin, Single display groupware: a model for co-present collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.286-293, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303064]
• 20: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 21: Peter Tandler , Thorsten Prante , Christian Müller-Tomfelde , Norbert Streitz , Ralf Steinmetz, Connectables: dynamic coupling of displays for the flexible creation of shared workspaces, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502351]
• 22: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 23: 23. Vernier, F., Lesh, N., & Shen, C. (2002). Visualization techniques for circular tabletop interfaces. Advanced Visual Interfaces.
• 24: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Experimentation

Keywords:
collaborative and competitive applications, gestures, multi degree-of-freedom input, tabletop interaction