Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

When combined with the organizational space provided by a simple table, physical notecards are a powerful organizational tool for information analysis. The physical presence of these cards affords many benefits but also is a source of disadvantages. For example, complex relationships among them are hard to represent. There have been a number of notecard software systems developed to address these problems. Unfortunately, the amount of visual details in such systems is lacking compared to real notecards on a large physical table; we look to alleviate this problem by providing a digital solution. One challenge with new display technology and systems is providing an efficient interface for its users. In this paper we look at comparing different interaction techniques of an emerging class of organizational systems that use high-resolution tabletop displays. The focus of these systems is to more easily and efficiently assist interaction with information. Using PDA, token, gesture, and voice interaction techniques, we conducted a within subjects experiment comparing these techniques over a large high-resolution horizontal display. We found strengths and weaknesses for each technique. In addition, we noticed that some techniques build upon and complement others.

REFERENCES

• 1: Mori. http://apokalypsesoftware.com/products/mori, 2007.
• 2: C. Andrews, T. Henry, C. Miller, and F. Quek. Cardtable: An embodied tool for analysis of historical information. 2007.
• 3: Robert Ball , Chris North, Visual Analytics: Realizing embodied interaction for visual analytics through large displays, Computers and Graphics, v.31 n.3, p.380-400, June, 2007 [doi>10.1016/j.cag.2007.01.029]
• 4: Robert Glenn Ball , Chris L. North, Effects of large, high-resolution displays for geospatial information visualization, Virginia Polytechnic Institute & State University, Blacksburg, VA, 2006
• 5: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.262-270, July 1980
• 6: Barbara L. Chalfonte , Robert S. Fish , Robert E. Kraut, Expressive richness: a comparison of speech and text as media for revision, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.21-26, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108848]
• 7: Nguyen Thong Dang , Monica Tavanti , Ivan Rankin , Matthew Cooper, A comparison of different input devices for a 3D environment, Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore!, August 28-31, 2007, London, United Kingdom [doi>10.1145/1362550.1362581]
• 8: Paul Dietz , Darren Leigh, DiamondTouch: a multi-user touch technology, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502389]
• 9: Alan Esenther , Kathy Ryall, Fluid DTMouse: better mouse support for touch-based interactions, Proceedings of the working conference on Advanced visual interfaces, May 23-26, 2006, Venezia, Italy [doi>10.1145/1133265.1133289]
• 10: EverNote. http://www.evernote.com/, 2007.
• 11: Clifton Forlines , Daniel Wigdor , Chia Shen , Ravin Balakrishnan, Direct-touch vs. mouse input for tabletop displays, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240726]
• 12: Michael A. Grasso , David S. Ebert , Timothy W. Finin, The integrality of speech in multimodal interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.5 n.4, p.303-325, Dec. 1998 [doi>10.1145/300520.300521]
• 13: François Guimbretière , Maureen Stone , Terry Winograd, Fluid interaction with high-resolution wall-size displays, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502353]
• 14: Frank G. Halasz , Thomas P. Moran , Randall H. Trigg, Notecards in a nutshell, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.45-52, April 05-09, 1987, Toronto, Ontario, Canada
• 15: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 16: Scott R. Klemmer , Jamey Graham , Gregory J. Wolff , James A. Landay, Books with voices: paper transcripts as a physical interface to oral histories, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642628]
• 17: Carsten Magerkurth , Maral Memisoglu , Timo Engelke , Norbert Streitz, Towards the next generation of tabletop gaming experiences, Proceedings of Graphics Interface 2004, p.73-80, May 17-19, 2004, London, Ontario, Canada
• 18: Catherine C. Marshall , Frank G. Halasz , Russell A. Rogers , William C. Janssen, Jr., Aquanet: a hypertext tool to hold your knowledge in place, Proceedings of the third annual ACM conference on Hypertext, p.261-275, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.123000]
• 19: Shawna Meyer , Oryx Cohen , Erik Nilsen, Device comparisons for goal-directed drawing tasks, Conference companion on Human factors in computing systems, p.251-252, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260468]
• 20: Christine Neuwirth , David Kaufer , Rick Chimera , Terilyn Gillespie, The Notes program: a hypertext application for writing from source texts, Proceedings of the ACM conference on Hypertext, p.121-141, November 1987, Chapel Hill, North Carolina, United States [doi>10.1145/317426.317437]
• 21: Sharon Oviatt, Taming recognition errors with a multimodal interface, Communications of the ACM, v.43 n.9, p.45-51, Sept. 2000 [doi>10.1145/348941.348979]
• 22: James Patten , Hiroshi Ishii , Jim Hines , Gian Pangaro, Sensetable: a wireless object tracking platform for tangible user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.253-260, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365112]
• 23: Anne Marie Piper , Eileen O'Brien , Meredith Ringel Morris , Terry Winograd, SIDES: a cooperative tabletop computer game for social skills development, Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, November 04-08, 2006, Banff, Alberta, Canada [doi>10.1145/1180875.1180877]
• 24: Jun Rekimoto , Brygg Ullmer , Haruo Oba, DataTiles: a modular platform for mixed physical and graphical interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.269-276, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365115]
• 25: Andrew J Sabri , Robert G Ball , Alain Fabian , Saurabh Bhatia , Chris North, High-resolution gaming: Interfaces, notifications, and the user experience, Interacting with Computers, v.19 n.2, p.151-166, March, 2007 [doi>10.1016/j.intcom.2006.08.002]
• 26: Thomas W. Schneider , Osman Balci, VTQuest: a voice-based multimodal web-based software system for maps and directions, Proceedings of the 44th annual Southeast regional conference, March 10-12, 2006, Melbourne, Florida [doi>10.1145/1185448.1185517]
• 27: Stacey D. Scott , M. Sheelagh , T. Carpendale , Kori M. Inkpen, Territoriality in collaborative tabletop workspaces, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031655]
• 28: C. Shen. Ubitable: Impromptu face-to-face collaboration on horizontal interactive surfaces, 2003.
• 29: Chia Shen , Frédéric D. Vernier , Clifton Forlines , Meredith Ringel, DiamondSpin: an extensible toolkit for around-the-table interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.167-174, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985714]
• 30: J. P. Springer, C. Sladeczek, M. Scheffer, J. Hochstrate, B. Frohlich, and F. Melchior. A survey of large high-resolution display technologies, techniques, and applications. In VR '06, p. 31, 2006.
• 31: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 32: SuperNoteCard. http://www.mindola.com/snc/index.html, 2007.
• 33: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 34: Brygg Ullmer , Hiroshi Ishii , Robert J. K. Jacob, Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.81-118, March 2005 [doi>10.1145/1057237.1057242]
• 35: Mike Wu , Ravin Balakrishnan, Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.193-202, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964718]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Experimentation, Human Factors, Performance

Keywords:
embodied interaction, gesture interaction, high-resolution displays, horizontal display, human-computer interaction, multimodal interfaces, pda interaction, tabletop interaction, tangible interaction, voice interaction