Mid-air text input techniques for very large wall displays

ABSTRACT

Traditional text input modalities, namely keyboards, are often not appropriate for use when standing in front of very large wall displays. Direct interaction techniques, such as handwriting, are better, but are not well suited to situations where users are not in close physical proximity to the display. We discuss the potential of mid-air interaction techniques for text input on very large wall displays, and introduce two factors, distance-dependence and visibility-dependence, which are useful for segmenting the design space of mid-air techniques. We then describe three techniques that were designed with the goal of exploring the design space, and present a comparative evaluation of those techniques. Questions raised by the evaluation were investigated further in a second evaluation focusing on distance-dependence. The two factors of distance- and visibility-dependence can guide the design of future text input techniques, and our results suggest that distance-independent techniques may be best for use with very large wall displays.

REFERENCES

• 1: Robert W. Bailey, Human performance engineering (3rd ed.): designing high quality professional user interfaces for computer products, applications and systems, Prentice-Hall, Inc., Upper Saddle River, NJ, 1996
• 2: Patrick Baudisch , Mike Sinclair , Andrew Wilson, Soap: a pointing device that works in mid-air, Proceedings of the 19th annual ACM symposium on User interface software and technology, October 15-18, 2006, Montreux, Switzerland [doi>10.1145/1166253.1166261]
• 3: B. Buxton. Surface and tangible computing, and the "small" matter of people and design. In IEEE International Solid-State Circuits Conference Digest of Technical Papers (2008), pages 24--29.
• 4: Mauro Cherubini , Gina Venolia , Rob DeLine , Andrew J. Ko, Let's go to the whiteboard: how and why software developers use drawings, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240714]
• 5: M. Czerwinski, G. Smith, T. Regan, B. Meyers, G. Robertson and G. Starkweather. Toward characterizing the productivity benefits of very large displays. In Proceedings of Interact '03, pages 9--16.
• 6: James D. Foley , Victor L. Wallace , Peggy Chan, The human factors of computer graphics interaction techniques, IEEE Computer Graphics and Applications, v.4 n.11, p.13-48, Nov. 1984
• 7: Thomas Költringer , Poika Isokoski , Thomas Grechenig, TwoStick: writing with a game controller, Proceedings of Graphics Interface 2007, May 28-30, 2007, Montreal, Canada [doi>10.1145/1268517.1268536]
• 8: S. Lee, S. H. Hong and J. W. Jeon. Designing a universal keyboard using chording gloves. In Proceedings of CUU '03, pages 142--147.
• 9: Yang Liu , Xiabi Liu , Yunde Jia, Hand-Gesture Based Text Input for Wearable Computers, Proceedings of the Fourth IEEE International Conference on Computer Vision Systems, p.8, January 04-07, 2006 [doi>10.1109/ICVS.2006.34]
• 10: I. Scott MacKenzie , Hedy Kober , Derek Smith , Terry Jones , Eugene Skepner, LetterWise: prefix-based disambiguation for mobile text input, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502365]
• 11: I. Scott MacKenzie , R. William Soukoreff, Phrase sets for evaluating text entry techniques, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765971]
• 12: I. S. MacKenzie and K. Tanaka-Ishii. Text Entry Systems. Morgan Kaufmann, 2007.
• 13: I. Scott MacKenzie , Shawn X. Zhang, The design and evaluation of a high-performance soft keyboard, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.25-31, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.302983]
• 14: Carsten Magerkurth , Richard Stenzel, A Pervasive Keyboard " Separating Input from Display, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, p.388, March 23-26, 2003
• 15: Benoît Martin, VirHKey: a VIRtual Hyperbolic KEYboard with gesture interaction and visual feedback for mobile devices, Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, September 19-22, 2005, Salzburg, Austria [doi>10.1145/1085777.1085794]
• 16: Elizabeth D. Mynatt , Takeo Igarashi , W. Keith Edwards , Anthony LaMarca, Flatland: new dimensions in office whiteboards, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.346-353, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303108]
• 17: A. Pavlovych and W. Stuerzlinger. An analysis of novice text entry performance on large interactive wall surfaces. In Human-Computer International, 2005.
• 18: Elin Rønby Pedersen , Kim McCall , Thomas P. Moran , Frank G. Halasz, Tivoli: an electronic whiteboard for informal workgroup meetings, Proceedings of the INTERCHI '93 conference on Human factors in computing systems, p.391-398, May 1993, Amsterdam, The Netherlands
• 19: Morten Proschowsky , Nette Schultz , Niels Ebbe Jacobsen, An intuitive text input method for touch wheels, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124842]
• 20: Garth Shoemaker , Anthony Tang , Kellogg S. Booth, Shadow reaching: a new perspective on interaction for large displays, Proceedings of the 20th annual ACM symposium on User interface software and technology, October 07-10, 2007, Newport, Rhode Island, USA [doi>10.1145/1294211.1294221]
• 21: Anthony Tang , Mattias Finke , Michael Blackstock , Rock Leung , Meghan Deutscher , Rodger Lea, Designing for bystanders: reflections on building a public digital forum, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357193]
• 22: Dan Venolia , Forrest Neiberg, T-Cube: a fast, self-disclosing pen-based alphabet, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.265-270, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191761]
• 23: Daniel Vogel , Ravin Balakrishnan, Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029656]
• 24: Daniel Vogel , Ravin Balakrishnan, Distant freehand pointing and clicking on very large, high resolution displays, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095041]
• 25: Neff Walker , John B. Smelcer, A comparison of selection time from walking and pull-down menus, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.221-226, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97277]
• 26: David J. Ward , Alan F. Blackwell , David J. C. MacKay, Dasher—a data entry interface using continuous gestures and language models, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.129-137, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354427]
• 27: Daniel Wigdor , Ravin Balakrishnan, TiltText: using tilt for text input to mobile phones, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.81-90, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964705]
• 28: Jacob O. Wobbrock , Brad A. Myers , John A. Kembel, EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.61-70, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964703]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
interaction techniques, text input, wall displays