Interacting with dynamically defined information spaces using a handheld projector and a pen

ABSTRACT

The recent trend towards miniaturization of projection technology indicates that handheld devices will soon have the ability to project information onto any surface, thus enabling interfaces that are not possible with current handhelds. We explore the design space of dynamically defining and interacting with multiple virtual information spaces embedded in a physical environment using a handheld projector and a passive pen tracked in 3D. We develop techniques for defining and interacting with these spaces, and explore usage scenarios.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, More than dotting the i's --- foundations for crossing-based interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503390]
• 2: Georg Apitz , François Guimbretière, CrossY: a crossing-based drawing application, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029635]
• 3: Woodrow Barfield , Thomas Caudell, Fundamentals of Wearable Computers and Augumented Reality, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2000
• 4: Paul Beardsley , Jeroen Van Baar , Ramesh Raskar , Clifton Forlines, Interaction Using a Handheld Projector, IEEE Computer Graphics and Applications, v.25 n.1, p.39-43, January 2005 [doi>10.1109/MCG.2005.12]
• 5: Blaine Bell , Steven Feiner , Tobias Höllerer, View management for virtual and augmented reality, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502363]
• 6: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 7: Gabor Blasko , Steven Feiner , Franz Coriand, Exploring Interaction with a Simulated Wrist-Worn Projection Display, Proceedings of the Ninth IEEE International Symposium on Wearable Computers, p.2-9, October 18-21, 2005 [doi>10.1109/ISWC.2005.21]
• 8: Harry Brignull , Shahram Izadi , Geraldine Fitzpatrick , Yvonne Rogers , Tom Rodden, The introduction of a shared interactive surface into a communal space, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031616]
• 9: Buxton, W., Living in augmented reality: Ubiquitous Media and Reactive Environments, in Video Mediated Communication, K. Finn, Sellen, A., Wilber, S., Editor. 1997, Erlbaum: Hillsdale, NJ. p. 363--384.
• 10: W. Buxton , B. Myers, A study in two-handed input, Proceedings of the SIGCHI conference on Human factors in computing systems, p.321-326, April 13-17, 1986, Boston, Massachusetts, United States
• 11: George Fitzmaurice , Azam Khan , Robert Pieké , Bill Buxton , Gordon Kurtenbach, Tracking menus, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.71-79, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964704]
• 12: Clifton Forlines , Ravin Balakrishnan , Paul Beardsley , Jeroen van Baar , Ramesh Raskar, Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095046]
• 13: Saul Greenberg , Michael Rounding, The notification collage: posting information to public and personal displays, Proceedings of the SIGCHI conference on Human factors in computing systems, p.514-521, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365339]
• 14: Hilliges, O. and Terrenghi, L. (2006). Overcoming mode-changes on multi-user large displays with bi-manual interaction. MU3I Workshop on Multi-User and Ubiquitous User Interfaces.
• 15: Stephen S. Intille, Change Blind Information Display for Ubiquitous Computing Environments, Proceedings of the 4th international conference on Ubiquitous Computing, p.91-106, September 29-October 01, 2002, Göteborg, Sweden
• 16: Nobuyuki Matsushita , Yuji Ayatsuka , Jun Rekimoto, Dual touch: a two-handed interface for pen-based PDAs, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.211-212, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354774]
• 17: Meredith Ringel Morris , Kathy Ryall , Chia Shen , Clifton Forlines , Frederic Vernier, Beyond "social protocols": multi-user coordination policies for co-located groupware, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031648]
• 18: Patel, S., Rekimoto, J., and Abowd, G. (2006 - in press). iCam: Precise at-a-distance interaction in the physical environment. Pervasive.
• 19: Gopal Pingali , Claudio Pinhanez , Anthony Levas , Rick Kjeldsen , Mark Podlaseck , Han Chen , Noi Sukaviriya, Steerable Interfaces for Pervasive Computing Spaces, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, p.315, March 23-26, 2003
• 20: Claudio S. Pinhanez, The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces, Proceedings of the 3rd international conference on Ubiquitous Computing, p.315-331, September 30-October 02, 2001, Atlanta, Georgia, USA
• 21: Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z., and Emele, M. (2004). Spotlight navigation: Interaction with a handheld projection device. International Conference on Pervasive Computing, Video paper.
• 22: Ramesh Raskar , Paul Beardsley , Jeroen van Baar , Yao Wang , Paul Dietz , Johnny Lee , Darren Leigh , Thomas Willwacher, RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 23: Andreas Simon, First-person experience and usability of co-located interaction in a projection-based virtual environment, Proceedings of the ACM symposium on Virtual reality software and technology, November 07-09, 2005, Monterey, CA, USA [doi>10.1145/1101616.1101622]
• 24: Sugimoto, M., Miyahara, K., Inoue, H., and Tsunesada, Y. (2005). Hotaru: Intuitive Manipulation Techniques for Projected Displays of Mobile Devices. INTERACT 2005. p. 57--68.
• 25: Summet, J. and Suthankar, R. (2005). Tracking locations of moving hand-held displays using projected light. Pervasive. p. 37--46.
• 26: Michael Tsang , George W. Fitzmaurice , Gordon Kurtenbach , Azam Khan , Bill Buxton, Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572001]
• 27: Ka-Ping Yee, Peephole displays: pen interaction on spatially aware handheld computers, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642613]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Design, Human Factors

Keywords:
handheld projector, information spaces, pen input