Ubiquitous graphics: combining hand-held and wall-size displays to interact with large images

ABSTRACT

Ubiquitous Graphics addresses the problem of interacting with very large computer graphics images, for instance an online map or a large digitized painting. It uses a combination of mobile and stationary displays to show both overview and detail. The main image is displayed using a projector or other large traditional display. To access details, the user holds a mobile device in front of the stationary display. Using ultrasonic tracking the smaller display is aligned with the overview, giving access to a corresponding portion of the image in higher resolution. Alternatively the system provides "magic lens" functionality that can show additional information. Users may add free-form annotations and pre-defined graphical objects by interacting directly with the mobile device. In a user study, subjects drew better descriptive maps using the system than an ordinary map application. The system is robust and was demonstrated to several thousand people in a week-long public exhibit.

REFERENCES

• 1: Patrick Baudisch , Nathaniel Good , Victoria Bellotti , Pamela Schraedley, Keeping things in context: a comparative evaluation of focus plus context screens, overviews, and zooming, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503423]
• 2: Patrick Baudisch , Nathaniel Good , Paul Stewart, Focus plus context screens: combining display technology with visualization techniques, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502354]
• 3: Paul Beardsley , Jeroen Van Baar , Ramesh Raskar , Clifton Forlines, Interaction Using a Handheld Projector, IEEE Computer Graphics and Applications, v.25 n.1, p.39-43, January 2005 [doi>10.1109/MCG.2005.12]
• 4: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 5: Fallman, D., Lund, A. and Wiberg, M. Inside-Out Interaction: An Interaction Technique for Dealing with Large Interface Surfaces such as Web Pages on Small Screen Displays. In SIGGRAPH Applications and Sketches Program 2004, Los Angeles, USA.
• 6: George W. Fitzmaurice, Situated information spaces and spatially aware palmtop computers, Communications of the ACM, v.36 n.7, p.39-49, July 1993 [doi>10.1145/159544.159566]
• 7: Lars Erik Holmquist , Johan Sanneblad , Lalya Gaye, Total recall: in-place viewing of captured whiteboard annotations, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.766105]
• 8: Edward Lank , Son Phan, Focus+Context sketching on a pocket PC, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986042]
• 9: Wendy E. Mackay , Guillaume Pothier , Catherine Letondal , Kaare Bøegh , Hans Erik Sørensen, The missing link: augmenting biology laboratory notebooks, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.571992]
• 10: Mimio XI. http://www.mimio.com
• 11: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 12: Johan Sanneblad , Lars Erik Holmquist, The GapiDraw platform: high-performance cross-platform graphics on mobile devices, Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, p.47-53, October 27-29, 2004, College Park, Maryland [doi>10.1145/1052380.1052388]
• 13: Sanneblad, J. and Holmquist, L. E. OpenTrek: A Platform for Developing Interactive Networked Games on Mobile Devices. In Proceedings of Mobile HCI 2003, Udine, Italy.
• 14: Michael Tsang , George W. Fitzmaurice , Gordon Kurtenbach , Azam Khan , Bill Buxton, Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572001]
• 15: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 16: Ka-Ping Yee, Peephole displays: pen interaction on spatially aware handheld computers, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642613]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Human Factors

Keywords:
magic lenses, mobile computing, peephole displays, position aware displays, ubiquitous computing