Augmented surfaces: a spatially continuous work space for hybrid computing environments

ABSTRACT

This paper describes our design and implementation of a computer augmented environment that allows users to smoothly interchange digital information among their portable computers, table and wall displays, and other physical objects. Supported by a camera-based object recognition system, users can easily integrate their portable computers with the pre-installed ones in the environment. Users can use displays projected on tables and walls as a spatially continuous extension of their portable computers. Using an interaction technique called hyperdragging, users can transfer information from one computer to another, by only knowing the physical relationship between them. We also provide a mechanism for attaching digital data to physical objects, such as a videotape or a document folder, to link physical and digital spaces.

REFERENCES

• 1: Steven Feiner , Ari Shamash, Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.9-17, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120783]
• 2: Jörg Geißler, Shuffle, throw or take it! working efficiently with an interactive wall, CHI 98 conference summary on Human factors in computing systems, p.265-266, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286745]
• 3: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 4: Myron W. Krueger. Artificial Reality H. Addison- Wesley, 1990.
• 5: Beth M. Lange , Mark A. Jones , James L. Meyers, Insight lab: an immersive team environment linking paper, displays, and data, Proceedings of the SIGCHI conference on Human factors in computing systems, p.550-557, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274718]
• 6: W. E. Mackay , D. S. Pagani , L. Faber , B. Inwood , P. Launiainen , L. Brenta , V. Pouzol, Ariel: augmenting paper engineering drawings, Conference companion on Human factors in computing systems, p.421-422, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223763]
• 7: Norbert A. Streitz , Jörg Geißler , Torsten Holmer, Roomware for Cooperative Buildings: Integrated Design of Architectural Spaces and Information Spaces, Proceedings of the First International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture, p.4-21, February 01, 1998
• 8: Ramesh Raskar , Greg Welch , Matt Cutts , Adam Lake , Lev Stesin , Henry Fuchs, The office of the future: a unified approach to image-based modeling and spatially immersive displays, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.179-188, July 1998 [doi>10.1145/280814.280861]
• 9: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 10: J. Rekimoto, Matrix: A Realtime Object Identification and Registration Method for Augmented Reality, Proceedings of the Third Asian Pacific Computer and Human Interaction, p.63, July 15-17, 1998
• 11: Jun Rekimoto, A multiple device approach for supporting whiteboard-based interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.344-351, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274692]
• 12: Scott Robertson , Cathleen Wharton , Catherine Ashworth , Marita Franzke, Dual device user interface design: PDAs and interactive television, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.79-86, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238408]
• 13: Peter Robinson, Dan Sheppard, Richard Watts, Robert Harding, and Steve Lay. Animated Paper Documents. In 7th International Conference on Human-Computer Interaction, HCI'97, 1997.
• 14: Eric Saund. ZombieBoard project description. http ://www.parc.xerox.com/spl/members/saund/ zombieboard-public.html.
• 15: Itiro Silo. lnfoBinder: a pointing device for a virtual desktop system. In 6th International Conference on Human-Computer Interaction (HCI International '95), pp. 261-264, July 1995.
• 16: Quentin Stafford-Fraser , Peter Robinson, BrightBoard: a video-augmented environment, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.134-141, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238457]
• 17: Mark Stefik , Gregg Foster , Daniel G. Bobrow , Kenneth Kahn , Stan Lanning , Lucy Suchman, Beyond the chalkboard: computer support for collaboration and problem solving in meetings, Communications of the ACM, v.30 n.1, p.32-47, Jan. 1987 [doi>10.1145/7885.7887]
• 18: Brygg Ullmer , Hiroshi Ishii , Dylan Glas, mediaBlocks: physical containers, transports, and controls for online media, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.379-386, July 1998 [doi>10.1145/280814.280940]
• 19: John Underkoffler. A view from the Luminous Room. Personal Technologies, Vol. 1, No. 2;, June 1997.
• 20: John Underkoffler , Hiroshi Ishii, Illuminating light: an optical design tool with a luminous-tangible interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.542-549, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274717]
• 21: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]
• 22: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING

General Terms:
Design, Theory

Keywords:
architectural media, augmented reality, multiple device user interfaces, physical space, portable computers, table-sized displays, ubiquitous computing, wall-sized displays