A desk supporting computer-based interaction with paper documents

ABSTRACT

Before the advent of the personal workstation, office work practice revolved around the paper document. Today the electronic medium offers a number of advantages over paper, but it has not eradicated paper from the office. A growing problem for those who work primarily with paper is lack of direct access to the wide variety of interactive functions available on personal workstations. This paper describes a desk with a computer-controlled projector and camera above it. The result is a system that enables people to interact with ordinary paper documents in ways normally possible only with electronic documents on workstation screens. After discussing the motivation for this work, this paper describes the system and two sample applications that can benefit from this style of interaction: a desk calculator and a French to English translation system. We describe the design and implementation of the system, report on some user tests, and conclude with some general reflections on interacting with computers in this way.

REFERENCES

• Bloo90: Bloomberg, D., and Maragos, P. "Image Algebra and Morphological Image Processing." SPIE Conference Proc., San Diego, CA, July 1990.
• Gold91: David Goldberg , Aaron Goodisman, Stylus user interfaces for manipulating text, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.127-135, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120796]
• Grea92: Greatbatch, D., Heath, C., Luff, P., and Campion, D. "On the use of Paper and Screenbased Documentation in the General Practice Consultation." Rank Xerox EuroPARC Technical Report, Cambridge 1992.
• Hans88: Wilfred J. Hansen , Christina Haas, Reading and writing with computers: a framework for explaining differences in performance, Communications of the ACM, v.31 n.9, p.1080-1089, Sept. 1988 [doi>10.1145/48529.48532]
• Ishi91: Hiroshi Ishii , Naomi Miyake, Toward an open shared workspace: computer and video fusion approach of TeamWorkStation, Communications of the ACM, v.34 n.12, p.37-50, Dec. 1991 [doi>10.1145/125319.125321]
• Know77: Knowlton, K. "Computer Displays Optically Superimposed on Input Devices." Bell System Technical Journal, vol. 56, no. 3, March 1977.
• Krue91: Krueger, M. Artificial Reality ii. Addison- Wesley, 1991.
• Lamm92: Lamming, M. and Newman, W. "Activitybased Information Retrieval: Technology in support of Personal Memory." Rank Xerox EuroPARC Technical Report 91-03. February 1992.
• Mill91: Miller, R. "Behold the Humble Barcode." Multimedia and Videodisk Monitor. Arlington VA, Sept. 1991.
• Newm91: Newman, W. "Interacting with Paper Documents" in Proceedings of NordDATA '91, June 16-19; Oslo 1991.
• Well91: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]
• Weis91: Weiser, M. "The Computer for the 21st Century" Scientific American, September 1991.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Documentation, Human Factors

Keywords:
desk, desktop, display, document recognition, input device, interaction technique, user interface, workstation