PointRight: experience with flexible input redirection in interactive workspaces

ABSTRACT

We describe the design of and experience with PointRight, a peer-to-peer pointer and keyboard redirection system that operates in multi-machine, multi-user environments. PointRight employs a geometric model for redirecting input across screens driven by multiple independent machines and operating systems. It was created for interactive workspaces that include large, shared displays and individual laptops, but is a general tool that supports many different configurations and modes of use. Although previous systems have provided for re-routing pointer and keyboard control, in this paper we present a more general and flexible system, along with an analysis of the types of re-binding that must be handled by any pointer redirection system This paper describes the system, the ways in which it has been used, and the lessons that have been learned from its use over the last two years.

REFERENCES

• 1: Eric A. Bier , Steve Freeman , Ken Pier, MMM: The multi-device multi-user multi-editor, Proceedings of the SIGCHI conference on Human factors in computing systems, p.645-646, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143065]
• 2: Barry Brumitt , Brian Meyers , John Krumm , Amanda Kern , Steven A. Shafer, EasyLiving: Technologies for Intelligent Environments, Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing, p.12-29, September 25-27, 2000, Bristol, UK
• 3: Michael H. Coen, Design principles for intelligent environments, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.547-554, July 1998, Madison, Wisconsin, United States
• 4: Fox, A., Johanson, B., Hanrahan, P., Winograd, T., PDAs in Interactive Workspaces, Computer Graphics and Animation, May, 2000.
• 5: François Guimbretière , Maureen Stone , Terry Winograd, Fluid interaction with high-resolution wall-size displays, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502353]
• 6: Hubinette, Fredrik, x2vnc, http://fredrik.hubbe.net/x2vnc.html.
• 7: iROS open source, http://iros.sourceforge.net
• 8: Brad Johanson , Armando Fox, The Event Heap: A Coordination Infrastructure for Interactive Workspaces, Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications, p.83, June 20-21, 2002
• 9: Brad Johanson , Armando Fox , Terry Winograd, The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms, IEEE Pervasive Computing, v.1 n.2, p.67-74, April 2002 [doi>10.1109/MPRV.2002.1012339]
• 10: Brad Johanson , Shankar Ponnekanti , Caesar Sengupta , Armando Fox, Multibrowsing: Moving Web Content across Multiple Displays, Proceedings of the 3rd international conference on Ubiquitous Computing, p.346-353, September 30-October 02, 2001, Atlanta, Georgia, USA
• 11: Fischer, Martin; Stone Maureen; Liston, Kathleen; Kunz, John; Singhal, Vibha (2002). "Multi-stakeholder collaboration: The CIFE iRoom." Proceedings CIB W78 Conference 2002: Distributing Knowledge in Building, Aarhus School of Architecture and Centre for Integrated Design, Aahus, Denmark, pp. 6-13.
• 12: Brad A. Myers , Herb Stiel , Robert Gargiulo, Collaboration using multiple PDAs connected to a PC, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.285-294, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289503]
• 13: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 14: Tristan Richardson , Quentin Stafford-Fraser , Kenneth R. Wood , Andy Hopper, Virtual Network Computing, IEEE Internet Computing, v.2 n.1, p.33-38, January 1998 [doi>10.1109/4236.656066]
• 15: Smart Technologies SMART Board, http://www.smarttech.com/SmartBoard/.
• 16: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 17: Peter Tandler, Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices, Proceedings of the 3rd international conference on Ubiquitous Computing, p.96-115, September 30-October 02, 2001, Atlanta, Georgia, USA
• 18: Weiser, M., The computer for the twenty-first century. Scientific American, 94-100, September 1991.
• 19: x2x, http://ftp.digital.com/pub/DEC/SRC/x2x/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  F. Theory of Computation
  F.1 COMPUTATION BY ABSTRACT DEVICES
      F.1.2 Modes of Computation
          Subjects: Interactive and reactive computation

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models
          Subjects: Geometric
      I.5.5 Implementation
          Subjects: Interactive systems

General Terms:
Algorithms, Design, Experimentation, Human Factors, Reliability

Keywords:
input redirection, multi-display environments, ubiquitous computing