A remote control interface for large displays

ABSTRACT

We describe a new widget and interaction technique, known as a "Frisbee," for interacting with areas of a large display that are difficult or impossible to access directly. A frisbee is simply a portal to another part of the display. It consists of a local "telescope" and a remote "target". The remote data surrounded by the target is drawn in the telescope and interactions performed within it are applied on the remote data. In this paper we define the behavior of frisbees, show unique affordances of the widget, and discuss design characteristics. We have implemented a test application and report on an experiment that shows the benefit of using the frisbee on a large display. Our results suggest that the frisbee is preferred over walking back and forth to the local and remote spaces at a distance of 4.5 feet.

REFERENCES

• 1: Johnny Accot , Shumin Zhai, More than dotting the i's --- foundations for crossing-based interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503390]
• 2: Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P. Bederson, B., and Zierlinger, A. (2003) Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-operated Systems. Proceedings of Interact 2003, pp. 57--64.
• 3: Patrick Baudisch , Ruth Rosenholtz, Halo: a technique for visualizing off-screen objects, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642695]
• 4: Benjamin B. Bederson , James D. Hollan, Pad++: a zooming graphical interface for exploring alternate interface physics, Proceedings of the 7th annual ACM symposium on User interface software and technology, p.17-26, November 02-04, 1994, Marina del Rey, California, United States [doi>10.1145/192426.192435]
• 5: Eric A. Bier , Maureen C. Stone , Ken Fishkin , William Buxton , Thomas Baudel, A taxonomy of see-through tools, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.358-364, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191786]
• 6: Doug A. Bowman , Larry F. Hodges, An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments, Proceedings of the 1997 symposium on Interactive 3D graphics, p.35-ff., April 27-30, 1997, Providence, Rhode Island, United States [doi>10.1145/253284.253301]
• 7: William Buxton , George Fitzmaurice , Ravin Balakrishnan , Gordon Kurtenbach, Large Displays in Automotive Design, IEEE Computer Graphics and Applications, v.20 n.4, p.68-75, July 2000 [doi>10.1109/38.851753]
• 8: M. S. T. Carpendale , Catherine Montagnese, A framework for unifying presentation space, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502358]
• 9: Patrick Chiu , Ashutosh Kapuskar , Sarah Reitmeier , Lynn Wilcox, NoteLook: taking notes in meetings with digital video and ink, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.149-158, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319483]
• 10: Scott Elrod , Richard Bruce , Rich Gold , David Goldberg , Frank Halasz , William Janssen , David Lee , Kim McCall , Elin Pedersen , Ken Pier , John Tang , Brent Welch, Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems, p.599-607, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143052]
• 11: T. Todd Elvins , David R. Nadeau , Rina Schul , David Kirsh, Worldlets: 3D thumbnails for 3D browsing, Proceedings of the SIGCHI conference on Human factors in computing systems, p.163-170, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274669]
• 12: George W. Fitzmaurice, Situated information spaces and spatially aware palmtop computers, Communications of the ACM, v.36 n.7, p.39-49, July 1993 [doi>10.1145/159544.159566]
• 13: G. W. Furnas, Generalized fisheye views, Proceedings of the SIGCHI conference on Human factors in computing systems, p.16-23, April 13-17, 1986, Boston, Massachusetts, United States
• 14: Jörg Geißler, Shuffle, throw or take it! working efficiently with an interactive wall, CHI 98 conference summary on Human factors in computing systems, p.265-266, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286745]
• 15: François Guimbretière , Maureen Stone , Terry Winograd, Fluid interaction with high-resolution wall-size displays, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502353]
• 16: Hascoët, M. (2003) Throwing models for large displays, Proceedings of HCI'2003, Designing for Society, Volume 2, pp. 73--77, British HCI Group.
• 17: Brad Johanson , Greg Hutchins , Terry Winograd , Maureen Stone, PointRight: experience with flexible input redirection in interactive workspaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572019]
• 18: Brad Johanson , Shankar Ponnekanti , Caesar Sengupta , Armando Fox, Multibrowsing: Moving Web Content across Multiple Displays, Proceedings of the 3rd international conference on Ubiquitous Computing, p.346-353, September 30-October 02, 2001, Atlanta, Georgia, USA
• 19: Robert C. Miller , Brad A. Myers, Synchronizing clipboards of multiple computers, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.65-66, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322584]
• 20: Brad A. Myers , Herb Stiel , Robert Gargiulo, Collaboration using multiple PDAs connected to a PC, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.285-294, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289503]
• 21: Jeffrey S. Pierce , Randy Pausch, Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503396]
• 22: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 23: Jun Rekimoto, A multiple device approach for supporting whiteboard-based interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.344-351, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274692]
• 24: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 25: Richard Stoakley , Matthew J. Conway , Randy Pausch, Virtual reality on a WIM: interactive worlds in miniature, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223938]
• 26: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 27: Smart Technologies (www.smarttech.com) SMART Board.
• 28: Kishore Swaminathan , Steve Sato, Interaction design for large displays, interactions, v.4 n.1, p.15-24, Jan./Feb. 1997 [doi>10.1145/242388.242395]
• 29: Desney S. Tan , Brian Meyers , Mary Czerwinski, WinCuts: manipulating arbitrary window regions for more effective use of screen space, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986106]
• 30: Masayuki Tani , Masato Horita , Kimiya Yamaashi , Koichiro Tanikoshi , Masayasu Futakawa, Courtyard: integrating shared overview on a large screen and per-user detail on individual screens, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.44-50, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191690]
• 31: Michael Tsang , George W. Fitzmaurice , Gordon Kurtenbach , Azam Khan , Bill Buxton, Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572001]
• 32: Brygg Ullmer , Hiroshi Ishii, The metaDESK: models and prototypes for tangible user interfaces, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.223-232, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263551]
• 33: Want, R., Schilit, B.N., Adams, N.I., Gold, R. Petersen, K., Goldberg, D., Ellis, J.R. and Weiser, M.. (1995) The PARCTAB Ubiquitous Computing Experiment. Technical Report CSL-95-1, Xerox Palo Alto Research Center, March 1995.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Windowing systems

Keywords:
drag-and-drop, interaction technique, large displays, pen user interfaces