Stitching: pen gestures that span multiple displays

ABSTRACT

Stitching is a new interaction technique that allows users to combine pen-operated mobile devices with wireless networking by using pen gestures that span multiple displays. To stitch, a user starts moving the pen on one screen, crosses over the bezel, and finishes the stroke on the screen of a nearby device. Properties of each portion of the pen stroke are observed by the participating devices, synchronized via wireless network communication, and recognized as a unitary act performed by one user, thus binding together the devices. We identify the general requirements of stitching and describe a prototype photo sharing application that uses stitching to allow users to copy images from one tablet to another that is nearby, expand an image across multiple screens, establish a persistent shared workspace, or use one tablet to present images that a user selects from another tablet. We also discuss design issues that arise from proxemics, that is, the sociological implications of users collaborating in close quarters.

REFERENCES

• 1: William Adjie-Winoto , Elliot Schwartz , Hari Balakrishnan , Jeremy Lilley, The design and implementation of an intentional naming system, Proceedings of the seventeenth ACM symposium on Operating systems principles, p.186-201, December 12-15, 1999, Charleston, South Carolina, United States
• 2: Altman, I., The Environment and Social Behavior. 1975, Monterey, CA: Brooks/Cole Publishing Company.
• 3: Bahl, P., Padmanabhan, V., RADAR: An In-Building RF-Based User Location and Tracking System, IEEE Computer and Communications Societies: INFOCOM 2000, 775--84.
• 4: Buxton, W., Chunking and Phrasing and the Design of Human-Computer Dialogues, Proc. IFIP Information Processing '86: Amsterdam: North Holland, 475--480.
• 5: William Buxton, A three-state model of graphical input, Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction, p.449-456, August 27-31, 1990
• 6: Buxton, W., Fiume, E., Hill, R., Lee, A., Woo, C., Continuous hand-gesture driven input, Graphics Interface '83, 191--195.
• 7: Deasy, C. M., Lasswell, T. E., Designing Places for People: A Handbook on Human Behavior for Architects, Designers, and Facility Managers. 1985, New York: Watson-Guptill.
• 8: W. Keith Edwards , Mark W. Newman , Jana Z. Sedivy , Trevor F. Smith , Dirk Balfanz , D. K. Smetters , H. Chi Wong , Shahram Izadi, Using speakeasy for ad hoc peer-to-peer collaboration, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587114]
• 9: Jeremy Elson , Lewis Girod , Deborah Estrin, Fine-grained network time synchronization using reference broadcasts, ACM SIGOPS Operating Systems Review, v.36 n.SI, Winter 2002 [doi>10.1145/844128.844143]
• 10: François Guimbretiére , Terry Winograd, FlowMenu: combining command, text, and data entry, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.213-216, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354778]
• 11: Hall, E. T., The Hidden Dimension. 1966, New York: Doubleday.
• 12: Ken Hinckley, Synchronous gestures for multiple persons and computers, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.149-158, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964713]
• 13: Lars Erik Holmquist , Friedemann Mattern , Bernt Schiele , Petteri Alahuhta , Michael Beigl , Hans-Werner Gellersen, Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts, Proceedings of the 3rd international conference on Ubiquitous Computing, p.116-122, September 30-October 02, 2001, Atlanta, Georgia, USA
• 14: Brad Johanson , Greg Hutchins , Terry Winograd , Maureen Stone, PointRight: experience with flexible input redirection in interactive workspaces, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572019]
• 15: Naohiko Kohtake , Jun Rekimoto , Yuichiro Anzai, InfoStick: An Interaction Device for Inter-Appliance Computing, Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing, p.246-258, September 27-29, 1999, Karlsruhe, Germany
• 16: Kurtenbach, G., Sellen, A., Buxton, W., An emprical evaluation of some articulatory and cognitive aspects of marking menus. Human Comput. Interaction, 1993. 8(1).
• 17: Brad A. Myers, Using handhelds and PCs together, Communications of the ACM, v.44 n.11, p.34-41, Nov. 2001 [doi>10.1145/384150.384159]
• 18: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 19: Rekimoto, J., Ayatsuka, Y., Kohno, M., SyncTap: An Interaction Technique for Mobile Networking, Mobile HCI 2003, 2003: Springer, 104--115.
• 20: Jun Rekimoto , Masanori Saitoh, Augmented surfaces: a spatially continuous work space for hybrid computing environments, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.378-385, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303113]
• 21: Tom Rodden , Yvonne Rogers , John Halloran , Ian Taylor, Designing novel interactional workspaces to support face to face consultations, Proceedings of the SIGCHI conference on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/642611.642623]
• 22: Scott, S. D., Territory-Based Interaction Techniques for Tabletop Collaboration, UIST'2003 Companion, 17--20.
• 23: Scott, S. D., Grant, K. D., Mandryk, R. L., System Guidelines for Co-located, Collaborative Work on a Tabletop Display, ECSCW'03, European Conference on Computer-Supported Cooperative Work, 159--178.
• 24: Sommer, R., Further studies of small group ecology. Sociometry, 1965. 28: p. 337--348.
• 25: Sommer, R., Personal space. 1969, Englewood Cliffs, NJ: Prentice-Hall.
• 26: Norbert A. Streitz , Jörg Geißler , Torsten Holmer , Shin'ichi Konomi , Christian Müller-Tomfelde , Wolfgang Reischl , Petra Rexroth , Peter Seitz , Ralf Steinmetz, i-LAND: an interactive landscape for creativity and innovation, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.120-127, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303010]
• 27: Colin Swindells , Kori M. Inkpen , John C. Dill , Melanie Tory, That one there! Pointing to establish device identity, Proceedings of the 15th annual ACM symposium on User interface software and technology, October 27-30, 2002, Paris, France [doi>10.1145/571985.572007]
• 28: Peter Tandler , Thorsten Prante , Christian Müller-Tomfelde , Norbert Streitz , Ralf Steinmetz, Connectables: dynamic coupling of displays for the flexible creation of shared workspaces, Proceedings of the 14th annual ACM symposium on User interface software and technology, November 11-14, 2001, Orlando, Florida [doi>10.1145/502348.502351]
• 29: Brygg Ullmer , Hiroshi Ishii , Dylan Glas, mediaBlocks: physical containers, transports, and controls for online media, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.379-386, July 1998 [doi>10.1145/280814.280940]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Human Factors

Keywords:
co-located collaboration, mobile devices, pen computing, proxemics, spontaneous device sharing, synchronous gestures