That one there! Pointing to establish device identity

ABSTRACT

Computing devices within current work and play environments are relatively static. As the number of 'networked' devices grows, and as people and their devices become more dynamic, situations will commonly arise where users will wish to use 'that device there' instead of navigating through traditional user interface widgets such as lists. This paper describes a process for identifying devices through a pointing gesture using custom tags and a custom stylus called the gesturePen. Implementation details for this system are provided along with qualitative and quantitative results from a formal user study. As ubiquitous computing environments become more pervasive, people will rapidly switch their focus between many computing devices. The results of our work demonstrate that our gesturePen method can improve the user experience in ubiquitous environments by facilitating significantly faster interactions between computing devices.

REFERENCES

• 1: Richard A. Bolt, “Put-that-there”: Voice and gesture at the graphics interface, Proceedings of the 7th annual conference on Computer graphics and interactive techniques, p.262-270, July 14-18, 1980, Seattle, Washington, United States
• 2: Richard Borovoy , Fred Martin , Sunil Vemuri , Mitchel Resnick , Brian Silverman , Chris Hancock, Meme tags and community mirrors: moving from conferences to collaboration, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.159-168, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289490]
• 3: Bucholtz, C. (2000) Software Behind HP Labs' CoolTown. Available at: http://www.interex.org/hpworldnews/hpw005/03news.html
• 4: Dray, S. (2001) Structured observation. Tutorial presented at CHI 2001.
• 5: D. C. Dryer , C. Eisbach , W. S. Ark, At what cost pervasive? a social computing view of mobile computing systems, IBM Systems Journal, v.38 n.4, p.652-676, Dec. 1999
• 6: Margaret Fleck , Marcos Frid , Tim Kindberg , Eamonn O'Brien-Strain , Rakhi Rajani , Mirjana Spasojevic, From Informing to Remembering: Ubiquitous Systems in Interactive Museums, IEEE Pervasive Computing, v.1 n.2, p.13-21, April 2002 [doi>10.1109/MPRV.2002.1012333]
• 7: Peter Ljungstrand , Lars Erik Holmquist, WebStickers: using physical objects as WWW bookmarks, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632916]
• 8: Brad A. Myers , Rishi Bhatnagar , Jeffrey Nichols , Choon Hong Peck , Dave Kong , Robert Miller , A. Chris Long, Interacting at a distance: measuring the performance of laser pointers and other devices, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503383]
• 9: Poor, R.D. (1999) The iRX 2.1. Available at: http://www.media.mit.edu/~r/projects/picsem/irx2/.
• 10: Redström, J., Dahlberg, P., Ljungstrand, P., Holmquist, L.E. (1999). Designing for Local Interaction. In Proc. of MANSE 1999.
• 11: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 12: Shu, K., Swindells, C., Chai, D., and Inkpen, K.M. (2002) WindowSpaces to share our digital media. Tech Report CMPT2002-04. Simon Fraser University. Available at: http://www.cs.sfu.ca/
• 13: Colin Swindells , Kori M. Inkpen, What is that?: gesturing to determine device identity, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506497]
• 14: Richard C. Teitelbaum , Richard E. Granda, The effects of positional constancy on searching menus for information, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.150-153, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801600]
• 15: Brygg Ullmer , Hiroshi Ishii, mediaBlocks: tangible interfaces for online media, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632739]
• 16: Roy Want , Gaetano Borriello, Information Appliances, IEEE Computer Graphics and Applications, v.20 n.3, p.21-23, May 2000 [doi>10.1109/MCG.2000.844368]
• 17: Roy Want , Kenneth P. Fishkin , Anuj Gujar , Beverly L. Harrison, Bridging physical and virtual worlds with electronic tags, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.370-377, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303111]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.3 Microcomputers
          Subjects: Portable devices (e.g., laptops, personal digital assistants)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); User-centered design; Interaction styles (e.g., commands, menus, forms, direct manipulation)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.1 Hardware architecture
          Subjects: Input devices
      I.3.4 Graphics Utilities
          Subjects: Virtual device interfaces

General Terms:
Design, Experimentation, Human Factors

Keywords:
PDA, gesturePen, gesturing, handheld computer, identification, infrared (IR) tag, pointing