Direct pointer: direct manipulation for large-display interaction using handheld cameras

ABSTRACT

This paper describes the design and evaluation of a technique, Direct Pointer, that enables users to interact intuitively with large displays using cameras equipped on handheld devices, such as mobile phones and personal digital assistant (PDA). In contrast to many existing interaction methods that attempt to address the same problem, ours offers direct manipulation of the pointer position with continuous visual feedback. The primary advantage of this technique is that it only requires equipment that is readily available: an electronic display, a handheld digital camera, and a connection between the two. No special visual markers in the display content are needed, nor are fixed cameras pointing at the display. We evaluated the performance of Direct Pointer as an interaction product, showing that it performs as well as comparable techniques that require more sophisticated equipment.

REFERENCES

• 1: Rafael Ballagas , Michael Rohs , Jennifer G. Sheridan, Sweep and point and shoot: phonecam-based interactions for large public displays, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056876]
• 2: ISO. Ergonomic requirements for office work with visual display terminals (VDTs) - Requirements for non-keyboard input devices. ISO 9241-9, (2000).
• 3: I. Scott MacKenzie , Shaidah Jusoh, An Evaluation of Two Input Devices for Remote Pointing, Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction, p.235-250, May 11-13, 2001
• 4: I. Scott MacKenzie , Tatu Kauppinen , Miika Silfverberg, Accuracy measures for evaluating computer pointing devices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.9-16, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365028]
• 5: Kento Miyaoku , Suguru Higashino , Yoshinobu Tonomura, C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029657]
• 6: Oh, J.-Y. and Stuerzlinger, W. Laser Pointers as Collaborative Pointing Devices. Proc Graphics Interface'02, (2002).
• 7: Dan R. Olsen, Jr. , Travis Nielsen, Laser pointer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-22, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365030]
• 8: Shi, J. and Tomasi, C. Good Features to Track. Proc CVPR'94, pages 593--600, (1994).
• 9: Sukthankar, R., Stockton, R. and Mullin, P. Smarter Presentations: Exploiting Homography in Camera-Projector Systems. Proc ICCV'01, (2001).
• 10: Xiang Cao , Ravin Balakrishnan, VisionWand: interaction techniques for large displays using a passive wand tracked in 3D, Proceedings of the 16th annual ACM symposium on User interface software and technology, p.173-182, November 02-05, 2003, Vancouver, Canada [doi>10.1145/964696.964716]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
interaction, large display, remote pointing, shared display