Photos for information: a field study of cameraphone computer vision interactions in tourism

ABSTRACT

Advances in mobile computing and computer vision can support camera-based interactions with mobile devices, including systems that use image-matching to support getting information about objects identified by the camera. These interfaces, sometimes considered mobile augmented reality, can be applied in many domains. This paper reports on a field study of these interfaces in a tourism application, which begins to address questions about embodied interaction, existing photo-taking practices, and alternative interfaces.

REFERENCES

• 1: Gregory D. Abowd , Christopher G. Atkeson , Jason Hong , Sue Long , Rob Kooper , Mike Pinkerton, Cyberguide: a mobile context-aware tour guide, Wireless Networks, v.3 n.5, p.421-433, Oct. 1997 [doi>10.1023/A:1019194325861]
• 2: Rafael A. Ballagas , Sven G. Kratz , Jan Borchers , Eugen Yu , Steffen P. Walz , Claudia O. Fuhr , Ludger Hovestadt , Martin Tann, REXplorer: a mobile, pervasive spell-casting game for tourists, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1240927]
• 3: Benjamin B. Bederson, Audio augmented reality: a prototype automated tour guide, Conference companion on Human factors in computing systems, p.210-211, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223526]
• 4: Chen, W-C., Xiong, Y., Gao, J., Gelfand, N., Grzeszczuk, R. Efficient Extraction of Robust Image Features on Mobile Devices. In Proc. ISMAR 2007.
• 5: Gao, J., Spasojevic, M., Jacob, M., Setlur, V., Reponen, E., Pulkkinen, M., Schloter, P., Pulli, K. Intelligent Visual Matching for Providing Context-Aware Information to Mobile Users. In Adjunct Proc. Ubicomp 2007.
• 6: Kindberg, T., O'Hara, K. You Are Here - Experiences with Located Symbols. HP Labs Technical Report HPL- 2006--120, 2006.
• 7: Milgram, P., H. Takemura, Utsumi, A., Kishin, F. Augmented Reality: A Class of Displays on the Reality- Virtuality Continuum. In Proc. SPIE, 2351, Telemanipulator and Telepresence Technologies, 282--292, 1994.
• 8: Stanford Public Walking Tour. http://www.stanford.edu/dept/visitorinfo/tours/.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Design, Human Factors

Keywords:
augmented reality, embodied interaction, field study, photography, tourist guides, user interfaces