Exploring the urban environment with a camera phone: lessons from a user study

ABSTRACT

We present a study investigating two novel mobile services supporting querying for information in the urban environment using camera equipped smart phones as well as two different ways to visualize results -- icon-based visualization and text-based visualization. Both applications enable the user to access information about an object by snapping a photo of it. We investigate how users would use a photo-based tourist guide in a free exploration setting in general as well as the acceptance/preference of two different ways to visualize results.

REFERENCES

• 1: Amlacher, K. and Paletta, L., (2008). An Attentive Machine Interface Using Geo-Contextual Awareness for Mobile Vision Tasks, Proc. European Conference on Artificial Intelligence, ECAI 2008, pp. 601--605.
• 2: Cuellar G., Eckles D. and Spasojevic M. (2008). Photos for Information: A Field Study of Cameraphone Computer Vision Interactions in Tourism. Proc. CHI 2008.
• 3: Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. IJCV 60(2), pp. 91--110.
• 4: Schmid, C. and Mohr, R. (1997). Local gray-value invariants for image retrieval. IEEE PAMI 19(5), pp. 530--535.
• 5: Shao, H., Svoboda, T., and van Gool, L. (2003). HPAT indexing for fast object/scene recognition based on local appearance. Proc. International Conference on Image and Video Retrieval, CIVR 2003, pp. 71--80.
• 6: Yeh, T., Tollmar, K., and Darrell, T. (2004). Searching the web with mobile images for location recognition. Proc. IEEE Computer Vision and Pattern Recognition, CVPR 2004, pp. 76

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors, Performance

Keywords:
augmented reality, computer vision, mobile devices