IDeixis: image-based Deixis for finding location-based information

ABSTRACT

We demonstrate an image-based approach to specifying location and finding location-based information from camera-equipped mobile devices. We introduce a point-by-photograph paradigm, where users can specify a location simply by taking pictures. Our technique uses content-based image retrieval methods to search the web or other databases for matching images and their source pages to find relevant location-based information. In contrast to conventional approaches to location detection, our method can refer to distant locations and does not require any physical infrastructure beyond mobile internet service. We have developed a prototype on a camera phone and conducted user studies to demonstrate the efficacy of our approach compared to other alternatives.

REFERENCES

• 1: Hisashi Aoki , Bernt Schiele , Alex Pentland, Realtime Personal Positioning System for Wearable Computers, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.37, October 18-19, 1999
• 2: Eija Kaasinen, User needs for location-aware mobile services, Personal and Ubiquitous Computing, v.7 n.1, p.70-79, May 2003 [doi>10.1007/s00779-002-0214-7]
• 3: Smith J. and Chang S.. Image and video search engine for the World Wide Web. In Proceedings of Storage and Retrieval for Image and Video Databases (SPIE), pages 84--95, 1997.
• 4: Yeh T., Tollmar K. and Darrell T., The IDeixis System, CSAIL Lab report, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
content-based image retrieval, context-aware computing, location-awareness, mobile computing