Visual summaries of popular landmarks from community photo collections

ABSTRACT

We present a novel data-driven algorithm that leverages online image repositories such as Flickr for automatically generating tourist maps. Our hypothesis is that, given a large enough dataset of images with geo-based metadata, clusters of matching images from that dataset tend to provide reliable cues as to what the popular tourist spots may be. Our algorithm takes the geographical area of interest as input and retrieves geotagged photos from online photo collections. By clustering the photos based on their locations and identifying the popular tags for each cluster, our algorithm generates a set of points of interest (POIs) for the area. After retrieving additional photos based on these discovered POI tags, we use image matching to find the most representative landmark view for each POI. Finally, we remove clutter from the representative image and apply tooning to generate a map icon for each landmark.

REFERENCES

• 1: D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5):603--619, May 2002.
• 2: F. Grabler, M. Agrawala, R.W. Sumner, and M. Pauly. Automatic generation of tourist maps. ACM Trans. Graph., 2008.
• 3: L.S. Kennedy and M. Naaman. Generating diverse and representative image search results for landmarks. In WWW'08: Proceeding of the 17th international conference on World Wide Web, pages 297--306, New York, NY, USA, 2008. ACM.
• 4: T. Quack, B. Leibe, and L.V. Gool. World-scale mining of objects and events from community photo collections. In CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval, pages 47--56, New York, NY, USA, 2008. ACM.
• 5: G. Salton and M.J. McGill. Introduction to Modern Information Retrieval. McGraw-Hill, Inc., New York, NY, USA, 1986.
• 6: V. Setlur, C. Albrecht-Buehler, A.A. Gooch, S. Rossoff, and B. Gooch. Semanticons: Visual Metaphors as File Icons. Eurographics 2005, 24(3):647--656, Sept. 2005.
• 7: I. Simon, N. Snavely, and S.M. Seitz. Scene Summarization for Online Image Collections. In Proc. of International Conference on Computer Vision (ICCV 2007). IEEE Computer Society, 2007.
• 8: N. Snavely, S.M. Seitz, and R. Szeliski. Photo tourism: exploring photo collections in 3d. In SIGGRAPH '06: ACM SIGGRAPH 2006 Papers, pages 835--846, New York, NY, USA, 2006. ACM.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Human Factors

Keywords:
geotagged photos, points of interest, tourist maps