Generating location overviews with images and tags by mining user-generated travelogues

ABSTRACT

Automatically generating location overviews in the form of both visual and textual descriptions is highly desired for online services such as travel planning, to provide attractive and comprehensive outlines of travel destinations. Actually, user-generated content (e.g., travelogues) on the Web provides abundant information to various aspects (e.g., landmarks, styles, activities) of most locations in the world. To leverage the experience shared by Web users, in this paper we propose a location overview generation approach, which first mines location-representative tags from travelogues and then uses such tags to retrieve web images. The learnt tags and retrieved images are finally presented via a novel user interface which provides an informative overview for a given location. Experimental results based on 23,756 travelogues and evaluation over 20 locations show promising results on both travelogue mining and location overview generation.

REFERENCES

• 1: Flickr. http://www.flickr.com/
• 2: L. Kennedy and M. Naaman. Generating diverse and representative image search results for landmarks. WWW, 2008.
• 3: I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. ICCV, 2007.
• 4: F. Jing, L. Zhang, and W.-Y. Ma. VirtualTour: an online travel assistant based on high quality images. MM, 2006.
• 5: L. Kennedy et al. How Flickr helps us make sense of the world: context and content in community-contributed media collections. MM, 2007.
• 6: E. Moxley, J. Kleban, and B. S. Manjunath. SpiritTagger: a geo-aware tag suggestion tool mined from Flickr. MIR, 2008.
• 7: T. Hofmann. Probabilistic latent semantic analysis. UAI, 1999.
• 8: Q. Mei et al. A probabilistic approach to spatiotemporal theme pattern mining on weblogs. WWW, 2006.
• 9: Q. Mei et al. Topic modeling with network regularization. WWW, 2008.
• 10: R. M. Neal and G. E. Hinton. A view of the EM algorithm that justifies incremental, sparse, and other variants. Learning in Graphical Models, MIT Press, 1999.
• 11: R. Cilibrasi and P. Vitányi. The Google similarity distance. IEEE Trans. Knowl. Data Eng, 19(3):370--383, 2007.
• 12: IgoUgo. http://www.igougo.com/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces

General Terms:
Algorithms, Design, Experimentation

Keywords:
location overview generation, travelogue mining, virtual tour