Detecting cultural differences using consumer-generated geotagged photos

ABSTRACT

We propose a novel method to detect cultural differences over the world automatically by using a large amount of geotagged images on the photo sharing Web sites such as Flickr. We employ the state-of-the-art object recognition technique developed in the research community of computer vision to mine representative photos of the given concept for representative local regions from a large-scale unorganized collection of consumer-generated geotagged photos. The results help us understand how objects, scenes or events corresponding to the same given concept are visually different depending on local regions over the world.

REFERENCES

• 1: G. Csurka, C. Bray, C. Dance, and L. Fan. Visual categorization with bags of keypoints. In Proc. of ECCV Workshop on Statistical Learning in Computer Vision, pages 59--74, 2004.
• 2: A. J. Edwardes and R. S. Purves. A theoretical grounding for semantic descriptions of place. In Proc. of 7th International Symposium on Web and Wireless Geographical Information Systems (W2GIS) (LNCS no. 4857), pages 106--121, 2007.
• 3: J. Hays and A. A. Efros. IM2GPS: Estimating geographic information from a single image. In Proc. of IEEE Computer Vision and Pattern Recognition, 2008.
• 4: Thomas Hofmann, Unsupervised learning by probabilistic latent semantic analysis, Machine Learning, v.42 n.1/2, p.177-196, Jan. 2001 [doi>10.1023/A:1007617005950]
• 5: Alexandar Jaffe , Mor Naaman , Tamir Tassa , Marc Davis, Generating summaries and visualization for large collections of geo-referenced photographs, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, October 26-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178677.1178692]
• 6: Lyndon S. Kennedy , Mor Naaman, Generating diverse and representative image search results for landmarks, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China [doi>10.1145/1367497.1367539]
• 7: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 8: Bingyu Qiu , Keiji Yanai, Objects over the World, Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing, December 09-13, 2008, Tainan, Taiwan [doi>10.1007/978-3-540-89796-5_31]
• 9: Till Quack , Bastian Leibe , Luc Van Gool, World-scale mining of objects and events from community photo collections, Proceedings of the 2008 international conference on Content-based image and video retrieval, July 07-09, 2008, Niagara Falls, Canada [doi>10.1145/1386352.1386363]
• 10: R. Raguram and S. Lazebnik. Computing iconic summaries of general visual concepts. In Proc. of IEEE CVPR Workshop on Internet Vision, 2008.
• 11: I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. In Proc. of IEEE International Conference on Computer Vision, 2007.
• 12: B. Smith and D. M. Mark. Geographical categories: an ontological investigation. International Journal of Geographical Information Science, 15(7), 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Keywords:
Flickr, geotag, object recognition, representative image