World explorer: visualizing aggregate data from unstructured text in geo-referenced collections

ABSTRACT

The availability of map interfaces and location-aware devices makes a growing amount of unstructured, geo-referenced information available on the Web. This type of information can be valuable not only for browsing, finding and making sense of individual items, but also in aggregate form to help understand data trends and features. In particular, over twenty million geo-referenced photos are now available on Flickr, a photo-sharing website - the first major collection of its kind. These photos are often associated with user-entered unstructured text labels (i.e., tags). We show how we analyze the tags associated with the geo-referenced Flickr images to generate aggregate knowledge in the form of "representative tags" for arbitrary areas in the world. We use these tags to create a visualization tool, World Explorer, tha tcan help expose the content of the data, using a map interface to display the derived tags and the original photo items. We perform a qualitative evaluation of World Explorer that outlines the visualization's benefits in browsing this type of content. We provide insights regarding the aggregate versus individual-item requirements in browsing digital geo-referenced material.

REFERENCES

• 1: A. Arampatzis, M. van Kreveld, I. Reinbacher, P. Clough, H. Joho, M. Sanderson, C. B. Jones, S. Vaid, M. Benkert, and A. Wolff. Web-based delineation of imprecise regions. In Proceedings of the Workshop on Geographic Information Retrieval, 2004.
• 2: Dick C. A. Bulterman, Is It Time for a Moratorium on Metadata?, IEEE MultiMedia, v.11 n.4, p.10-17, October 2004 [doi>10.1109/MMUL.2004.29]
• 3: D. Cavens, S. Sheppard, and M. Meitner. Image database extension to arcview: How to find the photograph you want. In Proceedings of ESRI Users Conference, 2001.
• 4: Marc Davis , Simon King , Nathan Good , Risto Sarvas, From context to content: leveraging context to infer media metadata, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027572]
• 5: Micah Dubinko , Ravi Kumar , Joseph Magnani , Jasmine Novak , Prabhakar Raghavan , Andrew Tomkins, Visualizing tags over time, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135810]
• 6: R. A. Finkel and J. L. Bentley. Quad trees a data structure for retrieval on composite keys. Acta Informatica, 4(1), 1974.
• 7: Flickr.com. http://www.flickr.com.
• 8: Alexandar Jaffe , Mor Naaman , Tamir Tassa , Marc Davis, Generating summaries and visualization for large collections of geo-referenced photographs, Proceedings of the 8th ACM international workshop on Multimedia information retrieval, October 26-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178677.1178692]
• 9: V. Jung. Metaviz: Visual interaction with geospatial digital libraries. Technical Report TR-99-017, International Computer Science Insitute, 1999.
• 10: R. R. Larson. Geographic information retrieval and spatial browsing. In L. Smith and M. Gluck, editors, Geographic Information Systems and Libraries: Patrons, Maps, and Spatial Information, pages 81--124. University of Illinois, 1996.
• 11: Y. Leclerc, M. Reddy, L. Iverson, and M. Eriksen. The geoweb - a new paradigm for finding data on the web. In International Cartographic Conference (ICC2001), 2001.
• 12: Ee-Peng Lim , Dion Hoe-Lian Goh , Zehua Liu , Wee-Keong Ng , Christopher Soo-Guan Khoo , Susan Ellen Higgins, G-Portal: a map-based digital library for distributed geospatial and georeferenced resources, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544307]
• 13: P. Longley, M. Goodchild, D. Maguire, and D. Rhind. Geographic Information Systems and Science. John Wiley & Sons, 2001.
• 14: Cameron Marlow , Mor Naaman , Danah Boyd , Marc Davis, HT06, tagging paper, taxonomy, Flickr, academic article, to read, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark [doi>10.1145/1149941.1149949]
• 15: S. Milgram and D. Jodelet. Psychological maps of paris. In W. I. H. Proshansky and L. Rivlin, editors, Environmental psychology, pages 104--124. Holt, Rinehart and Winston, 1976.
• 16: M. Naaman, A. Paepcke, and H. Garcia-Molina. From where to what: Metadata sharing for digital photographs with geographic coordinates. In 10th International Conference on Cooperative Information Systems (CoopIS), 2003.
• 17: R. Purves, P. Clough, and H. Joho. Identifying imprecise regions for geographic information retrieval using the web. In GISRUK '05, 2005.
• 18: T. Rattenbury, N. Good, and M. Naaman. Towards automatic extraction of event and place semantics from flickr tags. ACM Press, 2007.
• 19: G. Schwarz. Estimating the dimension of a model. The Annals of Statistic, 6:461--464, 1978.
• 20: Rao Shen , Naga Srinivas Vemuri , Weiguo Fan , Ricardo da S. Torres , Edward A. Fox, Exploring digital libraries: integrating browsing, searching, and visualization, Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries, June 11-15, 2006, Chapel Hill, NC, USA [doi>10.1145/1141753.1141755]
• 21: Terence R. Smith, A Digital Library for Geographically Referenced Materials, Computer, v.29 n.5, p.54-60, May 1996 [doi>10.1109/2.493457]
• 22: Kentaro Toyama , Ron Logan , Asta Roseway, Geographic location tags on digital images, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957046]
• 23: Fernanda B. Viégas , Scott Golder , Judith Donath, Visualizing email content: portraying relationships from conversational histories, Proceedings of the SIGCHI conference on Human Factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1124772.1124919]
• 24: Bin Zhu , Marshall Ramsey , Hsinchun Chen , Rosie V, Hauck , Tobun D. Ng , Bruce Schatz, Create a large-scale digital library for geo-referenced information, Proceedings of the fourth ACM conference on Digital libraries, p.260-261, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313445]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.0 General

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

General Terms:
Algorithms, Human Factors

Keywords:
geo-referenced data, photos, tagging systems, visualization