Geographic location tags on digital images

ABSTRACT

We describe an end-to-end system that capitalizes on geographic location tags for digital photographs. The World Wide Media eXchange (WWMX) database indexes large collections of image media by several pieces of metadata including timestamp, owner, and critically, location stamp. The location where a photo was shot is important because it says much about its semantic content, while being relatively easy to acquire, index, and search.The process of building, browsing, and writing applications for such a database raises issues that have heretofore been un- addressed in either the multimedia or the GIS community. This paper brings all of these issues together, explores different options, and offers novel solutions where necessary. Topics include acquisition of location tags for image media, data structures for location tags on photos, database optimization for location-tagged image media, and an intuitive UI for browsing a massive location-tagged image database. We end by describing an application built on top of the WWMX, a lightweight travelogue-authoring tool that automatically creates appropriate context maps for a slideshow of location-tagged photographs.

REFERENCES

• 1: Selected Papers from the International Workshop on Integrated Spatial Databases, Digital Inages and GIS, June 1999
• 2: Bahl, P. and V.N. Padmanabhan. RADAR: An In-Building RF-Based Location and Tracking System. in IEEE INFOCOM 2000. 2000. Tel-Aviv, Israel.
• 3: Bederson, B. B. PhotoMesa: A Zoomable Image Browser Using Quantum Treemaps and Bubblemaps. CHI Letters, 3(2):71--80, 2001.
• 4: J. J. Cadiz , Gina Venolia , Gavin Jancke , Anoop Gupta, Designing and deploying an information awareness interface, Proceedings of the 2002 ACM conference on Computer supported cooperative work, November 16-20, 2002, New Orleans, Louisiana, USA [doi>10.1145/587078.587122]
• 5: Stuart K. Card , Jock D. Mackinlay , Ben Shneiderman, Readings in information visualization: using vision to think, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 6: Michael G. Christel , Andreas M. Olligschlaeger , Chang Huang, Interactive Maps for a Digital Video Library, IEEE MultiMedia, v.7 n.1, p.60-67, January 2000 [doi>10.1109/93.839312]
• 7: Diomidis D. Spinellis, Position-Annotated Photographs: A Geotemporal Web, IEEE Pervasive Computing, v.2 n.2, p.72-79, April 2003 [doi>10.1109/MPRV.2003.1203756]
• 8: Dutton, G. Encoding and handling geospatial data with hierarchical triangular meshes. In Kraak, M.J. and Molenaar, M. (eds.) Advances in GIS Research II. London: Taylor & Francis, pp. 505--518, 1996.
• 9: P. Duygulu , Kobus Barnard , J. F. G. de Freitas , David A. Forsyth, Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary, Proceedings of the 7th European Conference on Computer Vision-Part IV, p.97-112, May 28-31, 2002
• 10: Dykes J.A., (1999) Interactive Maps for Exploratory Spatial Data Analysis: Cartographic Visualization - Approach, Implementation and Application, Ph.D. Thesis University of Leicester, UK
• 11: EXIF Standard. http://www.exif.org/specifications.html.
• 12: Jim Gemmell , Gordon Bell , Roger Lueder , Steven Drucker , Curtis Wong, MyLifeBits: fulfilling the Memex vision, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641053]
• 13: Google Image Search. <http://images.google.com>.
• 14: Don Kimber , Jonathan Foote , Surapong Lertsithichai, FlyAbout: spatially indexed panoramic video, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500192]
• 15: Henry Lieberman , Hugo Liu, Adaptive Linking between Text and Photos Using Common Sense Reasoning, Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, p.2-11, May 29-31, 2002
• 16: Longley, P. A., Goodchild, M. F., Maguire, D. J. Rhind, D. W., Geographic Information Systems and Science. John Wiley & Sons, 2001.
• 17: Mainichi Daily News article, http://mdn.mainichi.co.jp/ news/archive/200203/21/20020321p2a00m0fp003000c.html, March 21, 2002.
• 18: MapPoint online maps. http://www.mappoint.com.
• 19: Monmonier, M., Mapping It Out: Expository Cartography for the Humanities and Social Sciences. University of Chicago Press, Chicago IL, 1993.
• 20: Morris, B. CARTO-NET: Graphic retrieval and management in an automated map library. Special Libraries Association, Geography and Map Division Bulletin, 152:19--35, 1988.
• 21: North, C., Shneiderman, B., "A taxonomy of multiple window coordinations", University of Maryland, Dept. of Computer Science Tech Report, #CS-TR-3854, 1997.
• 22: Red Hen MediaMapper. http://www.mediamapper.com
• 23: Spatial databases with application to GIS, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
• 24: Rui, Y., Huang, T.S., and Chang, S. F., 1999. Image retrieval: current techniques, promising directions and open issues, Journal of Visual Communication and Image Representation , Vol. 10, pp.39--62.
• 25: Sahr, K. and White, D., Discrete Global Grid Systems. In Proc. 13th Symp. Interface, Comp. Sci. & Stat. 269-78, 1998.
• 26: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 27: Terence R. Smith, A Digital Library for Geographically Referenced Materials, Computer, v.29 n.5, p.54-60, May 1996 [doi>10.1109/2.493457]
• 28: USGS UTM fact sheet. http://mac.usgs.gov/mac/isb/ pubs/factsheets/fs07701.html.
• 29: George Wolberg, Digital Image Warping, IEEE Computer Society Press, Los Alamitos, CA, 1994
• 30: World Wide Media eXchange. http://wwmx.org.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures; Navigation; User issues

General Terms:
Algorithms, Design, Performance

Keywords:
GIS, digital photography, geographic interfaces, image databases