Integrating gazetteers and remote sensed imagery

ABSTRACT

This work explores the potential for increased synergy between gazetteers and high-resolution remote sensed imagery. These two data sources are complementary. Gazetteers provide high-level semantic information about what is where but they must be manually compiled and maintained. On the other hand, imagery can be automatically acquired but only provides low-level radiometric information. We explore ways in which these two data sources can be integrated to more fully automate geographic data management. In particular, we show how gazetteers represent a rich source of semi-supervised training data for geospatial object modelling. We also describe an example of information flow in the other direction, namely, how high-resolution imagery can be used to refine the spatial extents of geospatial objects in gazetteers.

REFERENCES

• 1: Alexandria Digital Library Gazetteer. 1999-. Santa Barbara CA: Map and Imagery Lab, Davidson Library, University of California, Santa Barbara. Copyright UC Regents. http://www.alexandria.ucsb.edu/gazetteer.
• 2: Flickr photo sharing. http://www.flickr.com.
• 3: Zonetag research prototype. http://zonetag.research.yahoo.com.
• 4: P. Agouris, K. Beard, G. Mountrakis, and A. Stefanidis. Capturing and modeling geographic object change: A spatiotemporal gazetteer framework. Photogrammetric Engineering & Remote Sensing, 66(10):1241--1250, 2000.
• 5: P. Agouris, S. Gyftakis, and A. Stefanidis. Using a fuzzy supervisor for object extraction within an integrated geospatial environment. International Archives of Photogrammetry and Remote Sensing, 32(III/1):191--195, 1998.
• 6: T. Bailloeul, J. Duan, V. Prinet, and B. Serra. Urban digital map updating from satellite high resolution images using GIS data as a priori knowledge. In Proceedings of the GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, pages 283--287, 2003.
• 7: E. P. Baltsavias. Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems. ISPRS Journal of Photogrammetry and Remote Sensing, 58(3--4):129--151, 2004.
• 8: K. Barnard, P. Duygulu, and D. Forsyth. Clustering art. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, volume 2, pages 434--441, 2001.
• 9: K. Barnard and D. Forsyth. Learning the semantics of words and pictures. In Proceedings of the IEEE International Conference on Computer Vision, volume 2, pages 408--415, 2001.
• 10: A. Baumgartner, W. Eckstein, H. Mayer, C. Heipke, and H. Ebner. Context-supported road extraction. Automatic Extraction of Man-Made Objects from Aerial and Space Images, II:299--308, 1997.
• 11: T. Berg, A. Berg, J. Edwards, M. Maire, R. White, Y.-W. Teh, E. Learned-Miller, and D. Forsyth. Names and faces in the news. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, volume 2, pages 848--854, 2004.
• 12: Matthew Cooper , Jonathan Foote , Andreas Girgensohn , Lynn Wilcox, Temporal event clustering for digital photo collections, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957093]
• 13: Peter Doucette , Peggy Agouris , Maohamad Musavi , Anthony Stefanidis, Automated Extraction of Linear Features from Aerial Imagery Using Kohonen Learning and GIS Data, Selected Papers from the International Workshop on Integrated Spatial Databases, Digital Inages and GIS, p.20-33, June 14-16, 1999
• 14: David J. Hand , Padhraic Smyth , Heikki Mannila, Principles of data mining, MIT Press, Cambridge, MA, 2001
• 15: L. L. Hill, J. Frew, and Q. Zheng. Geographic names: The implementation of a gazetteer in a georeferenced digital library. D-Lib, 5(1), 1999.
• 16: L.-J. Li, G. Wang, and L. Fei-Fei. Optimol: automatic Online Picture collecTion via Incremental MOdel Learning. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, pages 1--8, 2007.
• 17: David G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, v.60 n.2, p.91-110, November 2004 [doi>10.1023/B:VISI.0000029664.99615.94]
• 18: Martin Michalowski , Craig A. Knoblock , Ken Bayer , Berthe Y. Choueiry, Exploiting automatically inferred constraint-models for building identification in satellite imagery, Proceedings of the 15th annual ACM international symposium on Advances in geographic information systems, November 07-09, 2007, Seattle, Washington [doi>10.1145/1341012.1341021]
• 19: Krystian Mikolajczyk , Cordelia Schmid, A Performance Evaluation of Local Descriptors, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.10, p.1615-1630, October 2005 [doi>10.1109/TPAMI.2005.188]
• 20: Mor Naaman, Eyes on the World, Computer, v.39 n.10, p.108-111, October 2006 [doi>10.1109/MC.2006.339]
• 21: S. Newsam, S. Bhagavathy, and B. S. Manjunath. Object localization using texture motifs and markov random fields. In Proceedings of the IEEE International Conference on Image Processing, volume 2, pages 1049--1052, 2003.
• 22: S. Newsam, B. Sumengen, and B. Manjunath. Category-based image retrieval. In Proceedings of the IEEE International Conference on Image Processing, volume 3, pages 596--599, 2001.
• 23: Shawn Newsam , Yang Yang, Comparing global and interest point descriptors for similarity retrieval in remote sensed imagery, Proceedings of the 15th annual ACM international symposium on Advances in geographic information systems, November 07-09, 2007, Seattle, Washington [doi>10.1145/1341012.1341024]
• 24: S. Newsam and Y. Yang. Geographic image retrieval using interest point descriptors. In Proceedings of the International Symposium on Visual Computing (ISVC), 2007.
• 25: Till Quack , Ullrich Mönich , Lars Thiele , B. S. Manjunath, Cortina: a system for large-scale, content-based web image retrieval, Proceedings of the 12th annual ACM international conference on Multimedia, October 10-16, 2004, New York, NY, USA [doi>10.1145/1027527.1027650]
• 26: V. Walter and D. Fritsch. Automatic verification of GIS data using high resolution multispectral data. International Archives of Photogrammetry and Remote Sensing, 32(III/1):485--490, 1998.
• 27: Y. Yang and S. Newsam. Comparing SIFT descriptors and Gabor texture features for classfication of remote sensed imagery. In Proceedings of the IEEE International Conference on Image Processing, 2008 (accepted for publication).
• 28: C. Zhang. Towards an operational system for automated updating of road databases by integration of imagery and geodata. ISPRS Journal of Photogrammetry and Remote Sensing, 58(3--4):166--186, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Spatial databases and GIS

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Object recognition

  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING

Keywords:
Markov random fields, appearance modeling, appearance models, gazetteers, geospatial objects, information integration, interest points, remote sensed imagery