Modeling satellite image streams for change analysis

ABSTRACT

Fast detection of changes in environmental remotely sensed data is a major requirement in the Earth sciences, especially in natural disaster related scenarios. As satellite, transmission, and network technologies continue to improve, the real-time stream processing and delivery of geospatial data from remote sensors requires a systematic approach for change analysis and visualization in a streaming fashion. Although various approaches have been formulated to model the inherent spatial-temporal-spectral complexity of remotely sensed satellite data, there are still challenging peculiarities that demand a precise characterization in the context of environmental change detection.

In this paper, we present a formal characterization of fundamental operational aspects for the unambiguous specification of change detection and visualization queries in a streaming fashion. This goal is accomplished by defining spatially-aware temporal operators with a consistent semantics for change analysis tasks, and a practically relevant image stream processing architecture founded on a precise execution model and realized by using scientific workflows particularly targeted at collaborative scientific environments. We illustrate our approach with representative examples in land cover and wildfire detection using live data from environmental remote sensors.

REFERENCES

• 1: Daniel J. Abadi , Don Carney , Ugur Çetintemel , Mitch Cherniack , Christian Convey , Sangdon Lee , Michael Stonebraker , Nesime Tatbul , Stan Zdonik, Aurora: a new model and architecture for data stream management, The VLDB Journal — The International Journal on Very Large Data Bases, v.12 n.2, p.120-139, August 2003 [doi>10.1007/s00778-003-0095-z]
• 2: Brian Babcock , Shivnath Babu , Mayur Datar , Rajeev Motwani , Jennifer Widom, Models and issues in data stream systems, Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 03-05, 2002, Madison, Wisconsin [doi>10.1145/543613.543615]
• 3: Peter Baumann, A Database Array Algebra for Spatio-Temporal Data and Beyond, Proceedings of the 4th International Workshop on Next Generation Information Technologies and Systems, p.76-93, July 05-07, 1999
• 4: M. J. Carlotto. Detection and analysis of change in remotely sensed imagery with application to wide area surveillance. IEEE Transactions on Image Processing, 6(1):189--202, 1997.
• 5: S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, M. A. Shah. TelegraphCQ: Continuous dataflow processing for an uncertain world. In CIDR, 2003.
• 6: N. Chaudhry, K. Shaw, M. Abdelguerfi. Stream Data Management. Springer, April 2005.
• 7: M. Gertz, Q. Hart, C. Rueda, S. Singhal, J. Zhang. A data and query model for streaming geospatial image data. In EDBT'06 Workshops, LNCS 4254, 687--699, 2006.
• 8: Quinn Hart , Michael Gertz, Querying streaming geospatial image data: the geostreams project, Proceedings of the 17th international conference on Scientific and statistical database management, p.147-150, June 27-29, 2005, Santa Barbara, CA
• 9: C. Hylands, E. Lee, J. Liu, X. Liu, S. Neuendorffer, Y. Xiong, Y. Zhao, H. Zheng. Overview of the Ptolemy Project. Technical Report UCB/ERL M03/25, University of California, Berkeley, July 2003.
• 10: John R. Jensen, Introductory Digital Image Processing: A Remote Sensing Perspective, Prentice Hall PTR, Upper Saddle River, NJ, 1995
• 11: Daniel Kifer , Shai Ben-David , Johannes Gehrke, Detecting change in data streams, Proceedings of the Thirtieth international conference on Very large data bases, p.180-191, August 31-September 03, 2004, Toronto, Canada
• 12: K. Konstantinides, J. R. Rasure. The Khoros software development environment for image and signal processing. IEEE Transactions on Image Processing, 3(3):243--252, 1994.
• 13: Balachander Krishnamurthy , Subhabrata Sen , Yin Zhang , Yan Chen, Sketch-based change detection: methods, evaluation, and applications, Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, October 27-29, 2003, Miami Beach, FL, USA [doi>10.1145/948205.948236]
• 14: E. A. Lee, T. M. Parks. Dataflow process networks. Proceedings of the IEEE, 83(5):773--801, 1995.
• 15: B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger-Frank, M. Jones, E. Lee, J. Tao, Y. Zhao. Concurrency and Computation: Practice & Experience, Special Issue on Scientific Workflows, Chapter Scientific Workflow Management and the Kepler System, 2007.
• 16: R. S. Lunetta, C. D. Elvidge. Remote Sensing Change Detection: Environmental Monitoring Methods and Applications. Ann Arbor Press, 1998.
• 17: Arunprasad P. Marathe , Kenneth Salem, Query processing techniques for arrays, Proceedings of the 1999 ACM SIGMOD international conference on Management of data, p.323-334, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States
• 18: D. Murray, J. McWhirter, S. Wier, S. Emmerson. The integrated data viewer-a web-enabled application for scientific analysis and visualization. In 19th Conference on Interactive Information Processing Systems, AMS, 2003.
• 19: S. G. Parker, M. Miller, C. D. Hansen, C. R. Johnson. An integrated problem solving environment: The SCIRun computational steering system. HICSS'98, VOl.7, 1998.
• 20: R. Radke, S. Andra, O. Al-Kofahi, B. Roysam. Image change detection algorithms: A systematic survey. IEEE Transactions on Image Processing, 14(3):294--307, 2005.
• 21: Gerhard X. Ritter , Joseph N. Wilson, Handbook of Computer Vision Algorithms in Image Algebra, CRC Press, Inc., Boca Raton, FL, 2000
• 22: P. L. Rosin. Thresholding for change detection. Computer Vision and Image Understanding, 86(2):79--95, 2002.
• 23: Carlos Rueda , Michael Gertz , Bertram Ludascher , Bernd Hamann, An Extensible Infrastructure for Processing Distributed Geospatial Data Streams, Proceedings of the 18th International Conference on Scientific and Statistical Database Management, p.285-290, July 03-05, 2006 [doi>10.1109/SSDBM.2006.12]
• 24: S. Shekhar, S. Chawla. Spatial Databases: A Tour. Prentice Hall, 2002.
• 25: J. Yeh. Image and video processing libraries in Ptolemy II. Technical Report UCB/ERL M03/52, EECS Department, University of California, 2003.
• 26: Yunyue Zhu , Dennis Shasha, Efficient elastic burst detection in data streams, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956789]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING
      Subjects: Earth and atmospheric sciences

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.1 Logical Design
          Subjects: Data models

General Terms:
Design, Experimentation

Keywords:
change detection, data streams, remote sensing, scientific workflows