Optimization of multiple continuous queries over streaming satellite data

ABSTRACT

Remotely sensed data, in particular satellite imagery, play many important roles in environmental applications. In particular applications that study rapid changes in the environment require frequent access to these data. For continuous data products, users are often interested in formulating continuous queries that deliver results for each incoming image. In the presence of multiple continuous queries, there is clearly an opportunity to share common intermediate data and thus, increase the overall processing speed of the system.Based on the widely used GRASS, this paper describes a system that realizes multiple query processing using two major components. A query optimizer maintains the current set of active continuous queries. Queries are organized into a single processing plan designed to share intermediate results. For each new image from the stream, the optimizer generates an execution plan specific to the active queries. The query executor then rewrites this plan into a set of geospatial processing steps and executes the plan.We detail experiments using data from NOAA's GOES. Continuous queries are defined in a way similar to the OGC WMS query specification. Using predicted query patterns over the visible hemisphere of GOES, experimental results indicate that multiple-query optimized plans can improve performance significantly when compared to queries that are executed separately.

REFERENCES

• 1: J. de La Beaujardiere. Web Map Service. OpenGIS Implementation OGC 04-024, Open Geospatial Consortium Inc., Aug 2004.
• 2: James Frew , Rajendra Bose, Earth System Science Workbench: A Data Management Infrastructure for Earth Science Products, Proceedings of the 13th International Conference on Scientific and Statistical Database Management, p.180-189, July 18-20, 2001
• 3: M. Gertz, Q. Hart, C. Rueda, S. Singhal, and J. Zhang. A Data and Query Model for Streaming Geospatial Image Data. In EDBT Workshops (11th International Workshop on Foundations of Models and Languages for Data and Objects), LNCS 4254, Springer, 687--699, 2006.
• 4: GOES I-M DataBook, Revision 1, 1996.
• 5: GRASS Development Team. Geographic Resources Analysis Support System (GRASS GIS) Software, grass.baylor.edu.
• 6: Q. Hart, M. Gertz, J. Zhang. Evaluation of a Dynamic Tree Structure for Indexing Query Regions on Streaming Geospatial Data. In 9th International Symposium on Spatial and Temporal Databases (SSTD05), LNCS 3633, Springer, 145--162, 2005.
• 7: Quinn Hart , Michael Gertz, Querying streaming geospatial image data: the geostreams project, Proceedings of the 17th international conference on Scientific and statistical database management, p.147-150, June 27-29, 2005, Santa Barbara, CA
• 8: J. R. Jensen. Remote Sensing of the Environment: An Earth Resource Perspective. Prentice Hall, 2000.
• 9: Christopher Lynnes , Bruce Vollmer, A robust, low-cost virtual archive for science data, Proceedings of the 17th international conference on Scientific and statistical database management, p.59-62, June 27-29, 2005, Santa Barbara, CA
• 10: Samuel Madden , Mehul Shah , Joseph M. Hellerstein , Vijayshankar Raman, Continuously adaptive continuous queries over streams, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564698]
• 11: J. McCoy. ArcGIS9 Using ArcGIS Spatial Analyst. ESRI, Redlands, CA, 2005.
• 12: Sunil Prabhakar , Yuni Xia , Dmitri V. Kalashnikov , Walid G. Aref , Susanne E. Hambrusch, Query Indexing and Velocity Constrained Indexing: Scalable Techniques for Continuous Queries on Moving Objects, IEEE Transactions on Computers, v.51 n.10, p.1124-1140, October 2002 [doi>10.1109/TC.2002.1039840]
• 13: Gerhard X. Ritter , Joseph N. Wilson, Handbook of Computer Vision Algorithms in Image Algebra, CRC Press, Inc., Boca Raton, FL, 2000
• 14: Carlos Rueda , Michael Gertz , Bertram Ludascher , Bernd Hamann, An Extensible Infrastructure for Processing Distributed Geospatial Data Streams, Proceedings of the 18th International Conference on Scientific and Statistical Database Management, p.285-290, July 03-05, 2006 [doi>10.1109/SSDBM.2006.12]
• 15: Timos K. Sellis, Multiple-query optimization, ACM Transactions on Database Systems (TODS), v.13 n.1, p.23-52, March 1988 [doi>10.1145/42201.42203]
• 16: Jie Zhang , Michael Gertz , Demet Aksoy, Spatio-temporal aggregates over raster image data, Proceedings of the 12th annual ACM international workshop on Geographic information systems, November 12-13, 2004, Washington DC, USA [doi>10.1145/1032222.1032230]

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.2 PHYSICAL SCIENCES AND ENGINEERING
      Subjects: Earth and atmospheric sciences

General Terms:
Experimentation, Performance

Keywords:
GIS, query optimization, remotely sensed imagery (RSI)