Computing information gain for spatial data support

ABSTRACT

Widespread use of GPS devices and explosion of remotely sensed geospatial images along with cheap storage devices has resulted in vast amounts of data. More recently, with the advent of wireless technology, a large number of sensor networks have been deployed to monitor many human, biological and natural processes. This poses a challenge in many data rich application domains. The problem now is how best to choose the datasets to solve specific problems. Some of the datasets may be redundant and their inclusion in analysis may not only be time consuming, but may lead to erroneous conclusions. We propose the concept of data support as the basis for efficient, cost-effective and intelligent use of geospatial data in order to reduce uncertainty in the analysis and consequently in the results. Data support is defined as the process of determining the information utility of a data source to help decide which one to include or exclude to improve cost-effectiveness in existing data analysis. In this article we use mutual information as the basis of computing data support. The concept of mutual information is defined in information theory as a measure to compute information gain or loss between two disjoint datasets. We use this to compute the optimal datasets in specific applications. The effectiveness of the approach is demonstrated using an application in the hydrological analysis domain.

REFERENCES

• 1: Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 2006
• 2: Chow, Ven Te. (1964). Handbook of applied hydrology. McGraw-Hill.
• 3: Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
• 4: Kun Deng , Chris Bourke , Stephen Scott , Julie Sunderman , Yaling Zheng, Bandit-Based Algorithms for Budgeted Learning, Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, p.463-468, October 28-31, 2007 [doi>10.1109/ICDM.2007.91]
• 5: Lei Fu , Leen-Kiat Soh , Ashok Samal, Techniques for Computing Fitness of Use (FoU) for Time Series Datasets with Applications in the Geospatial Domain, Geoinformatica, v.12 n.1, p.91-115, March 2008 [doi>10.1007/s10707-007-0025-0]
• 6: Hunter, G. (1998). Managing Uncertainty in GIS, NCGIA Core Curriculum in GIScience, http://www.ncgia.ucsb.edu/giscc/units/u187/u187_f.html, posted February 03, 1998.
• 7: J. Susan Milton , Jesse C. Arnold, Introduction to Probability and Statistics: Principles and Applications for Engineering and the Computing Sciences, McGraw-Hill, Inc., New York, NY, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.1 Systems and Information Theory

General Terms:
Algorithms, Design, Experimentation, Theory, Verification

Keywords:
information gain/loss, spatial data support