Actively learning level-sets of composite functions

ABSTRACT

Scientists frequently have multiple types of experiments and data sets on which they can test the validity of their parameterized models and locate plausible regions for the model parameters. By examining multiple data sets, scientists can obtain inferences which typically are much more informative than the deductions derived from each of the data sources independently. Several standard data combination techniques result in target functions which are a weighted sum of the observed data sources. Thus, computing constraints on the plausible regions of the model parameter space can be formulated as finding a level set of a target function which is the sum of observable functions. We propose an active learning algorithm for this problem which selects both a sample (from the parameter space) and an observable function upon which to compute the next sample. Empirical tests on synthetic functions and on real data for an eight parameter cosmological model show that our algorithm significantly reduces the number of samples required to identify the desired level-set.

REFERENCES

• 1: Dana Angluin, Queries and Concept Learning, Machine Learning, v.2 n.4, p.319-342, April 1988 [doi>10.1023/A:1022821128753]
• 2: Bennett, C. L., et al. (2003). First-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Foreground Emission. Astrophysical Journal Supplemental, 148, 97--117.
• 3: Brent Bryan , Jeff Schneider, Actively learning specific function properties with applications to statistical inference, Carnegie Mellon University, Pittsburgh, PA, 2007
• 4: Bryan, B., et al. (2005). Active learning for identifying function threshold boundaries. In Advances in neural information processing systems 18. Cambridge, MA: MIT Press.
• 5: Cressie, N. (1991). Statistics for spatial data. New York: Wiley.
• 6: Davis, T. M., et al. (2007). Scrutinizing Exotic Cosmological Models Using ESSENCE Supernova Data Combined with Other Cosmological Probes. Astrophysical Journal, 666, 716.
• 7: Fisher, R. (1932). Statistical methods for research workers. London: Oliver and Boyd. 4 edition.
• 8: Carlos Guestrin , Andreas Krause , Ajit Paul Singh, Near-optimal sensor placements in Gaussian processes, Proceedings of the 22nd international conference on Machine learning, p.265-272, August 07-11, 2005, Bonn, Germany [doi>10.1145/1102351.1102385]
• 9: Hedges, L. V. (1985). Statistical methods for meta-analysis. Academic Press.
• 10: Kristian Kersting , Christian Plagemann , Patrick Pfaff , Wolfram Burgard, Most likely heteroscedastic Gaussian process regression, Proceedings of the 24th international conference on Machine learning, p.393-400, June 20-24, 2007, Corvalis, Oregon [doi>10.1145/1273496.1273546]
• 11: David J. C. MacKay, Information-based objective functions for active data selection, Neural Computation, v.4 n.4, p.590-604, July 1992 [doi>10.1162/neco.1992.4.4.590]
• 12: Ramakrishnan, N., et al. (2005). Gaussian processes for active data mining of spatial aggregates. Proceedings of the SIAM International Conference on Data Mining.
• 13: Carl Edward Rasmussen , Christopher K. I. Williams, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning), The MIT Press, 2005
• 14: Santner, T. J., Williams, B. J., & Notz, W. (2003). The design and analyis of computer experiments. Springer. 1 edition.
• 15: Shmueli, G., & Fienberg, S. E. (2006). Statistical methods in counterterrorism, chapter Current and Potential Statistical Methods for Monitoring Multiple Data Streams for Biosurveillance, 109. New York: Springer.
• 16: Spergel, D. et al. (2003). First-Year Wilkinson Microwave Anisotropy Probe Observations: Determination of Cosmological Parameters. Astrophysical Journal Supplemental, 148.
• 17: Tegmark, M., et al. (2006). Cosmological constraints from the SDSS luminous red galaxies. Physical Review D, 74, 123507.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.3 Deduction and Theorem Proving
          Subjects: Inference engines
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis
      I.6.5 Model Development
          Subjects: Modeling methodologies

General Terms:
Algorithms, Design, Performance, Theory