A maximum entropy approach to species distribution modeling

ABSTRACT

We study the problem of modeling species geographic distributions, a critical problem in conservation biology. We propose the use of maximum-entropy techniques for this problem, specifically, sequential-update algorithms that can handle a very large number of features. We describe experiments comparing maxent with a standard distribution-modeling tool, called GARP, on a dataset containing observation data for North American breeding birds. We also study how well maxent performs as a function of the number of training examples and training time, analyze the use of regularization to avoid overfitting when the number of examples is small, and explore the interpretability of models constructed using maxent.

REFERENCES

• 1: Anderson, R. P., Lew, D., & Peterson, A. T. (2003). Evaluating predictive models of species' distributions: Criteria for selecting optimal models. Ecological Modelling, 162, 211--232.
• 2: Anderson, R. P., & Martíínez-Meyer, E. (2004). Modeling species' geographic distributions for preliminary conservation assessments: an implementation with the spiny pocket mice (Heteromys) of Ecuador. Biological Conservation, 116, 167--179.
• 3: Adam L. Berger , Vincent J. Della Pietra , Stephen A. Della Pietra, A maximum entropy approach to natural language processing, Computational Linguistics, v.22 n.1, p.39-71, March 1996
• 4: Chen, S. F., & Rosenfeld, R. (2000). A survey of smoothing techniques for ME models. IEEE Trans. on Speech and Audio Processing, 8, 37--50.
• 5: Michael Collins , Robert E. Schapire , Yoram Singer, Logistic Regression, AdaBoost and Bregman Distances, Machine Learning, v.48 n.1-3, p.253-285, 2002 [doi>10.1023/A:1013912006537]
• 6: Darroch, J. N., & Ratcliff, D. (1972). Generalized iterative scaling for log-linear models. The Annals of Math. Statistics, 43, 1470--1480.
• 7: Stephen Della Pietra , Vincent Della Pietra , John Lafferty, Inducing Features of Random Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.19 n.4, p.380-393, April 1997 [doi>10.1109/34.588021]
• 8: Dudík, M., Phillips, S. J., & Schapire, R. E. (2004). Performance guarantees for regularized maximum entropy density estimation. Proceedings of the 17th Annual Conference on Computational Learning Theory.
• 9: Elith, J. (2002). Quantitative methods for modeling species habitat: Comparative performance and an application to Australian plants. In S. Ferson and M. Burgman (Eds.), Quantitative methods for conservation biology, 39--58. New York: Springer-Verlag.
• 10: Joshua Goodman, Sequential conditional Generalized Iterative Scaling, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073086]
• 11: Goodman, J. (2003). Exponential priors for maximum entropy models (Technical Report). Microsoft Research. (Available from http://research.microsoft.com/~joshuago/longexponentialprior.ps).
• 12: Hutchinson, G. E. (1957). Concluding remarks. Cold Spring Harbor Symposia on Quantitative Biology, 22, 415--427.
• 13: Robert Malouf, A comparison of algorithms for maximum entropy parameter estimation, proceeding of the 6th conference on Natural language learning, p.1-7, August 31, 2002 [doi>10.3115/1118853.1118871]
• 14: Minka, T. (2001). Algorithms for maximum-likelihood logistic regression (Technical Report). CMU CALD. (Available from http://www.stat.cmu.edu/~minka/papers/logreg.html).
• 15: New, M., Hulme, M., & Jones, P. (1999). Representing twentieth-century space-time climate variability. Part 1: Development of a 1961-90 mean monthly terrestrial climatology. Journal of Climate, 12, 829--856.
• 16: Peterson, A. T. (2001). Predicting species' geographic distributions based on ecological niche modeling. The Condor, 103, 599--605.
• 17: Peterson, A. T., Papes, M., & Kluza, D. A. (2003). Predicting the potential invasive distributions of four alien plant species in North America. Weed Science, 51, 863--868.
• 18: Peterson, A. T., & Robins, C. R. (2003). Using ecological-niche modeling to predict barred owl invasions with implications for spotted owl conservation. Conservation Biology, 17, 1161--1165.
• 19: Peterson, A. T., & Shaw, J. (2003). Lutzomyia vectors for cutaneous leishmaniasis in southern Brazil: ecological niche models, predicted geographic distribution, and climate change effects. International Journal of Parasitology, 33, 919--931.
• 20: Ponder, W. F., Carter, G. A., Flemons, P., & Chapman, R. R. (2001). Evaluation of museum collection data for use in biodiversity assessment. Conservation Biology, 15, 648--657.
• 21: Raxworthy, C. J., Martinez-Meyer, E., Horning, N., Nussbaum, R. A., Schneider, G. E., Ortega-Huerta, M. A., & Peterson, A. T. (2004). Predicting distributions of known and unknown reptile species in Madagascar. Nature, 426, 837--841.
• 22: Salakhutdinov, R., Roweis, S. T., & Ghahramani, Z. (2003). On the convergence of bound optimization algorithms. Uncertainty in Artificial Intelligence 19 (pp. 509--516).
• 23: Sauer, J. R., Hines, J. E., & Fallon, J. (2001). The North American breeding bird survey, results and analysis 1966--2000, Version 2001.2. http://www.mbr-pwrc.usgs.gov/bbs/bbs.html. USGS Patuxent Wildlife Research Center, Laurel, MD.
• 24: Stockwell, D., & Peters, D. (1999). The GARP modelling system: problems and solutions to automated spatial prediction. International Journal of Geographical Information Science, 13, 143--158.
• 25: David R. B. Stockwell , Ian R. Noble, Induction of sets of rules from animal distribution data: a robust and informative method of data analysis, Mathematics and Computers in Simulation, v.33 n.5-6, p.385-390, April 1992
• 26: Stockwell, D. R. B., & Peterson, A. T. (2002). Controlling bias in biodiversity data. In J. M. Scott, P. J. Heglund, M. L. Morrison, J. B. Haufler, M. G. Raphael, W. A. Wall and F. B. Samson (Eds.), Predicting species occurrences: Issues of accuracy and scale, 537--546. Washington, DC: Island Press.
• 27: Thomas, C. D., Cameron, A., Green, R. E., Bakkenes, M., Beaumont, L. J., Collingham, Y. C., Erasmus, B. F. N., de Siqueira, M. F., Grainger, A., Hannah, L., Hughes, L., Huntley, B., van Jaarsveld, A. S., Midgley, G. F., Miles, L., Ortega-Huerta, M. A., Peterson, A. T., Phillips, O. L., & Williams, S. E. (2004). Extinction risk from climate change. Nature, 427, 145--148.
• 28: Wiley, E. O., McNyset, K. M., Peterson, A. T., Robins, C. R., & Stewart, A. M. (2003). Niche modeling and geographic range predictions in the marine environment using a machine-learning algorithm. Oceanography, 16, 120--127.
• 29: Peter M. Williams, Bayesian regularization and pruning using a Laplace prior, Neural Computation, v.7 n.1, p.117-143, Jan. 1995 [doi>10.1162/neco.1995.7.1.117]