Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

We propose a local (or lazy) version of the naive credal classifier. The latter is an extension of naive Bayes to imprecise probability developed to issue reliable classifications despite small amounts of data, which may then be carrying highly uncertain information about a domain. Reliability is maintained because credal classifiers can issue set-valued classifications on instances that are particularly difficult to classify. We show by extensive experiments that the local classifier outperforms the original one, both in terms of accuracy of classification and because it leads to stronger conclusions (i.e., set-valued classifications made by fewer classes). By comparing the local credal classifier with a local version of naive Bayes, we also show that the former reliably deals with instances which are difficult to classify, unlike the local naive Bayes which leads to fragile classifications.

REFERENCES

• 1: Mauro Birattari , Gianluca Bontempi , Hugues Bersini, Lazy learning meets the recursive least squares algorithm, Proceedings of the 1998 conference on Advances in neural information processing systems II, p.375-381, July 1999
• 2: G. Corani and M. Zaffalon. JNCC2: The Java Implementation Of Naive Credal Classifier 2. Journal of Machine Learning Research, 9:2695--2698, 2008.
• 3: Giorgio Corani , Marco Zaffalon, Learning Reliable Classifiers From Small or Incomplete Data Sets: The Naive Credal Classifier 2, The Journal of Machine Learning Research, 9, p.581-621, 6/1/2008
• 4: I. D. Dinov. Socr: Statistics online computational resource. Journal of Statistical Software, 16(11):1--16, 10 2006.
• 5: Pedro Domingos , Michael Pazzani, On the Optimality of the Simple Bayesian Classifier under Zero-One Loss, Machine Learning, v.29 n.2-3, p.103-130, Nov./Dec. 1997 [doi>10.1023/A:1007413511361]
• 6: U. M. Fayyad and K. B. Irani. Multi-interval Discretization of Continuous-valued Attributes for Classification Learning. In Proceedings of the 13th International Joint Conference on Artificial Intelligence, pages 1022--1027, San Francisco, CA, 1993. Morgan Kaufmann.
• 7: E. Frank, M. Hall, and B. Pfahringer. Locally weighted naive Bayes. In Proceedings of the 19th Conference on Uncertainty in Artificial Intelligence, pages 249--256. Morgan Kaufmann, 2003.
• 8: Jerome H. Friedman, On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality, Data Mining and Knowledge Discovery, v.1 n.1, p.55-77, 1997 [doi>10.1023/A:1009778005914]
• 9: Nir Friedman , Dan Geiger , Moises Goldszmidt, Bayesian Network Classifiers, Machine Learning, v.29 n.2-3, p.131-163, Nov./Dec. 1997 [doi>10.1023/A:1007465528199]
• 10: Grigorios Tsoumakas , Ioannis Vlahavas, Random k-Labelsets: An Ensemble Method for Multilabel Classification, Proceedings of the 18th European conference on Machine Learning, September 17-21, 2007, Warsaw, Poland [doi>10.1007/978-3-540-74958-5_38]
• 11: Peter Van Der Putten , Maarten Van Someren, A Bias-Variance Analysis of a Real World Learning Problem: The CoIL Challenge 2000, Machine Learning, v.57 n.1-2, p.177-195, October-November 2004 [doi>10.1023/B:MACH.0000035476.95130.99]
• 12: P. Walley. Statistical Reasoning with Imprecise Probabilities. Chapman and Hall, New York, 1991.
• 13: Dietrich Wettschereck , David W. Aha , Takao Mohri, A Review and Empirical Evaluation of Feature Weighting Methods for aClass of Lazy Learning Algorithms, Artificial Intelligence Review, v.11 n.1-5, p.273-314, Feb. 1997 [doi>10.1023/A:1006593614256]
• 14: M. Zaffalon. Statistical inference of the naive credal classifier. In G. de Cooman, T. L. Fine, and T. Seidenfeld, editors, ISIPTA '01: Proceedings of the Second International Symposium on Imprecise Probabilities and Their Applications, pages 384--393, The Netherlands, 2001. Shaker.
• 15: Xie Zhipeng , Wynne Hsu , Liu Zongtian , Mong-Li Lee, SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning, Proceedings of the 6th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, p.104-114, May 06-08, 2002

INDEX TERMS

Keywords:
imprecise probabilities, lazy credal classifier, naive credal classifier