Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

In this paper, we describe the use of a modern learning classifier system to a data mining task. In particular, in collaboration with a medical specialist, we apply XCS to a primary breast cancer data set. Our results indicate more effective knowledge discovery than with C4.5.

REFERENCES

• 1: Bacardit, J., & Butz, M. (2004). Data Mining in Learning Classifier Systems: Comparing XCS with GAssis. Advances in Learning Classifier Systems (7th International Workshop, IWLCS 2004), Seattle, USA, LNAI, Springer.
• 2: Gustavo E. A. P. A. Batista , Ronaldo C. Prati , Maria Carolina Monard, A study of the behavior of several methods for balancing machine learning training data, ACM SIGKDD Explorations Newsletter, v.6 n.1, June 2004 [doi>10.1145/1007730.1007735]
• 3: Ester Bernadó i Mansilla , Xavier Llorà , Josep Maria Garrell i Guiu, XCS and GALE: A Comparative Study of Two Learning Classifier Systems on Data Mining, Revised Papers from the 4th International Workshop on Advances in Learning Classifier Systems, p.115-132, July 07-08, 2001
• 4: Blake, C., & Merz, C. (1998). UCI Repository of Machine Learning Databases {online}. Irvine, CA: University of California, Department of Information and Computer Science. Available from: http://www.ics.uci.edu/~mlearn/MLRepository.html {Accessed 2/2004}.
• 5: Bonelli, P. & Parodi (1991) An Efficient Classifier System and its Experimental Comparison with Two Representative Learning Methods on Three Medical Domains. In Proceedings of the 4th International Conference on Genetic Algorithms, pp. 288--295, Morgan Kauffman.
• 6: Martin Butz , Stewart W. Wilson, An Algorithmic Description of XCS, Revised Papers from the Third International Workshop on Advances in Learning Classifier Systems, p.253-272, September 15-16, 2000
• 7: Famili, F., Shen, W., Weber, R., & Simoudis, E. (1997). Data Preprocessing and Intelligent Data Analysis. Intelligent. Data Analysis, 1(1--4), pp 3--23.
• 8: Holland, J.H. (1986). Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems. In Michalski, Carbonell, & Mitchell (eds) Machine learning, an artificial intelligence approach. Morgan Kaufmann.
• 9: Holmes, J. (1997). Discovering risk of disease with a learning classifier system, In: T. Baeck (ed). Proceedings of the Seventh International Conference on Genetic Algorithms (ICGA97). Morgan Kaufmann, San Francisco, CA (1997).
• 10: John H. Holmes, Learning Classifier Systems Applied to Knowledge Discovery in Clinical Research Databases, Learning Classifier Systems, From Foundations to Applications, p.243-262, January 2000
• 11: Holmes J., Bilker W., (2002) The Effect of Missing Data on Learning Classifier System Learning Rate and Classification Performance. IWLCS 2002: 46--60.
• 12: Holmes, J., Sager, J., & Bilker, W. (2004). A Comparison of Three Methods for Covering Missing Data in XCS. Seventh International Workshop on Learning Classifier Systems (IWLCS-2004).
• 13: Japkowicz, N. (2003). Class Imbalances: Are we focusing on the Right Issue? Notes from the ICML Workshop on Learning from Imbalanced Data Sets II.
• 14: Japkowicz, N., and Stephen, S.(2002) The class imbalance problem: a systematic study. Intelligent Data Analysis, 6(5):429--450.
• 15: Japkowicz, N. (2000). The class imbalance problem: Significance and strategies. In Proceedings of the 2000 International Conference on Artificial Intelligence (ICAI '2000).
• 16: Finn V. Jensen , F.V. V. Jensen , F. V. Jensen, Introduction to Bayesian Networks, Springer-Verlag New York, Inc., Secaucus, NJ, 1996
• 17: Taeho Jo , Nathalie Japkowicz, Class imbalances versus small disjuncts, ACM SIGKDD Explorations Newsletter, v.6 n.1, June 2004 [doi>10.1145/1007730.1007737]
• 18: Kharbat, F. (2006) Learning Classifier Systems for Knowledge Discovery in Breast Cancer. PhD Dissertation. University of the West of England, U.K.
• 19: Kharbat, F., Bull, L. & Odeh, M. (2005) Revisiting Genetic Selection in the XCS Learning Classifier System. In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, pp2061--2068.
• 20: Kohavi R. & Provost F. (1998)., Glossary of Terms. Editorial for the Special Issue on Applications of Machine Learning and the Knowledge Discovery Process. 30: 2/3.
• 21: Weiqiang Liu , Peihua Shen , Yingge Qu , Deshen Xia, Fast Algorithm of Support Vector Machines in Lung Cancer Diagnosis, Proceedings of the International Workshop on Medical Imaging and Augmented Reality (MIAR '01), p.188, June 10-12, 2001
• 22: Amy Moore , Albert Hoang, A performance assessment of Bayesian networks as a predictor of breast cancer survival, Second international workshop on Intelligent systems design and application, p.3-8, August 07-08, 2002, Atlanta, Georgia
• 23: Ogunyemi, O., Chlebowski, R., Matloff, E., Schnabel, F., Orr, R., & Col, N. (2004). Creating Bayesian Network Models for Breast Cancer Risk Prediction. Cancer Risk Prediction Models: A Workshop on Development, Evaluation, and Application, pp 20--21.
• 24: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 25: Sierra, B., & Larranaga, P. (1998). Predicting the survival in malignant skin melanoma using Bayesian networks. An empirical comparison between different approaches, Artificial Intelligence in Medicine, 14(1--2), pp 215--230.
• 26: Sorace, J., & Zhan, M. (2003). A data review and re-assessment of ovarian cancer serum proteomic profiling. BMC Bioinformatics 4(24).
• 27: Tan, K., Yu, Q., Heng, C., & Lee, T. (2003). Evolutionary computing for knowledge discovery in medical diagnosis, Artificial Intelligence in Medicine, 27(2), pp 129--154.
• 28: Stewart W. Wilson, Compact Rulesets from XCSI, Revised Papers from the 4th International Workshop on Advances in Learning Classifier Systems, p.197-210, July 07-08, 2001
• 29: Wilson, S., (1995) Classifier Fitness Based on Accuracy. Evolutionary Computing 3: 149--175.
• 30: Ian H. Witten , Eibe Frank, Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 31: Wyatt, D., Bull, L., & Parmee, I. (2004). Building Compact Rulesets for Describing Continuous-Valued Problem Spaces Using a Learning Classifier System. In: I. Parmee (ed). Adaptive Computing in Design and Manufacture VI. Springer, pp 235--248.
• 32: Prati, R., Batista, G., and Monard, M. (2004) Class Imbalances versus Class Overlapping: an Analysis of a Learning System Behavior. In MICAI, pp. 312--321.
• 33: Barandela, R., Valdovinos, R., Scnchez, J., & Ferri, F. (2004). The imbalanced training sample problem: Under or over sampling?. Joint IAPR International Workshops on Structural, Syntactic, and Statistical Pattern Recognition (SSPR/SPR'04). Lecture Notes in Computer Science 3138, Springer-Verlag, pp 806--814.
• 34: John C. Platt, Fast training of support vector machines using sequential minimal optimization, Advances in kernel methods: support vector learning, MIT Press, Cambridge, MA, 1999
• 35: Chunsheng Fu , Lawrence Davis, A Modified Classifier System Compaction Algorithm, Proceedings of the Genetic and Evolutionary Computation Conference, p.920-925, July 09-13, 2002
• 36: Dixon, P., Corne, D., & Oates, M. (2003). A Ruleset Reduction Algorithm for the XCS Learning Classifier System. In: P. Lanzi, W. Stolzmann, and S. Wilson (eds.) Proceedings of the 3rd International Workshop on Learning Classifier Systems. Springer LNCS, pp 20--29.
• 37: Martin V. Butz , David E. Goldberg , Kurian Tharakunnel, Analysis and improvement of fitness exploitation in XCS: bounding models, tournament selection, and bilateral accuracy, Evolutionary Computation, v.11 n.3, p.239-277, Fall 2003 [doi>10.1162/106365603322365298]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Backtracking

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Dynamic programming; Heuristic methods; Scheduling; Graph and tree search strategies; Control theory; Plan execution, formation, and generation

General Terms:
Algorithms, Experimentation, Performance

Keywords:
XCS, classification, data mining, genetic algorithm, learning classifier systems, medical informatics