Self-adaptive mutation in XCSF

ABSTRACT

Recent advances in XCS technology have shown that self-adaptive mutation can be highly useful to speed-up the evolutionary progress in XCS. Moreover, recent publications have shown that XCS can also be successfully applied to challenging real-valued domains including datamining, function approximation, and clustering. In this paper, we combine these two advances and investigate self-adaptive mutation in the XCS system for function approximation with hyperellipsoidal condition structures, referred to as XCSF in this paper. It has been shown that XCSF solves function approximation problems with an accuracy, noise robustness, and generalization capability comparable to other statistical machine learning techniques and that XCSF outperforms simple clustering techniques to which linear approximations are added. This paper shows that the right type of self-adaptive mutation can further improve XCSF's performance solving problems more parameter independent and more reliably. We analyze various types of self-adaptive mutation and show that XCSF with self-adaptive mutation ranges,differentiated for the separate classifier condition values, yields most robust performance results. Future work may further investigate the properties of the self-adaptive values and may integrate advanced self-adaptation techniques.

REFERENCES

• 1: T. Bäck and H.-P. Schwefel. Evolution strategies I: Variants and their computational implementation. In G. Winter, J. Périaux, M. Gal'an, and P. Cuesta, editors, Genetic algorithms in engineering and computer science, chapter 7, pages 111--126. John Wiley & Sons, Chichester, 1995.
• 2: L. B. Booker , D. E. Goldberg , J. H. Holland, Classifier systems and genetic algorithms, Artificial Intelligence, v.40 n.1-3, p.235-282, Sep. 1989 [doi>10.1016/0004-3702(89)90050-7]
• 3: L. Bull. On lookahead and latent learning in simple lcs. In J. Bacardit, E. Bernadó-Mansilla, and M. V. Butz, editors, Learning Classifier Systems. International Workshops, IWLCS 2006-2007. Springer-Verlag, Berlin Heidelberg, 2008.
• 4: L. Bull, J. Hurst, and A. Tomlinson. Self-adaptive mutation in classifier system controllers. From Animals to Animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, pages 460--467, 2000.
• 5: M. V. Butz. Anticipatory learning classifier systems. Kluwer Academic Publishers, Boston, MA, 2002.
• 6: Martin V. Butz, Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system, Proceedings of the 2005 conference on Genetic and evolutionary computation, June 25-29, 2005, Washington DC, USA [doi>10.1145/1068009.1068320]
• 7: M. V. Butz, T. Kovacs, P. L. Lanzi, and S.W.Wilson. Toward a theory of generalization and learning in XCS. IEEE Transactions on Evolutionary Computation, 8:28--46, 2004.
• 8: Martin V. Butz , Pier Luca Lanzi , Stewart W. Wilson, Hyper-ellipsoidal conditions in XCS: rotation, linear approximation, and solution structure, Proceedings of the 8th annual conference on Genetic and evolutionary computation, July 08-12, 2006, Seattle, Washington, USA [doi>10.1145/1143997.1144237]
• 9: M. V. Butz, M. Pelikan, X. Llorà, and D. E. Goldberg. Automated global structure extraction for effective local building block processing in XCS. Evolutionary Computation, 14:345--380, 2006.
• 10: Nikolaus Hansen , Andreas Ostermeier, Completely Derandomized Self-Adaptation in Evolution Strategies, Evolutionary Computation, v.9 n.2, p.159-195, June 2001 [doi>10.1162/106365601750190398]
• 11: J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. In D. A. Waterman and F. Hayes-Roth, editors, Pattern directed inference systems, pages 313--329. Academic Press, New York, 1978.
• 12: Jacob Hurst , Larry Bull, A Self-Adaptive XCS, Revised Papers from the 4th International Workshop on Advances in Learning Classifier Systems, p.57-73, July 07-08, 2001
• 13: Jacob Hurst , Larry Bull, A Neural Learning Classifier System with Self-Adaptive Constructivism for Mobile Robot Control, Artificial Life, v.12 n.3, p.353-380, July 2006 [doi>10.1162/artl.2006.12.3.353]
• 14: Christian Igel , Nikolaus Hansen , Stefan Roth, Covariance Matrix Adaptation for Multi-objective Optimization, Evolutionary Computation, v.15 n.1, p.1-28, Spring 2007 [doi>10.1162/evco.2007.15.1.1]
• 15: Stewart W. Wilson, Classifier fitness based on accuracy, Evolutionary Computation, v.3 n.2, p.149-175, Summer 1995 [doi>10.1162/evco.1995.3.2.149]
• 16: S. W. Wilson. Function approximation with a classifier system. Proceedings of the Third Genetic and Evolutionary Computation Conference (GECCO-2001), pages 974--981, 2001.
• 17: Stewart W. Wilson, Classifiers that approximate functions, Natural Computing: an international journal, v.1 n.2-3, p.211-234, June 2002 [doi>10.1023/A:1016535925043]

INDEX TERMS

Primary Classification:
  F. Theory of Computation
  F.1 COMPUTATION BY ABSTRACT DEVICES
      F.1.1 Models of Computation
          Subjects: Self-modifying machines (e.g., neural networks)

General Terms:
Algorithms, Performance

Keywords:
LCS, XCS, mutation, self-adaptation