Improving particle swarm optimization with differentially perturbed velocity

ABSTRACT

This paper introduces a novel scheme of improving the performance of particle swarm optimization (PSO) by a vector differential operator borrowed from differential evolution (DE). Performance comparisons of the proposed method are provided against (a) the original DE, (b) the canonical PSO, and (c) three recent, high-performance PSO-variants. The new algorithm is shown to be statistically significantly better on a seven-function test suite for the following performance measures: solution quality, time to find the solution, frequency of finding the solution, and scalability.

REFERENCES

• 1: Peter J. Angeline, Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences, Proceedings of the 7th International Conference on Evolutionary Programming VII, p.601-610, March 25-27, 1998
• 2: Blackwell, T. A., Bentley, P. Improvised music with swarms. In Proceedings of IEEE Congress on Evolutionary Computation 2002, vol. 2, Honolulu, HI (2002), 1462--1467.
• 3: Clerc, M., Kennedy, J. The particle swarm - explosion, stability, and convergence in a multidimensional complex space, In IEEE Transactions on Evolutionary Computation (2002) 6(1): 58--73.
• 4: Eberhart, R. C., Shi, Y. Particle swarm optimization: Developments, applications and resources, In Proceedings of IEEE International Conference on Evolutionary Computation, vol. 1 (2001), 81--86.
• 5: Eberhart, R. C., Shi, Y. Comparing inertia weights and constriction factors in particle swarm optimization, In Proceedings of IEEE International Congress on Evolutionary Computation, Vol. 1 (2000), 84--88.
• 6: Higashi, N., Iba, H. Particle swarm optimization with Gaussian mutation, In IEEE Swarm Intelligence Symposium (2003) 72--79.
• 7: Kennedy, J. Bare bones particle swarms, In Proceedings of IEEE Swarm Intelligence Symposium, (2003) 80--87.
• 8: Kennedy, J, Eberhart R. Particle swarm optimization, In Proceedings of IEEE International Conference on Neural Networks, (1995) 1942--1948.
• 9: Kennedy, J. Stereotyping: Improving particle swarm performance with cluster analysis, In Proceedings of IEEE International Conference on Evolutionary Computation, vol. 2 (2000), 303--308.
• 10: Ratnaweera, A., Halgamuge, K.S. Self organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients, In IEEE Transactions on Evolutionary Computation (2004) 8(3): 240--254.
• 11: Shi, Y., Eberhart, R. C. Empirical Study of particle swarm optimization, In Proceedings of IEEE International Conference Evolutionary Computation, Vol. 3 (1999), 101--106.
• 12: Rainer Storn , Kenneth Price, Differential Evolution – A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces, Journal of Global Optimization, v.11 n.4, p.341-359, December 1997 [doi>10.1023/A:1008202821328]
• 13: Ioan Cristian Trelea, The particle swarm optimization algorithm: convergence analysis and parameter selection, Information Processing Letters, v.85 n.6, p.317-325, 31 March 2003 [doi>10.1016/S0020-0190(02)00447-7]
• 14: van den Bergh, F., Engelbrecht, P. A. Effects of swarm size on cooperative particle swarm optimizers, In Proceedings of GECCO-2001, San Francisco CA, (2001), 892--899.
• 15: Xie, X. F., Zhang, W. J., Yang, Z. L. A dissipative particle swarm optimization, In Proceedings of IEEE Congress on Evolutionary Computation (2002), 1456--1461.
• 16: Xie, X. F., Zhang, W. J., Yang, Z. L. Adaptive particle swarm optimization on individual level, In Proceedings of International Conference on Signal Processing (2002), 1215--1218.
• 17: Yao, X., Liu, Y., Lin, G. Evolutionary programming made faster, IEEE Transactions on Evolutionary Computation, vol 3, No 2 (1999), 82--102.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Heuristic methods

Additional Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.6 Optimization
          Subjects: Global optimization
  G.3 PROBABILITY AND STATISTICS
      Subjects: Probabilistic algorithms (including Monte Carlo)

General Terms:
Algorithms

Keywords:
differential evolution, evolutionary computation, particle swarm optimization