Parameter estimation for asymptotic regression model by particle swarm optimization

ABSTRACT

Asymptotic regression model (ARM) has been widely used in the field of agriculture, biology and engineering, especially in agriculture. Parameter estimation for ARM is a significant, challenging and difficult issue. The modern heuristic algorithm has been proved to be a highly effective and successful technique in parameter estimation of nonlinear models. As a novel evolutionary computation paradigm based on social behavior of bird flocking or fish schooling, particle swarm optimization (PSO) has shown outstanding performance in many real-world applications, for it is conceptually simple and practically easy to be implemented. In the present work, parameters of ARM are estimated on the basis of PSO for the first time. Firstly, PSO is compared with evolutionary algorithm (EA) on seven groups of actual data; PSO, while using less number of function evaluations, can find a parameter set as well as EA. Secondly, we estimate one-dimensional, two-dimensional and three-dimensional parameter by fixing two, one and zero of all parameters of ARM, respectively. Finally, how sampling range and data with Gaussian noise influence on the performance of PSO is considered. Experimental results show that PSO is a stable, reliable and effective method in parameter estimation for ARM and it's robust to noise.

REFERENCES

• 1: V. Alvarez, R. Larico, Y. Ianos, and M. Aznar. Parameter estimation for vle calculation by global minimization: The genetic algorithm. Brazilian Journal of Chemical Engineering , 25(2):409--418,Apr./June 2008.
• 2: M. Awadallah. Parameter estimation of induction machines from nameplate data using particle swarm optimization and genetic algorithm techniques. Electric Power Components and Systems,36(8):801--814, August 2008.
• 3: D. Bates and D. Watts. Nonlinear Regression Analysis and Its Applications. John Wiley & Sons, New York, 1988.
• 4: Z. Chan, H. Ngan, Y. Fung, and A. Rad. An advanced evolutionary algorithm for parameter estimation of the discrete kalman filter. Computer Physics Communications, 142(1):248--254, December2001.
• 5: R. Fletcher, Practical methods of optimization; (2nd ed.), Wiley-Interscience, New York, NY, 1987
• 6: F. Gao and H. Tong. Parameter estimation for chaotic system based on particle swarm optimization. Acta Physica Sinica, 55(2):577--582, February 2006.
• 7: M. Gill, Y. Kaheil, A. Khalil, M. McKee, and L. Bastidas. Multi-objective particle swarm optimization for parameter estimation in hydrology. Water Resources Research, 42(7):W07417, July2006.
• 8: Orland R. Gonzalez , Christoph Küper , Kirsten Jung , Prospero C. Naval , Eduardo Mendoza, Parameter estimation using Simulated Annealing for S-system models of biochemical networks, Bioinformatics, v.23 n.4, p.480-486, February 2007 [doi>10.1093/bioinformatics/btl522]
• 9: Q. He, L. Wang, and B. Liu. Parameter estimation for chaotic systems by particle swarm optimization. Chaos, Solitons & Fractals,34(2):654--661, October 2007.
• 10: D. Jain, S. Ilyas, P. Pathare, S., Prasad, and H. Singh. Development of mathematical model for cooling the fish with ice. Journal of Food Engineering, 71(3):324--329, July 2005.
• 11: S. Kannan, S. Slochanal, and N. Padhy. Application and comparison of metaheuristic techniques to generation expansion planning problem. IEEE Transactions on Power Systems, 20(1):466--475, February2005.
• 12: J. Kennedy and R. Eberhart. Particle swarm optimization. In Proceedings of IEEE International Conference on Neural Network, pages 1942--1948. IEEE, November 1995.
• 13: James Kennedy , Russell C. Eberhart, Swarm intelligence, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
• 14: Arash Massoudieh , Ann Mathew , Timothy R. Ginn, Column and batch reactive transport experiment parameter estimation using a genetic algorithm, Computers & Geosciences, v.34 n.1, p.24-34, January, 2008 [doi>10.1016/j.cageo.2007.02.005]
• 15: John C. Nash , Mary Walker-Smith, Nonlinear parameter estimation: an integrated system in BASIC, Marcel Dekker, Inc., New York, NY, 1987
• 16: Z. Pan, L. Kang, and Y. Chen. Evolutionary computation. Tsinghua University Press, Beijing, 1998.
• 17: D. Ratkowsky. Nonlinear regression modelling: A unified practical approach. Marcel Dekker, New York, 1983.
• 18: R.L.Pagano, V. Calado, F. Tavares, and E. Biscaia. Cure kinetic parameter estimation of thermo setting resins with isothermal data by using particle swarm optimization. European Polymer Journal,44(8):2678--2686, August 2008.
• 19: M. Schwaab, E. Biscaia, J. L. Monteiro, and J. C. Pinto. Nonlinear parameter estimation through particle swarm optimization. Chemical Engineering Science, 63(6):1542--1552, March 2008.
• 20: G. Seber. Linear Regression Analysis. John Wiley & Sons, New York,1977.
• 21: J. Wang and D. Huang. Parameter estimation for chaotic systems based on hybrid differential evolution algorithm. Acta Physica Sinica, 57(5):2755--2760, May 2008.
• 22: Shiwei Wang , D. L. Yu, Adaptive RBF network for parameter estimation and stable air-fuel ratio control, Neural Networks, v.21 n.1, p.102-112, January, 2008 [doi>10.1016/j.neunet.2007.10.006]
• 23: Rui Xu , Donald Wunsch II , Ronald Frank, Inference of Genetic Regulatory Networks with Recurrent Neural Network Models Using Particle Swarm Optimization, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), v.4 n.4, p.681-692, October 2007 [doi>10.1109/TCBB.2007.1057]

INDEX TERMS

Primary Classification:
  G. Mathematics of Computing
  G.1 NUMERICAL ANALYSIS
      G.1.6 Optimization
          Subjects: Global optimization

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.8 Problem Solving, Control Methods, and Search
          Subjects: Heuristic methods

General Terms:
Algorithms

Keywords:
asymptotic regression model, nonlinear system, parameter estimation, particle swarm optimization