Simulation versus analytic-numeric methods: illustrative examples

ABSTRACT

Performance along with dependability analysis is a tremendous challenge in the design or improvement of modern complex systems. Two different classes of solution methods are generally used: analytic-numeric methods and simulation methods. As most of the literature explains, the choice between them depends more on the analyst's background than on the system itself. In this paper, we illustrate the advantages and drawbacks of each method on real problems and compare the results. Finally we conclude the paper providing some hints to choose a solution method depending on the model. We use SPNP, a Petri net analysis package, and CSIM 19, as simulation package to model and evaluate systems.

REFERENCES

• 1: CSIM 19 Simulator: http://www.mesquite.com/, 2005.
• 2: M. Ajmone Marsan, G. Balbo, G. Conte, S. Donatelli, and G. Franceschinis. Modelling with Generalized Stochastic Petri Nets. John Wiley & Sons, 1995.
• 3: Marco Ajmone Marsan , Gianni Conte , Gianfranco Balbo, A class of generalized stochastic Petri nets for the performance evaluation of multiprocessor systems, ACM Transactions on Computer Systems (TOCS), v.2 n.2, p.93-122, May 1984 [doi>10.1145/190.191]
• 4: J. Banks, J. S. Carson, B. L. Nelson, and D. M. Nicol. Discrete-Event System Simulation. Prentice Hall, NJ, third edition, 2001.
• 5: A. Bobbio , V. G. Kulkarni , A. Puliafito , M. Telek , K. S. Trivedi, Preemptive repeat identical transitions in Markov regenerative stochastic Petri nets, Proceedings of the Sixth International Workshop on Petri Nets and Performance Models, p.113, October 03-06, 1995
• 6: Cheng-Shang Chang , Philip Heidelberger , Perwez Shahabuddin, Fast simulation of packet loss rates in a shared buffer communications switch, ACM Transactions on Modeling and Computer Simulation (TOMACS), v.5 n.4, p.306-325, Oct. 1995 [doi>10.1145/226275.226277]
• 7: Hoon Choi , Vidyadhar G. Kulkarni , Kishor S. Trivedi, Markov regenerative stochastic Petri nets, Performance Evaluation, v.20 n.1-3, p.337-357, May 1994
• 8: Hoon Choi , Vidyadhar G. Kulkarni , Kishor S. Trivedi, Transient Analysis of Deterministic and Stochastic Petri Nets, Proceedings of the 14th International Conference on Application and Theory of Petri Nets, p.166-185, June 21-25, 1993
• 9: G. Ciardo, A. Blakemore, P. Chimento, J. Muppala, and K. Trivedi. Automated Generation and Analysis of Markov Reward Models using Stochatic Reward Nets. In C. Meyer and R. Plemmons, editors, Linear Algebra, Markov Chains and Queuing Models, volume 48 of IMA Volumes in Mathematics and its Applications, pages 145--191. Springer-Verlag, Heidelberg, 1993.
• 10: Gianfranco Ciardo , Jogesh K. Muppala , Kishor S. Trivedi, SPNP: Stochastic Petri Net Package, The Proceedings of the Third International Workshop on Petri Nets and Performance Models, p.142-151, December 11-13, 1989
• 11: Gianfranco Ciardo , David M. Nicol , Kishor S. Trivedi, Discrete-Event Simulation of Fluid Stochastic Petri Nets, IEEE Transactions on Software Engineering, v.25 n.2, p.207-217, March 1999 [doi>10.1109/32.761446]
• 12: Gianfranco Ciardo , Kishor S. Trivedi, A decomposition approach for stochastic reward net models, Performance Evaluation, v.18 n.1, p.37-59, July 1993 [doi>10.1016/0166-5316(93)90026-Q]
• 13: G. Fishman. Monte Carlo: Concepts, Algorithms and Applications. Springer-Verlag, 1996.
• 14: Christophe Hirel , Robin A. Sahner , Xinyu Zang , Kishor S. Trivedi, Reliability and Performability Modeling Using SHARPE 2000, Proceedings of the 11th International Conference on Computer Performance Evaluation: Modelling Techniques and Tools, p.345-349, March 27-31, 2000
• 15: Christophe Hirel , Bruno Tuffin , Kishor S. Trivedi, SPNP: Stochastic Petri Nets. Version 6.0, Proceedings of the 11th International Conference on Computer Performance Evaluation: Modelling Techniques and Tools, p.354-357, March 27-31, 2000
• 16: O. C. Ibe , H. Choi , K. S. Trivedi, Performance Evaluation of Client-Server Systems, IEEE Transactions on Parallel and Distributed Systems, v.4 n.11, p.1217-1229, November 1993 [doi>10.1109/71.250101]
• 17: Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
• 18: Y. Liu, Y. Ma, L. H. Han, J. J, and K. S. Trivedi. A proactive approach towards always-on availability in broadband cable networks. Computer Communications, 28(1):51--64, January 2005.
• 19: M. Malhotra, J. Muppala, and K. Trivedi. Stiffness-tolerant methods for transient analysis of stiff Markov chains. Microelectronics Reliability, 34(11):1825--1841, 1994.
• 20: J. Muppala and K. Trivedi. Composite Performance and Availability Analysis using a Hierarchy of Stochastic Reward Nets. In G. Balbo and G. Serazzi, editors, Computer Performance Evaluation, Modelling Techniques and Tools, pages 335--350. Elsevier, Amsterdam, 1992.
• 21: M. Neuts and K. Meier. On the use of phase type distributions in reliability modelling of systems with two components. Oper. Res. Spektrum, 2(4):227--234, 1981.
• 22: James Lyle Peterson, Petri Net Theory and the Modeling of Systems, Prentice Hall PTR, Upper Saddle River, NJ, 1981
• 23: W. J. Stewart. Introduction to the Numerical Solution of Markov Chains. Princeton University Press, 1994.
• 24: Kishor S. Trivedi, Probability and statistics with reliability, queuing and computer science applications, John Wiley and Sons Ltd., Chichester, UK, 2001
• 25: Bruno Tuffin , Kishor S. Trivedi, Implementation of Importance Splitting Techniques in Stochastic Petri Net Package, Proceedings of the 11th International Conference on Computer Performance Evaluation: Modelling Techniques and Tools, p.216-229, March 27-31, 2000

INDEX TERMS

Keywords:
analytic-numeric methods, performance evaluation, simulation