A trace-based visual inspection technique to detect errors in simulation models

ABSTRACT

Generation of traces from a simulation model and their analysis is a powerful and common mean to debug simulation models. In this paper, we define a measure of progress for simulation traces and describe how it can be used to detect certain errors. We devise a visual inspection technique based on that measure and discuss several examples to illustrate how one can distinguish normal behavior from irregular, potentially erroneous behavior documented in a trace of a simulation run. The overall approach is implemented and integrated in Traviando, a trace analyzer for debugging stochastic simulation models.

REFERENCES

• 1: Banks, J. 2000. Getting started with AutoMod. 655 Medical Drive, Bountiful, Utah 84010: AutoSimulations, Inc.
• 2: Falko Bause , Heinz Beilner , Markus Fischer , Peter Kemper , Markus Völker, The ProC/B Toolset for the Modelling and Analysis of Process Chains, Proceedings of the 12th International Conference on Computer Performance Evaluation, Modelling Techniques and Tools, p.51-70, April 14-17, 2002
• 3: Falko Bause , Peter Buchholz , Peter Kemper, A Toolbox for Functional and Quantitative Analysis of DEDS, Proceedings of the 10th International Conference on Computer Performance Evaluation: Modelling Techniques and Tools, p.356-359, September 14-18, 1998
• 4: Daniel D. Deavours , Graham Clark , Tod Courtney , David Daly , Salem Derisavi , Jay M. Doyle , William H. Sanders , Patrick G. Webster, The Möbius Framework and Its Implementation, IEEE Transactions on Software Engineering, v.28 n.10, p.956-969, October 2002 [doi>10.1109/TSE.2002.1041052]
• 5: Heiner, M., and P. Deussen. 1996. Petri net based design and analysis of reactive systems. In Proc. 3rd Workshop on Discrete Event Systems (WoDES96), 308--313.
• 6: W. David Kelton , Randall P. Sadowski , Deborah A. Sadowski, Simulation with Arena, McGraw-Hill, Inc., New York, NY, 2002
• 7: Peter Kemper , Carsten Tepper, Automated Analysis of Simulation Traces - Separating Progress from Repetitive Behavior, Proceedings of the Fourth International Conference on Quantitative Evaluation of Systems, p.101-110, September 17-19, 2007 [doi>10.1109/QEST.2007.9]
• 8: Peter Kemper , Carsten Tepper, Trace based analysis of process interaction models, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
• 9: Kemper, P., and C. Tepper. 2005b. Visualizing the dynamic behavior of ProC/B models. In Proc. Simulation and Visualization, ed. T. Schulze, G. Horton, B. Preim, and S. Schlechtweg, 63--74: SCS Publishing House e.V.
• 10: Peter Kemper , Carsten Tepper, Traviando - Debugging Simulation Traces with Message Sequence Charts, Proceedings of the 3rd international conference on the Quantitative Evaluation of Systems, p.135-136, September 11-14, 2006 [doi>10.1109/QEST.2006.58]
• 11: David Krahl, Debugging simulation models, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
• 12: Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
• 13: Deborah A. Sadowski, Tips for successful practice of simulation, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
• 14: Usa Sammapun , Insup Lee , Oleg Sokolsky, RT-MaC: Runtime Monitoring and Checking of Quantitative and Probabilistic Properties, Proceedings of the 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications, p.147-153, August 17-19, 2005 [doi>10.1109/RTCSA.2005.84]
• 15: Woodside, C. M., and Y. Li. 1991. Performance Petri net analysis of communications protocol software by delay-equivalent aggregation. In Proc. PNPM, 64--73: IEEE.