Independent verification and validation: a missing link in simulation methodology?

ABSTRACT

Independent verification and validation (IV&V) is a powerful tool that can be used to mitigate the increasing complexities associated with an ever-expanding set of modeling and simulation problems. In this paper we discuss the use of independent V&V within the modeling and simulation community. Literature reviews and conversations with experienced technical managers serve as a basis for our conjecture that (a) validation is the major focus of most modeling and simulation efforts, (b) verification plays only a secondary role, and (c) independent V&V is, for all practical purposes, being ignored. In an effort to raise the awareness of the benefits and applicability of independent V&V within the modeling and simulation community, we describe in a step-by-step fashion the application of independent V&V to one particular life cycle model of a simulation study.

REFERENCES

• 1: Michael P. Bailey , William G. Kemple, The scientific method of choosing model fidelity, Proceedings of the 24th conference on Winter simulation, p.791-797, December 13-16, 1992, Arlington, Virginia, United States [doi>10.1145/167293.167723]
• 2: Balci, O. (1994). Validation Verification, and Testing Techniques Throughout the Cycle of a Simulation Study. Annals of Operations Research 53, 121-173.
• 3: Paul Bratley , Bennett L. Fox , Linus E. Schrage, A guide to simulation (2nd ed.), Springer-Verlag New York, Inc., New York, NY, 1987
• 4: Cassandras, C.G. (1993). Discrete Event Systems - Modeling and Performance Analysis. Homewood, IL: Aksen Associates Incorporated.
• 5: Don Caughlin, Verification, validation, and accreditation (VV&A) of models and simulations through reduced order metamodels, Proceedings of the 27th conference on Winter simulation, p.1405-1412, December 03-06, 1995, Arlington, Virginia, United States [doi>10.1145/224401.224832]
• 6: Ruth M. Davies , Robert M. O'Keefe, Simulation modelling with Pascal, Prentice Hall International (UK) Ltd., Hertfordshire, UK, 1989
• 7: Zaven A. Karian , Edward J. Dudewicz, Modern statistical, systems, and GPSS simulation: the first course, Computer Science Press, Inc., New York, NY, 1990
• 8: George B. Kleindorfear , Ram Geneshan, The philosophy of science and validation in simulation, Proceedings of the 25th conference on Winter simulation, p.50-57, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256582]
• 9: Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
• 10: Gaynor Legge , Dana L. Wyatt, A software mechanism to enhance simulation model validity, Proceedings of the 24th conference on Winter simulation, p.798-806, December 13-16, 1992, Arlington, Virginia, United States [doi>10.1145/167293.167726]
• 11: Robert O. Lewis, Independent verification & validation: a life cycle engineering process for quality software, John Wiley & Sons, Inc., New York, NY, 1992
• 12: Nance, R.E. (1994). The Conical Methodology and the Evolution of Simulation Model Development. Annals of Operations Research 53, 1-46.
• 13: Dale K. Pace, Naval modeling and simulation verification, validation, and accreditation, Proceedings of the 25th conference on Winter simulation, p.1077-1080, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256966]
• 14: Sheldon M. Ross, A Course in Simulation, Prentice Hall PTR, Upper Saddle River, NJ, 1990
• 15: Robert G. Sargent, Verification and validation of simulation models, Proceedings of the 26th conference on Winter simulation, p.77-87, December 11-14, 1994, Orlando, Florida, United States
• 16: Schmben, L.W. (1992). SIGMA: Graphical Simulation Modeling Program. San Francisco, CA: The Scientific Press.
• 17: Enver Yücesan , Sheldon H. Jacobson, Building correct simulation models is difficult, Proceedings of the 24th conference on Winter simulation, p.783-790, December 13-16, 1992, Arlington, Virginia, United States [doi>10.1145/167293.167720]
• 18: Bernard P. Zeigler, Object-oriented simulation with hierarchical, modular models: intelligent agents and endomorphic systems, Academic Press Professional, Inc., San Diego, CA, 1990