Validation and verification of simulation models

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Validation and verification of simulation models

Full text

Pdf (90 KB)

Source

Winter Simulation Conference archive
Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future - Volume 1 table of contents

Phoenix, Arizona, United States

Pages: 39 - 48

Year of Publication: 1999

ISBN:0-7803-5780-9

Author

Robert G. Sargent

Simulation Research Group, Department of Electrical Engineering and Computer Science, College of Engineering and Computer Science, Syracuse University, Syracuse, NY

Sponsors

ACM: Association for Computing Machinery
SIGSIM: ACM Special Interest Group on Simulation and Modeling

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 10, Downloads (12 Months): 82, Citation Count: 13

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/324138.324148 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Anderson, H. A. and R. G. Sargent. 1974. An Investigation into Scheduling for an Interactive Computer System, IBM Journal of Research and Development, 18, 2, pp. 125-137.
	2	O. Balci, How to assess the acceptability and credibility of simulation results, Proceedings of the 21st conference on Winter simulation, p.62-71, December 04-06, 1989, Washington, D.C., United States [doi>10.1145/76738.76746]
	3	Osman Balci, Principles and techniques of simulation validation, verification, and testing, Proceedings of the 27th conference on Winter simulation, p.147-154, December 03-06, 1995, Arlington, Virginia, United States [doi>10.1145/224401.224456]
	4	Osman Balci , Robert G. Sargent, A methodology for cost-risk analysis in the statistical validation of simulation models, Communications of the ACM, v.24 n.4, p.190-197, April 1981 [doi>10.1145/358598.358609]
	5	Balci, O. and R. G. Sargent. 1982a. Validation of Multivari-ate Response Simulation Models by Using Hotelling's Two-Sample T 2 Test, Simulation, 39, 6, pp. 185-192.
	6	Osman Balci , Robert G. Sargent, Some examples of simulation model validation using hypothesis testing, Proceedings of the 14th conference on Winter Simulation, December 06-08, 1982, San Diego, California
	7	Osman Balci , Robert G. Sargent, Validation fo Multivariate Response Trace-driven Simulation Models, Proceedings of the 9th International Symposium on Computer Performance Modelling, Measurement and Evaluation, p.309-323, May 25-27, 1983
	8	Balci, O. and R. G. Sargent. 1984a. A Bibliography on the Credibility Assessment and Validation of Simulation and Mathematical Models, Simuletter, 15, 3, pp. 15-27.
	9	Balci, O. and R. G. Sargent. 1984b. Validation of Simu-lation Models via Simultaneous Confidence Intervals, American Journal of Mathematical and Management Science, 4, 3, pp. 375-406.
	10	Banks, J., J. S. Carson II, and B. L. Nelson. 1996. Discrete-Event System Simulation, 2nd Ed., Prentice-Hall, En-glewood Cliffs, N.J.
	11	Banks, J., D. Gerstein, and S. P. Searles. 1988. Model-ing Processes, Validation, and Verification of Complex Simulations: A Survey, Methodology and Validation, Simulation Series, Vol. 19, No. 1, The Society for Computer Simulation, pp. 13-18.
	12	DODSimulations: Improved Assessment Procedures Would Increase the Credibility of Results. 1987. U. S. General Accounting Office, PEMD-88-3.
	13	Fairley, R. E. 1976. Dynamic Testing of Simulation Soft-ware, Proc. of the 1976 Summer Computer Simulation Conf., Washington, D.C., pp. 40-46.
	14	Gass, S. I. 1983. Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis, Operations Research, 31, 4, pp. 601-663.
	15	Gass, S. I. 1984. Documenting a Computer-Based Model, Interfaces, 14, 3, pp. 84-93.
	16	Gass, S. I. 1993. Model Accreditation: A Rationale and Process for Determining a Numerical Rating, European Journal of Operational Research, 66, 2, pp. 250-258.
	17	Gass, S. I. and L. Joel. 1987. Concepts of Model Con-fidence, Computers and Operations Research,8,4, pp. 341-346.
	18	Gass, S. I. and B. W. Thompson. 1980. Guidelines for Model Evaluation: An Abridged Version of the U.S. General Accounting Office Exposure Draft, Operations Research, 28, 2, pp. 431-479.
	19	James Lee Johnson, Probability and Statistics for Computer Science, John Wiley & Sons, Inc., New York, NY, 2003
	20	Jack P C Kleijnen, Statistical tools for simulation practitioners, Marcel Dekker, Inc., New York, NY, 1986
	21	George B. Kleindorfear , Ram Geneshan, The philosophy of science and validation in simulation, Proceedings of the 25th conference on Winter simulation, p.50-57, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256582]
	22	Peter L. Knepell , Deborah Arangno, Simulation Validation - a Confidence Assessment Methodology, IEEE Computer Society Press, Los Alamitos, CA, 1993
	23	Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
	24	Naylor, T. H. and J. M. Finger. 1967. Verification of Computer Simulation Models, Management Science, 14, 2, pp. B92-B101.
	25	Tuncer I. Ören, Concepts and criteria to assess acceptability of simulation studies: a frame of reference, Communications of the ACM, v.24 n.4, p.180-189, April 1981 [doi>10.1145/358598.358605]
	26	Rao, M. J. and R. G. Sargent. 1988. An advisory System for Operational Validity, Artificial Intelligence and Simulation: The Diversity of Applications, ed. T. Hensen, Society for Computer Simulation, San Diego, CA, pp. 245-2250.
	27	Robert G. Sargent, Validation of simulation models, Proceedings of the 11th conference on Winter simulation, p.497-503, December 03-05, 1979, San Diego, CA, United States
	28	Sargent, R. G. 1981. An Assessment Procedure and a Set of Criteria for Use in the Evaluation of Computerized Models and Computer-Based Modelling Tools, Final Technical Report RADC-TR-80-409.
	29	Sargent, R. G. 1982. Verification and Validation of Simula-tion Models, Chapter IX in Progress in Modelling and Simulation, ed. F. E. Cellier, Academic Press, London, pp. 159-169.
	30	Sargent, R. G. 1984. Simulation Model Validation, Simula-tion and Model-Based Methodologies: An Integrative View, ed. Oren, et al., Springer-Verlag.
	31	Robert G. Sargent, An expository on verification and validation of simulation models, Proceedings of the 17th conference on Winter simulation, p.15-22, December 11-13, 1985, San Francisco, California, United States [doi>10.1145/21850.253058]
	32	Robert G. Sargent, The use of graphical models in model validation, Proceedings of the 18th conference on Winter simulation, p.237-241, December 08-10, 1986, Washington, D.C., United States [doi>10.1145/318242.318312]
	33	Robert G. Sargent, A tutorial on validation and verification of simulation models, Proceedings of the 20th conference on Winter simulation, p.33-39, December 12-14, 1988, San Diego, California, United States [doi>10.1145/318123.318150]
	34	Sargent, R. G. 1990. Validation of Mathematical Mod-els, Proc. of Geoval-90: Symposium on Validation of Geosphere Flow and Transport Models, Stockholm, Sweden, pp. 571-579.
	35	Robert G. Sargent, Simulation model verification and validation, Proceedings of the 23rd conference on Winter simulation, p.37-47, December 08-11, 1991, Phoenix, Arizona, United States
	36	Robert G. Sargent, Verification and validation of simulation models, Proceedings of the 26th conference on Winter simulation, p.77-87, December 11-14, 1994, Orlando, Florida, United States
	37	Robert G. Sargent, Some subjective validation methods using graphical displays of data, Proceedings of the 28th conference on Winter simulation, p.345-351, December 08-11, 1996, Coronado, California, United States [doi>10.1145/256562.256648]
	38	Robert G. Sargent, Verifying and validating simulation models, Proceedings of the 28th conference on Winter simulation, p.55-64, December 08-11, 1996, Coronado, California, United States [doi>10.1145/256562.256572]
	39	Robert G. Sargent, Verification and validation of simulation models, Proceedings of the 30th conference on Winter simulation, p.121-130, December 13-16, 1998, Washington, D.C., United States
	40	Schlesinger, et al. 1979. Terminology for Model Credibility, Simulation, 32, 3~ pp. 103-104.
	41	Schruben, L. W. 1980. Establishing the Credibility of Simulations, Simulation, 34, 3, pp. 101-105.
	42	Shannon, R. E. 1975. Systems Simulation: The Art and the Science, Prentice-Hall.
	43	R. B. Whitner , O. Balci, Guidelines for selecting and using simulation model verification techniques, Proceedings of the 21st conference on Winter simulation, p.559-568, December 04-06, 1989, Washington, D.C., United States [doi>10.1145/76738.76811]
	44	David O. Wood, MIT model analysis program: what we have learned about policy model review, Proceedings of the 18th conference on Winter simulation, p.248-252, December 08-10, 1986, Washington, D.C., United States [doi>10.1145/318242.318314]
	45	Bernard P. Zeigler, Theory of Modelling and Simulation, Krieger Publishing Co., Inc., Melbourne, FL, 1984

CITED BY 13

	Candace L. Conwell , Rosemary Enright , Marcia A. Stutzman, Capability maturity models support of modeling and simulation verification, validation, and accreditation, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
	Robert G. Sargent , Priscilla A. Glasow , Jack P. C. Kleijnen , Averill M. Law , Ian McGregor , Simone Youngblood, Strategic directions in VV&A; research: strategic directions in Verification, Validation, and Accreditation research, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
	Robert G. Sargent, Verification, validation, and accreditation: verification, validation, and accreditation of simulation models, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
	Don Caughlin, An integrated approach to verification, validation, and accredition of models and simulations, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
	G. I. Papadimitriou , B. Sadoun , C. Papazoglou, Fundamentals of system simulation, Applied system simulation: methodologies and applications, Kluwer Academic Publishers, Norwell, MA, 2003
	Gloria J. Giacaman , Rodrigo P. Medel , Jorge A. Tabilo, Manufacturing supply chain applications 3: simulation of the material transporting and loading process in Pedro de Valdivia mine, Proceedings of the 34th conference on Winter simulation: exploring new frontiers, December 08-11, 2002, San Diego, California
	Lisete Silva , Ana Luisa Ramos , Pedro M. Vilarinho, Using simulation for manufacturing process reengineering: a practical case study, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
	Osman Balci , Richard E. Nance , James D. Arthur , William F. Ormsby, Improving the model development process: expanding our horizons in verification, validation, and accreditation research and practice, Proceedings of the 34th conference on Winter simulation: exploring new frontiers, December 08-11, 2002, San Diego, California
	Yingping Huang , Xiaorong Xiang , Gregory Madey , Steve E. Cabaniss, Agent-Based Scientific Simulation, Computing in Science and Engineering, v.7 n.1, p.22-29, January 2005
	Esther E. Klein , Paul J. Herskovitz, Philosophical foundations of computer simulation validation, Simulation and Gaming, v.36 n.3, p.303-329, September 2005
	Jon H. Marvel , Mark A. Schaub , Gary Weckman, Validating the capacity planning process and flowline product sequencing through simulation analysis, Proceedings of the 37th conference on Winter simulation, December 04-07, 2005, Orlando, Florida
	Erik M. W. Kolb , Sebastian Schoening , Jordan Peck , Taesik Lee, Reducing emergency department overcrowding: five patient buffer concepts in comparison, Proceedings of the 40th Conference on Winter Simulation, December 07-10, 2008, Miami, Florida
	Robert G. Sargent, Verification and validation of simulation models, Proceedings of the 40th Conference on Winter Simulation, December 07-10, 2008, Miami, Florida

INDEX TERMS

Primary Classification:
A. General Literature

Additional Classification:
I. Computing Methodologies
I.6 SIMULATION AND MODELING

General Terms:
Design, Measurement, Performance, Reliability, Theory, Verification

Collaborative Colleagues:

Robert G. Sargent: colleagues

Adobe Acrobat

QuickTime

Windows Media Player

Real Player