Verification, validation, and accreditation (VV&A) of models and simulations through reduced order metamodels

ABSTRACT

The paper provides a new approach to support verification, validation, and accreditation (VV&A) of models and simulations. The need for efficient and objective methods to verify, validate and accredit models and simulations is greater than ever. More and more decisions are based on computer generated data that are derived from models and simulations. The strength of these decisions is a direct function of the validity of this data. Based on the system identification of reduced order models, this new approach approximates a complex high-dimensional model or simulation by a relatively simple mathematical model valid over a specified domain and range of interest. Verification or validation is then accomplished by the straightforward comparison of the reduced order model structure and coefficients with the baseline data or system. Well-developed identification methods and a structured procedure make this process more efficient and objective than existing methods.

REFERENCES

• 1: Anderson, et al. 1989. SIMTAX, A Taxonomy for Warfare Simulation. Workshop report taken from the Catalog of Wargaming and Military Simulation Models, 11th Edition, Force Structure, Resource, and Assignment Directorate (J-8), The Joint Staff, Washington, DC 20318-8000.
• 2: Caughlin, D. 1994. A Metamodeling Approach to Model Abstraction. Proceedings Fourth Annual IEEE Dual-Use Technologies ~ Applications Conference, 387-396. SUNY Institute of Technology, Utica/Rome, New York.
• 3: Caughlin, D. 1994. An Evaluation of Simulated Annealing for Modeling Air Combat Simulations. Proceedings Fourth Annual IEEE Dual- Use Technologies ~ Application Conference, 412- 421. SUNY institute of Technology, Utica/Rome, New York.
• 4: Lewis, R. O. 1994. Verification, Validation, and Accreditation (VV&A) Process for Distributed Interactive Simulations (DIS). Proceedings of the l Oth DIS Workshop on Standards for the lnteroperability of Defense Simulations, 373-379. Institute for Simulation and Training, University of Central Florida, Orlando, Florida
• 5: Naylor, A. W., and G. R. Sell. 1982. Linear Operator Theory in Engineering and Science. New York: Springer Verlag.
• 6: Norton, J. P. 1988. An Introduction to Identification. San Diego: Academic Press.
• 7: Royden, H. L. 1988. Real Analysis. New York:Macmillan Publishing Company.
• 8: Sinha, N. K., and B. Kuszta. 1983. Modeling and Identification of Dynamic Systems. New York:Van Nostrand Reinhold.
• 9: Sisti, A. F. 1992. Large-Scale Battlefield Simulation Using a Multi-Level Model Integration Methodology. Rome Laboratory Technical Report RL-TR- 92-69.
• 10: Sisti, A. F. 1989. A Model Integration Approach to Electronic Combat Effectiveness Evaluation. Rome Laboratory Technical Report RL- TR-89-183.
• 11: Willems, J. C. 1991. Paradigms and Puzzles in the Theory of Dynamical Systems. IEEE Transactions on Automatic Control, 36:259-294.
• 12: Zeimer, et al. 1993. Metamodel Procedures for Air Engagement Simulation Models. Rome Laboratory/IRAE Technical Report.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.4 Model Validation and Analysis

General Terms:
Theory, Verification