Input modeling: input model uncertainty: why do we care and what should we do about it?

ABSTRACT

An input model is a collection of distributions together with any associated parameters that are used as primitive inputs in a simulation model. Input model uncertainty arises when one is not completely certain what distributions and/or parameters to use. This tutorial attempts to provide a sense of why one should consider input uncertainty and what methods can be used to deal with it.

REFERENCES

• 1: Andradóttir, S., and P. W. Glynn. 2003. Computing Bayesian means using simulation. Submitted for publication.
• 2: Russell R. Barton , Stephen E. Chick , Russell C. H. Cheng , Shane G. Henderson , Averill M. Law , Bruce W. Schmeiser , Lawrence M. Leemis , Lee W. Schruben , James R. Wilson, Panel discussion on current issues in input modeling: panel on current issues in simulation input modeling, Proceedings of the 34th conference on Winter simulation: exploring new frontiers, December 08-11, 2002, San Diego, California
• 3: Russell R. Barton , Lee W. Schruben, Uniform and bootstrap resampling of empirical distributions, Proceedings of the 25th conference on Winter simulation, p.503-508, December 12-15, 1993, Los Angeles, California, United States [doi>10.1145/256563.256699]
• 4: Russell R. Barton , Lee W. Schruben, Resampling methods for input modeling, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 5: A. Ben-Tal , A. Nemirovski, Robust Convex Optimization, Mathematics of Operations Research, v.23 n.4, p.769-805, Nov. 1998 [doi>10.1287/moor.23.4.769]
• 6: Ben-Tal, A., and A. Nemirovski. 2000. Robust solutions of linear programming problems contaminated with uncertain data. Mathematical Programming, Series A 88:411--424.
• 7: Russell C. H. Cheng, Selecting input models, Proceedings of the 26th conference on Winter simulation, p.184-191, December 11-14, 1994, Orlando, Florida, United States
• 8: Cheng, R. C. H. 2000. Analysis of simulation output by resampling. International Journal of Simulation: Systems, Science & Technology 1:51--58.
• 9: Russell C. H. Cheng, Analysis of simulation experiments by bootstrap resampling, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 10: Cheng, R. C. H., and W. Holland. 1997. Sensitivity of computer simulation experiments to errors in input data. Journal of Statistical Computation and Simulation 57:219--241.
• 11: Cheng, R. C. H., and W. Holland. 1998. Two-point methods for assessing variability in simulation output. Journal of Statistical Computation and Simulation 60:183--205.
• 12: Cheng, R. C. H., and W. Holland. 2003. Calculation of confidence intervals for simulation output. Submitted for publication.
• 13: Stephen E. Chick, Bayesian analysis for simulation input and output, Proceedings of the 29th conference on Winter simulation, p.253-260, December 07-10, 1997, Atlanta, Georgia, United States [doi>10.1145/268437.268488]
• 14: Stephen E. Chick, Steps to implement Bayesian input distribution selection, Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future, p.317-324, December 05-08, 1999, Phoenix, Arizona, United States [doi>10.1145/324138.324233]
• 15: Stephen E. Chick, Bayesian methods: bayesian methods for simulation, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
• 16: Stephen E. Chick, Input Distribution Selection for Simulation Experiments: Accounting for Input Uncertainty, Operations Research, v.49 n.5, p.744-758, September 2001 [doi>10.1287/opre.49.5.744.10606]
• 17: Stephen E. Chick , Szu Hui Ng, Simulation input analysis: joint criterion for factor identification and parameter estimation, Proceedings of the 34th conference on Winter simulation: exploring new frontiers, December 08-11, 2002, San Diego, California
• 18: Draper, D. 1995. Assessment and propagation of model uncertainty. Journal of the Royal Statistical Society. Series B 57:45--97.
• 19: Mike Freimer , Lee Schruben, Simulation input analysis: collecting data and estimating parameters for input distributions, Proceedings of the 34th conference on Winter simulation: exploring new frontiers, December 08-11, 2002, San Diego, California
• 20: Jon C. Helton, Computational structure of a performance assessment involving stochastic and subjective uncertainty, Proceedings of the 28th conference on Winter simulation, p.239-247, December 08-11, 1996, Coronado, California, United States [doi>10.1145/256562.256613]
• 21: Helton, J. C. 1997. Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty. Journal of Statistical Computation and Simulation 57:3--76.
• 22: Helton, J. C., and F. J. Davis. 2003. Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems. Reliability Engineering & System Safety 81:23--69.
• 23: Shane G. Henderson, Mathematics and hybrid modeling: mathematics for simulation, Proceedings of the 32nd conference on Winter simulation, December 10-13, 2000, Orlando, Florida
• 24: Henderson, S. G. 2001. Mathematics for simulation. In Proceedings of the 2001 Winter Simulation Conference, ed. B. A. Peters, J. S. Smith, D. J. Medeiros, and M. W. Rohrer, 83--94. Piscataway NJ: IEEE.
• 25: Kleijnen, J. P. C. 1994. Sensitivity analysis versus uncertainty analysis: when to use what? In Predictability and Nonlinear Modelling in Natural Sciences and Economics, ed. J. Grasman and G. van Straten. Dordrecht: Kluwer Academic.
• 26: Jack P. C. Kleijnen, Five-stage procedure for the evaluation of simulation models through statistical techniques, Proceedings of the 28th conference on Winter simulation, p.248-254, December 08-11, 1996, Coronado, California, United States [doi>10.1145/256562.256616]
• 27: Kleijnen, J. P. C. 1998. Experimental design for sensitivity analysis, optimization, and validation of simulation models. In Handbook of Simulation: Principles, Methodology, Advances, Applications, and Practice, ed. J. Banks. New York: Wiley.
• 28: Averill M. Law , David M. Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1999
• 29: Shing-Hoi Lee , Peter Glynn, Monte carlo computation of conditional expectation quantiles, 1998
• 30: Shing-Hoi Lee , Peter W. Glynn, Computing the distribution function of a conditional expectation via Monte Carlo: discrete conditioning spaces, Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future, p.1654-1663, December 05-08, 1999, Phoenix, Arizona, United States [doi>10.1145/324898.325356]
• 31: Szu Hui Ng , Stephen E. Chick, Reducing input parameter uncertainty for simulations, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 32: Oberkampf, W. L., J. C. Helton, C. A. Joslyn, S. F. Wojtkiewicz, and S. Ferson. 2003. Challenge problems: uncertainty in system response given uncertain parameters. Available online via <http://www.sandia.gov/epistemic/eup_challenge.htm> {accessed July 6, 2003}.
• 33: Samuel G. Steckley , Shane G. Henderson, Simulation input modeling: a kernel approach to estimating the density of a conditional expectation, Proceedings of the 35th conference on Winter simulation: driving innovation, December 07-10, 2003, New Orleans, Louisiana
• 34: Faker Zouaoui , James R. Wilson, Accounting for input model and parameter uncertainty in simulation, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 35: Faker Zouaoui , James R. Wilson, Input uncertainty: accounting for parameter uncertainty in simulation input modeling, Proceedings of the 33nd conference on Winter simulation, December 09-12, 2001, Arlington, Virginia
• 36: Zouaoui, F., and J. R. Wilson. 2003a. Accounting for input model and parameter uncertainty in simulation. Submitted for publication.
• 37: Zouaoui, F., and J. R. Wilson. 2003b. Accounting for parameter uncertainty in simulation input modeling. IIE Transactions. To appear.