|
ABSTRACT
In this paper we develop some intuitive graphical methods for designing, running, and analyzing simulation experiments. We first concentrate on the analysis of output plots from a single run; the concept of a standardized simulation output plot is presented and its use illustrated. The remainder of the paper involves the design of experiments that may involve several (sequential) simulation runs. Experimental design discussions in simulation often focus on special topics unique to the field. Control over random variables permits design techniques such as antithetic variates and common random number streams. Yet many of the general topics of experiment design including confounding, fractional designs, and sample size determination are important in a simulation setting. The second part of this tutorial will focus on these general topics and present some graphical tools for generating experiment designs: causal diagrams and multidimensional point plots.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
Andrews, H. P. (1964), "The Role of Statistics in Setting Food Specifications," Proceedings of the Sixteenth Research Conference of the Research Council of the American Meat Institute, 43--56. Reprinted in Experiments in Industry: Design, Analysis, and Interpretation of Results, eds. R. D. Snee, L. B. Hare, and J. R. Trout, Milwaukee: American Society for Quality Control, 1985.
|
| |
2
|
Box, G. E. P., and Draper, N. R. (1959), "A Basis for the Selection of a Response Surface Design," Journal of the American Statistical Association, 54, 622--653.
|
| |
3
|
Box, G. E. P., Hunter, W. G., and Hunter, J. S. (1978), Statistics for Experimenters, New York: Wiley.
|
| |
4
|
Butz, L. (1982), "Connectivity in Multi-Factor Designs: A Combinatorial Approach," Research and Education in Mathematics 3, Berlin: Helderman Verlag.
|
| |
5
|
Edwards, B. (1979), Drawing on the Right Side of the Brain, Boston: Houghton-Mifflin.
|
| |
6
|
Glynn, P. W., and Heidelberger, P. (1989), "Analysis of Initial Transient Deletion for Replicated Steady State Simulations", presented at the Fall 1989 joint ORSA/TIMS conference, New York, NY, October, 1989.
|
| |
7
|
Goldsman, D. M., and L. Schruben (1989), "New Confidence Interval Estimators Using Standardized Time Series", to appear in Management Science.
|
| |
8
|
Ishikawa, K. (1982), Guide to Quality Control, Tokyo: Asian Productivity Organization, (second edition).
|
| |
9
|
Mitchell, T. J. (1974), "An Algorithm for the Construction of D-Optimal Experimental Designs," Technometrics, 16, 203--210.
|
| |
10
|
Nozari, A. (1986), "Confidence Intervals Based on Steady-State Continuous-Time Statistics", Operations Research Letters, 4.5, pp. 213--219.
|
| |
11
|
Schruben, L. (1983), "Confidence Interval Estimation Using Standardized Time Series", Operations Research, 31.6, pp. 1090--1107.
|
| |
12
|
Schruben, L., and Margolin, B. (1978), "Pseudorandom Number Assignment in Statistically Designed Simulation and Distribution Sampling Experiments", Journ. Amer. Stat. Assoc., 73.363, pp. 504--525.
|
| |
13
|
Snee, R. D. (1981), "Developing Blending Models for Gasoline and Other Mixtures," Technometrics, 23, 119--130.
|
| |
14
|
Snee, R. D. (1985a), "Experimenting with a Large Number of Variables," in Experiments in Industry: Design, Analysis, and Interpretation of Results, eds. R. D. Snee, L. B. Hare, and J. R. Trout, Milwaukee: American Society for Quality Control.
|
| |
15
|
Snee, R. D. (1985b), "Computer-Aided Design of Experiments -Some Practical Experiences," Journal of Quality Technology, 17, 222--236.
|
| |
16
|
Taguchi, G., and Wu, Y. (1980), Introduction to Off-Line Quality Control, The Central Japanese Quality Control Association (available from American Supplier Institute, 32100 Detroit Industrial Expressway, Romulus, MI 48174.
|
| |
17
|
Welch, P. D. (1983), "The Statistical Analysis of Simulation Results", Chpt. 6 of The Computer Performance Modeling Handbook, Academic Press, pp. 267--329.
|
| |
18
|
Young, A., Moore, M., and Girard, T. (1987), "A Warped Disk," OR516: Case Studies, Project Report, School of Operations Research and Industrial Engineering, Cornell University.
|
|