Methods for selecting the best system (1991)

ABSTRACT

In this tutorial we consider three methods for selecting the best of a set of competing systems: interactive analysis, ranking and selection, and multiple comparisons. We describe each method; discuss assumptions, implementation aspects, advantages, and disadvantages; and demonstrate the use of each method with an airline-reservation-system simulation example.

REFERENCES

• 1: Bechhofer, R. E., C. Dunnett, D. Goldsman, and M. Hartmann. 1990. A Comparison of the performances of procedures for selecting the normal population having the largest mean when the populations have a common unknown variance. Communications in Statistics---Simulation and Computation B19, 971--1006.
• 2: Jean Dickinson Gibbons , Ingram Olkin , Milton Sobel, Selecting and ordering populations: a new statistical methodology, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1999
• 3: Lynne Goldsman , Barry L. Nelson, Batch-size effects on simulation optimization using multiple comparisons with the best, Proceedings of the 22nd conference on Winter simulation, p.288-293, December 09-12, 1990, New Orleans, Louisiana, United States
• 4: Y. Hochberg , A. C. Tamhane, Multiple comparison procedures, John Wiley & Sons, Inc., New York, NY, 1987
• 5: Hsu, J. C. 1984. Ranking and selection and multiple comparisons with the best. In: Design of Experiments: Ranking and Selection, eds. T. J. Santner and A. C. Tamhane, 23--33. New York: Marcel Dekker.
• 6: J. C. Hsu, Sample size computation for designing multiple comparison experiments, Computational Statistics & Data Analysis, v.7 n.1, p.79-91, August 1988 [doi>10.1016/0167-9473(88)90017-5]
• 7: Averill M. Law , W. David Kelton, Simulation Modeling and Analysis, McGraw-Hill Higher Education, 1997
• 8: Nelson, B. L. 1992. Statistical analysis of simulation results. In: Handbook of Industrial Engineering, Second Edition, ed. G. Salvendy, in press. New York: John Wiley.
• 9: Rinott, Y. 1978. On two-stage selection procedures and related probability inequalities. Communications in Statistics A7, 799--811.
• 10: Schmeiser, B. W. 1982. Batch size effects in the analysis of simulation output. Operations Research 30, 556--568.
• 11: Schmeiser, B. W. 1990. Simulation experiments. In: Handbook of Operations Research and Management Science, Volume 2: Stochastic Models, eds. D. Heyman and M. Sobel, 295--330. Amsterdam: North Holland.
• 12: Bruce W. Schmeiser , Thanos N. Avramidis , Sherif Hashem, Overlapping batch statistics, Proceedings of the 22nd conference on Winter simulation, p.395-398, December 09-12, 1990, New Orleans, Louisiana, United States
• 13: Bruce W. Schmeiser , Mark D. Scott, SERVO: simulation experiments with random-vector output, Proceedings of the 23rd conference on Winter simulation, p.927-936, December 08-11, 1991, Phoenix, Arizona, United States
• 14: Schmidt, J. W., and R. E. Taylor. 1970. Simulation and Analysis of Industrial Systems. Homewood, Illinois: Richard D. Irwin.
• 15: Wilcox, R. R. 1984. A table for Rinott's selection procedure. Journal of Quality Technology 16, 97--100.
• 16: Yang, W., and B. L. Nelson. 1991. Using common random numbers and control variates in multiple-comparison procedures. Operations Research 39, in press.