Ranking and selection techniques with overlapping variance estimators

ABSTRACT

Some ranking and selection (R&S) procedures for steady-state simulation require an estimate of the asymptotic variance parameter of each system to guarantee a certain probability of correct selection. We show that the performance of such R&S procedures depends on the quality of the variance estimates that are used. In this paper, we study the performance of R&S procedures with two new variance estimators --- overlapping area and overlapping Cramér-von Mises estimators --- which show better long-run performance than other estimators previously used in R&S problems.

REFERENCES

• 1: Alexopoulos, C., N. T. Argon, D. Goldsman, N. M. Steiger, G. Tokol, and J. R. Wilson. 2006a. Efficient computation of overlapping variance estimators for simulation. To appear in INFORMS Journal on Computing.
• 2: Alexopoulos, C., N. T. Argon, D. Goldsman, G. Tokol, and J. R. Wilson. 2006b. Overlapping Estimators for simulation. To appear in Operations Research.
• 3: Batur, D., D. Goldsman, and S.-H. Kim. 2007. An improved standardized time series Durbin-Watson variance estimator for steady-state simulation. Technical Report, H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia.
• 4: Bechhofer, R. E., T. J. Santner, and D. M. Goldsman. 1995. Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons. New York: John Wiley and Sons, Inc.
• 5: P. W. Glynn , D. L. Iglehart, Simulation output analysis using standardized time series, Mathematics of Operations Research, v.15 n.1, p.1-16, Feb. 1990 [doi>10.1287/moor.15.1.1]
• 6: David Goldsman , Seong-Hee Kim , William S. Marshall , Barry L. Nelson, Ranking and Selection for Steady-State Simulation: Procedures and Perspectives, INFORMS Journal on Computing, v.14 n.1, p.2-19, January 2002 [doi>10.1287/ijoc.14.1.2.7710]
• 7: David Goldsman , William S. Marshall, Selection procedures with standardized time series variance estimators, Proceedings of the 31st conference on Winter simulation: Simulation---a bridge to the future, p.382-388, December 05-08, 1999, Phoenix, Arizona, United States [doi>10.1145/324138.324252]
• 8: D. Goldsman , M. Meketon , L. Schruben, Properties of standardized time series weighted area variance estimators, Management Science, v.36 n.5, p.602-612, May 1990 [doi>10.1287/mnsc.36.5.602]
• 9: Healey, C., D. Goldsman, S.-H. Kim. 2007. Ranking and selection techniques with overlapping variance estimators. Technical Report, H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia.
• 10: Seong-Hee Kim , Barry L. Nelson, On the Asymptotic Validity of Fully Sequential Selection Procedures for Steady-State Simulation, Operations Research, v.54 n.3, p.475-488, May-June 2006 [doi>10.1287/opre.1060.0281]
• 11: Rinott, Y. 1978. On two-stage selection procedures and related probability-inequalities. Communications in Statistics -- Theory and Methods, A8:799--811.