Toward a progress indicator for database queries

ABSTRACT

Many modern software systems provide progress indicators for long-running tasks. These progress indicators make systems more user-friendly by helping the user quickly estimate how much of the task has been completed and when the task will finish. However, none of the existing commercial RDBMSs provides a non-trival progress indicator for long-running queries. In this paper, we consider the problem of supporting such progress indicators. After discussing the goals and challenges inherent in this problem, we present a set of techniques sufficient for implementing a simple yet useful progress indicator for a large subset of RDBMS queries. We report an initial implementation of these techniques in PostgreSQL.

REFERENCES

• 1: Ashraf Aboulnaga , Surajit Chaudhuri, Self-tuning histograms: building histograms without looking at data, Proceedings of the 1999 ACM SIGMOD international conference on Management of data, p.181-192, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States
• 2: Gennady Antoshenkov, Dynamic Query Optimization in Rdb/VMS, Proceedings of the Ninth International Conference on Data Engineering, p.538-547, April 19-23, 1993
• 3: Nicolas Bruno , Surajit Chaudhuri , Luis Gravano, STHoles: a multidimensional workload-aware histogram, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.211-222, May 21-24, 2001, Santa Barbara, California, United States
• 4: D. A. Berque, M. K. Goldberg. Monitoring an Algorithm's Execution. Computational Support for Discrete Mathematics, DIMACS Series in Discrete Mathematics and Theoretical Computer Science, Vol. 15, pp. 153--163, 1992.
• 5: Richard L. Cole , Goetz Graefe, Optimization of dynamic query evaluation plans, Proceedings of the 1994 ACM SIGMOD international conference on Management of data, p.150-160, May 24-27, 1994, Minneapolis, Minnesota, United States
• 6: Chandra Chekuri , Waqar Hasan , Rajeev Motwani, Scheduling problems in parallel query optimization, Proceedings of the fourteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.255-265, May 22-25, 1995, San Jose, California, United States [doi>10.1145/212433.212471]
• 7: DB2. SQL/Monitoring Facility. http://www.sprdb2.com/SQLMFVSE.PDF, 2000.
• 8: M. Dempsey. Monitoring Active Queries with Teradata Manager 5.0. http://www.teradataforum.com/attachments/a030318c.doc, 2001.
• 9: Marcia A. Derr, Adaptive query optimization in a deductive database system, Proceedings of the second international conference on Information and knowledge management, p.206-215, November 01-05, 1993, Washington, D.C., United States [doi>10.1145/170088.170134]
• 10: Peter J. Haas , Joseph M. Hellerstein, Ripple joins for online aggregation, Proceedings of the 1999 ACM SIGMOD international conference on Management of data, p.287-298, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States
• 11: Joseph M. Hellerstein , Peter J. Haas , Helen J. Wang, Online aggregation, Proceedings of the 1997 ACM SIGMOD international conference on Management of data, p.171-182, May 11-15, 1997, Tucson, Arizona, United States
• 12: Yannis E. Ioannidis , Raymond T. Ng , Kyuseok Shim , Timos K. Sellis, Parametric query optimization, The VLDB Journal — The International Journal on Very Large Data Bases, v.6 n.2, p.132-151, May 1997 [doi>10.1007/s007780050037]
• 13: Ihab F. Ilyas , Jun Rao , Guy Lohman , Dengfeng Gao , Eileen Lin, Estimating compilation time of a query optimizer, Proceedings of the 2003 ACM SIGMOD international conference on Management of data, June 09-12, 2003, San Diego, California [doi>10.1145/872757.872803]
• 14: Navin Kabra , David J. DeWitt, Efficient mid-query re-optimization of sub-optimal query execution plans, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.106-117, June 01-04, 1998, Seattle, Washington, United States
• 15: U. Larry. Monitoring Rollback Progress. http://www.interealm.com/technotes/larry/rollback_time.ht ml, 2002.
• 16: Brad A. Myers, The importance of percent-done progress indicators for computer-human interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.11-17, April 1985, San Francisco, California, United States
• 17: Kenneth W. Ng , Zhenghao Wang , Richard R. Muntz , Silvia Nittel, Dynamic Query Re-Optimization, Proceedings of the 11th International Conference on Scientific on Scientific and Statistical Database Management, p.264, July 28-30, 1999 [doi>10.1109/SSDM.1999.787642]
• 18: Oracle. Communication with Oracle during long-running query. http://www.experts-exchange.com/Databases/Oracle/Q_20675711.html, 2003.
• 19: PostgreSQL homepage, 2003. http://www.postgresql.org.
• 20: Raghu Ramakrishnan , Johannes Gehrke, Database Management Systems, McGraw-Hill Science/Engineering/Math, 2002
• 21: Michael Stillger , Guy M. Lohman , Volker Markl , Mokhtar Kandil, LEO - DB2's LEarning Optimizer, Proceedings of the 27th International Conference on Very Large Data Bases, p.19-28, September 11-14, 2001
• 22: TPC Homepage. TPC-R benchmark, www.tpc.org.