Workload models for DBMS performance evaluation

ABSTRACT

A hierarchy of workload models to support Database Management System Performance Measurement and Evaluation studies is defined herein. The hierarchy is structured so that each successive layer represents database design, DBMS functionality and workload characterization in progressively greater detail. The design of the hierarchy was influenced by the ANSI/X3/SPARC (3) model for DBMS architecture, by Senko's DIAM (20), by Scheuermann's DBMS model (19) and by Sevcik's layered model for database system performance evaluation (21). The hierarchical layers clearly isolate DBMS functionality from organizational activities and underlying machine characteristics. Specific modeling techniques for deriving both database design and workload models at each level of the hierarchy are identified. The database design models form the basis for defining certain critical components of the workload models. The hierarchy of workload models facilitates a clear separation of the relevant performance measurement and evaluation issues and objectives based upon an increasingly detailed view of the total computing environment. Figure 1 illustrates the major layers of the hierarchy. The remainder of this paper defines the workload models developed at each layer and the measurement parameters and performance metrics derived therein.

REFERENCES

• 1: Adams, E.J., "A Time-Dependent Data-Dependent Analysis of the Costs Associated with the Processing of a Query", Master of Science Project Report, University of Southwestern Louisana, Lafayette, La., December 1979.
• 2: Evans Joseph Adams, An integrated hierarchical methodology for the objective evaluation of database management systems, 1982
• 3: ANSI/X3/SPARC: interim Report: Study Group on Data Base Management Systems. Bulletin of ACM-SIGMOD , vol 7. no. 2, 1975.
• 4: Catriel Beeri , Ronald Fagin , John H. Howard, A complete axiomatization for functional and multivalued dependencies in database relations, Proceedings of the 1977 ACM SIGMOD international conference on Management of data, August 03-05, 1977, Toronto, Ontario, Canada [doi>10.1145/509404.509414]
• 5: Browne, J.C., Chandy, K.M., Brown, R.M., Keller, T.W., Towsley, D.F., and Dissley, C.W., "Hierarchical Techniques for Development of Realistic Models of Complex Computer Systems", Proceedings of the IEEE , vol. 63, no. 6, June 1975, pp. 966-975.
• 6: R. M. Brown , J. C. Browne , K. M. Chandy, Memory management and response time, Communications of the ACM, v.20 n.3, p.153-165, March 1977 [doi>10.1145/359436.359443]
• 7: Peter Pin-Shan Chen, The entity-relationship model—toward a unified view of data, ACM Transactions on Database Systems (TODS), v.1 n.1, p.9-36, March 1976 [doi>10.1145/320434.320440]
• 8: CODASYL Systems Committee, CODASYL Data Base Task Group - April 1971 Report , ACM, New York, 1971.
• 9: E. F. Codd, A relational model of data for large shared data banks, Communications of the ACM, v.13 n.6, p.377-387, June 1970 [doi>10.1145/362384.362685]
• 10: Codd, E.F., "Further Normalization of the Data Base Relational Model", in Data Base Systems (R. Rustin, editor), Prentice-Hall, Englewood Cliffs, N.J., pp. 33-64.
• 11: Douglas Comer, Ubiquitous B-Tree, ACM Computing Surveys (CSUR), v.11 n.2, p.121-137, June 1979 [doi>10.1145/356770.356776]
• 12: Thomas Richard Cousins, A methodology for the inferential derivation of retrieval semantics utilizing a relational view of a meta-base., 1978
• 13: C. J. Date, An introduction to database systems: vol. I (4th ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1986
• 14: Ronald Fagin, Multivalued dependencies and a new normal form for relational databases, ACM Transactions on Database Systems (TODS), v.2 n.3, p.262-278, Sept. 1977 [doi>10.1145/320557.320571]
• 15: Chris P. Gane , Trish Sarson, Structured Systems Analysis: Tools and Techniques, Prentice Hall Professional Technical Reference, 1979
• 16: Nijssen, G. M., "Architecture and Models in Data Base Management Systems", Proceedings IFIP Conference on Modelling in Data Base Management Systems , North-Holland, Amsterdam, 1977.
• 17: Clifford A. Rose, A Measurement Procedure for Queueing Network Models of Computer Systems, ACM Computing Surveys (CSUR), v.10 n.3, p.263-280, Sept. 1978 [doi>10.1145/356733.356736]
• 18: Sauer, C H and MacNair, E A , "Queueing Network Software for Systems Modelling" Software-Practice and Experience , vol. 9, no. 5, May 1979, pp. 369-380.
• 19: Scheuermann, P., "On the Design and Evaluation of Data Bases", Computer , February 1978, pp. 46-55.
• 20: Senko, M.E. et. al., "Data Structures and Accessing in Database Systems', IBM Systems Journal , vol. 12, no. i, January 1973, pp. 30-93.
• 21: Sevcik, K., "Data Base System Performance Prediction Using an Analytic Model", Proceedings 7th International Conference on Very La__~ Data Bases , September 1981, pp. 182-198.
• 22: Max Vetter , R. N. Maddison, Data Base Design Methodology, Prentice-Hall, Inc., Upper Saddle River, NJ, 1981

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT

General Terms:
Algorithms, Performance