A workload characterization pipeline for models of parallel systems

ABSTRACT

The same application implemented on different systems will necessarily present different workloads to the systems. Characterizations of workloads intended to represent the same application, but input to models of different systems, must also differ in analogous ways. We present a hierarchical method for characterizing a workload at increasing levels of detail such that every characterization at a lower level still accurately represents the workload at higher levels. We discuss our experience in using the method to feed the same application through a workload characterization “pipeline” to two different models of two different systems, a conventional relational database system and a logic-based distributed database system. We have developed programs that partially automate the characterization changes that are required when the system to be modeled changes.

REFERENCES

• Anon85: A measure of transaction processing power, Datamation, v.31 n.7, p.112-118, March 15, 1985
• Ban87: François Bancilhon , Ted Briggs , Setrag Khoshafian , Patrick Valduriez, FAD, a Powerful and Simple Database Language, Proceedings of the 13th International Conference on Very Large Data Bases, p.97-105, September 01-04, 1987
• Bri82: R. S. Brice, "Benchmarking Your Benchmarks", Proc. of the Computer Measurement Group (CMG) XIII International Conf., December 1982, San Diego, CA.
• Car75: Alfonso F. Cárdenas, Analysis and performance of inverted data base structures, Communications of the ACM, v.18 n.5, p.253-263, May 1975 [doi>10.1145/360762.360766]
• Che84: j.M. Cheng, C. R. Loosley, A. Shibamiya, and P. S. Worthington, "IBM Database 2 Performance: Design, Implementation, and Tuning", IBM Systems Journal, Vol. 23, No. 2, 1984, pp 189-210.
• Den78: Peter J. Denning , Jeffrey P. Buzen, The Operational Analysis of Queueing Network Models, ACM Computing Surveys (CSUR), v.10 n.3, p.225-261, Sept. 1978 [doi>10.1145/356733.356735]
• Laz84: Edward D. Lazowska , John Zahorjan , G. Scott Graham , Kenneth C. Sevcik, Quantitative system performance: computer system analysis using queueing network models, Prentice-Hall, Inc., Upper Saddle River, NJ, 1984
• Sev81: Kenneth C. Sevcik, "Data Base System Performance Prediction Using An Analytical Model", Proceedings of 7th VLDB Conf., 1981, pp 182-189.
• Sch85: M. Schkolnick , P. Tiberio, Estimating the cost of updates in a relational database, ACM Transactions on Database Systems (TODS), v.10 n.2, p.163-179, June 1985 [doi>10.1145/3857.3863]
• Schw85: H. Schwetman, "CSIM: A C-Based, Process-Oriented Simulation Language", MCC Parallel Processing Technical Report No. PP-080-85, September 1985.
• Smi80: Connie Umland Smith, The prediction and evaluation of the performance of software from extended design specifications, 1980
• Smi82: Connie U. Smith and J. C. Browne, "Performance Engineering of Software Systems: A Case Study", Proc. National Computer Conference, Vol 15, Houston, June 1982, pp 217-224.
• Tsu86: Shalom Tsur , Carlo Zaniolo, LDL: A Logic-Based Data Language, Proceedings of the 12th International Conference on Very Large Data Bases, p.33-41, August 25-28, 1986

INDEX TERMS

Classification:
  C. Computer Systems Organization
  C.1 PROCESSOR ARCHITECTURES

General Terms:
Design, Measurement, Performance