Database performance in the real world: TPC-D and SAP R/3

ABSTRACT

Traditionally, database systems have been evaluated in isolation on the basis of standardized benchmarks (e.g., Wisconsin, TPC-C, TPC-D). We argue that very often such a performance analysis does not reflect the actual use of the DBMSs in the “real world.” End users typically don't access a stand-alone database system; rather they use a comprehensive application system, in which the database system constitutes an integrated component. In order to derive performance evaluations of practical relevance to the end users, the application system including the database system has to be benchmarked. In this paper, we present TPC-D benchmark results carried out using the SAP R/3 system, an integrated business administration system. Like many other application systems SAP R/3 is based on a commercial relational database system. We compare the SAP R/3 benchmark results with TPC-D results of an isolated database system, the database product that served as SAP R/3's back-end.

REFERENCES

• BDT83: Dina Bitton , David J. DeWitt , Carolyn Turbyfill, Benchmarking Database Systems A Systematic Approach, Proceedings of the 9th International Conference on Very Large Data Bases, p.8-19, October 31-November 02, 1983
• BEG96: Reudiger Buck-Emden , Jurgen Galimow, Sap R\3 System: A Client/Server Technology, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1996
• Col96: George Colliat, OLAP, relational, and multidimensional database systems, ACM SIGMOD Record, v.25 n.3, p.64-69, Sept. 1996 [doi>10.1145/234889.234901]
• DHKK: J. Doppelhammer, T. Htippler, A. Kemper, and D. Kossmann. Database performance of SAP System R/3. http://www.db.fmi.unipassau.de/projects/SAP.
• FS96: Phil Fernandez , Donovan Schneider, The ins and outs (and everything in between) of data warehousing, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.541, June 04-06, 1996, Montreal, Quebec, Canada
• GBLP96: Jim Gray , Adam Bosworth , Andrew Layman , Hamid Pirahesh, Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total, Proceedings of the Twelfth International Conference on Data Engineering, p.152-159, February 26-March 01, 1996
• Gra93: Jim Gray, Benchmark Handbook: For Database and Transaction Processing Systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1992
• LM95: B. Lober and U. Marquard. Standard Application Benchmarks. SAP AG, 69185 Walldorf, Germany, Dec 1995.
• Mat96: B. Matzke. ABAP/4- Die Programmiersprache des SAP-Systems R/3. Addison-Wesley, Reading, MA, USA, 1996.
• SAP: SAP AG. R/3 system overview. http://www.sap.com/r3/r3_over.htm.
• TPC95: Transaction Processing Performance Council TPC. TPC benchmark D (decision support). Standard Specification 1.0, May 1995.
• WHSH96: L. Will, C. Hienger, E Str~enburg, and R. Himmer. R/3-Administration. Addison-Wesley, Reading, MA, USA, 1996.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.2 Installation Management
          Subjects: Performance and usage measurement

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT

General Terms:
Design, Experimentation, Management, Measurement, Performance, Standardization, Theory