|
ABSTRACT
Performance is a major issue in the acceptance of object-oriented and relational database systems aimed at engineering applications such as computer-aided software engineering (CASE) and computer-aided design (CAD). Because traditional database systems benchmarks are inapproriate to measure performance for operations on engineering objects, we designed a new benchmark Object Operations version 1 (OO1) to focus on important characteristics of these applications. OO1 is descended from an earlier benchmark for simple database operations and is based on several years experience with that benchmark. In this paper we describe the OO1 benchmark and results we obtained running it on a variety of database systems. We provide a careful specification of the benchmark, show how it can be implemented on database systems, and present evidence that more than an order of magnitude difference in performance can result from a DBMS implementation quite different from current products; minimizing overhead per database call, offloading database server functionality to workstations, taking advantage of large main memories, and using link-based methods.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
|
 |
2
|
|
 |
3
|
M. M. Astrahan , M. W. Blasgen , D. D. Chamberlin , K. P. Eswaran , J. N. Gray , P. P. Griffiths , W. F. King , R. A. Lorie , P. R. McJones , J. W. Mehl , G. R. Putzolu , I. L. Traiger , B. W. Wade , V. Watson, System R: relational approach to database management, ACM Transactions on Database Systems (TODS), v.1 n.2, p.97-137, June 1976
[doi> 10.1145/320455.320457]
|
| |
4
|
BARRETT, M. C + + Test driver for object-oriented databases, Prime Computervlsion, personal commumcatlon, 1990.
|
| |
5
|
|
| |
6
|
MAmR, D. Making database systems fast enough for CAD applications. Tech Rep CS/E- 87-016, Oregon Graduate Center, Beaverton, Oregon, 1987
|
 |
7
|
|
| |
8
|
SCHWARTZ, J., SAMCO, R. Object-oriented database evaluation, Mentor Graphics, personal communication, 1990.
|
 |
9
|
W. B. Rubenstein , M. S. Kubicar , R. G. G. Cattell, Benchmarking simple database operations, Proceedings of the 1987 ACM SIGMOD international conference on Management of data, p.387-394, May 27-29, 1987, San Francisco, California, United States
|
| |
10
|
TRANSACTION PROCESSING PERFORMANCE COUNCIL (TPC), "TPC Benchmark A Standard", Shanley Public Relations, 777 N. First St., Suite 600, San Jose, California, November, 1989.
|
| |
11
|
WINSLETT, M., AND CHU, S. Using a relational DBMS for CAD data. Tech. Rep. UIUCDCS- R-90-1649, Computer Science, Univ. of Illinois, Urbana, 1990.
|
CITED BY 40
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Michael J. Carey , David J. DeWitt , Jeffrey F. Naughton , Mohammad Asgarian , Paul Brown , Johannes E. Gehrke , Dhaval N. Shah, The BUCKY object-relational benchmark, ACM SIGMOD Record, v.26 n.2, p.135-146, June 1997
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Yin-he Jiang , Xiangning Liu , Bharat Bhargava, Re-evaluating indexing schemes for nested objects, Proceedings of the third international conference on Information and knowledge management, p.439-446, November 29-December 02, 1994, Gaithersburg, Maryland, United States
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Robert L. Grossman , Xiao Qin , D. Valsamis , W. Xu , C. T. Day , S. Loken , J. F. MacFarlane , D. Quarrie , Edward N. May , D. Lifka , David M. Malon , L. E. Price , A. Baden , L. Cormell , P. Leibold , D. Liu , U. Nixdorf , B. Scipioni , T. Song, Analyzing high energy physics data using databases: a case study, Proceedings of the 7th international conference on Scientific and Statistical Database Management, p.283-286, September 28-30, 1994, Charlottesville, Virginia
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
P. Y. Chevalier , A. Freyssinet , D. Hagimont , S. Krakowiak , S. Lacourte , X. Rousset de Pina, Experience with shared object support in the GUIDE system, USENIX Systems on USENIX Experiences with Distributed and Multiprocessor Systems, p.8-8, September 22-23, 1993, San Diego, California
|
|
|
Albrecht Schmidt , Florian Waas , Martin Kersten , Michael J. Carey , Ioana Manolescu , Ralph Busse, XMark: a benchmark for XML data management, Proceedings of the 28th international conference on Very Large Data Bases, p.974-985, August 20-23, 2002, Hong Kong, China
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
INDEX TERMS
Primary Classification:
K.
Computing Milieux
K.6
MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
K.6.2
Installation Management
Subjects:
Benchmarks
Additional Classification:
D.
Software
D.1
PROGRAMMING TECHNIQUES
H.
Information Systems
H.2
DATABASE MANAGEMENT
H.2.1
Logical Design
Subjects:
Data models
H.2.3
Languages
Subjects:
Data manipulation languages (DML);
Data description languages (DDL);
Database (persistent) programming languages
K.
Computing Milieux
K.6
MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
K.6.2
Installation Management
Subjects:
Performance and usage measurement
General Terms:
Algorithms,
Design,
Experimentation,
Languages,
Measurement,
Performance
Keywords:
CAD,
CASE,
client-server architecture,
engineering database benchmark,
hypermodel,
object operations benchmark,
object-oriented DBMS's,
relation of DBMS's,
workstations
REVIEW
"Martin E. Modell : Reviewer"
Generally, benchmarks produce mixed results and have mixed
acceptance among the information systems community. Some people swear by
them, while others swear at them. When one is evaluating database
management system (DBMS) packages, and especi
more...
|