XOO7: applying OO7 benchmark to XML query processing tool

ABSTRACT

If XML is to play the critical role of the lingua franca for Internet data interchange that many predict, it is necessary to start designing and adopting benchmarks allowing the comparative performance analysis of the tools being developed and proposed. The effectiveness of existing XML query languages has been studied by many, with a focus on the comparison of linguistic features, implicitly reflecting the fact that most XML tools exist only on paper. In this paper, with a focus on efficiency and concreteness, we propose a pragmatic first step toward the systematic benchmarking of XML query processing platforms with an initial focus on the data (versus document) point of view. We propose XOO7, an XML version of the OO7 benchmark. We discuss the applicability of XOO7, its strengths, limitations and the extensions we are considering. We illustrate its use by presenting and discussing the performance comparison against XOO7 of three different query processing platforms for XML.

REFERENCES

• 1: Serge Abiteboul, Querying Semi-Structured Data, Proceedings of the 6th International Conference on Database Theory, p.1-18, January 08-10, 1997
• 2: Serge Abiteboul , Peter Buneman , Dan Suciu, Data on the Web: from relations to semistructured data and XML, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 3: Serge Abiteboul , Stéphane Grumbach, COL: A Logic-Based Language for Complex Objects, Proceedings of the International Conference on Extending Database Technology: Advances in Database Technology, p.271-293, March 14-18, 1988
• 4: S. Abiteboul , M. Scholl, From simple to sophisticated languages for complex objects, Data Engineering, v.11 n.3, p.15-22, September 1988
• 5: S. Abiteboul, D. Quass, 3. McHug, J. Widom, J. Wiener. The LOREL Query Language for Semistructured Data. International Journal on Digital Libraries, 1(1):68, April 1997.
• 6: R. Bourret. Java Packages for Transferring Data between XML Documents and Relational Databases. httn://www.robourret.com/xmldbms/readme.htm.
• 7: Peter Buneman, Semistructured data, Proceedings of the sixteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, p.117-121, May 11-15, 1997, Tucson, Arizona, United States [doi>10.1145/263661.263675]
• 8: Angela Bonifati , Stefano Ceri, Comparative analysis of five XML query languages, ACM SIGMOD Record, v.29 n.1, p.68-79, March 2000 [doi>10.1145/344788.344822]
• 9: T. Bohme, E. Rahm. XMach-1: A Benchmark for XML Data Management. Available at httn://dbs.unileinzig.de/nroiekte/XMLIXmlBenchmarkina.html
• 10: Michael J. Carey , David J. DeWitt , Jeffrey F. Naughton, The 007 Benchmark, Proceedings of the 1993 ACM SIGMOD international conference on Management of data, p.12-21, May 25-28, 1993, Washington, D.C., United States
• 11: Donald D. Chamberlin , Jonathan Robie , Daniela Florescu, Quilt: An XML Query Language for Heterogeneous Data Sources, Selected papers from the Third International Workshop WebDB 2000 on The World Wide Web and Databases, p.1-25, May 18-19, 2000
• 12: A. Deutsch, M. Fernandez, D. Florescu, A. Levy, D. Suciu. XML-QL: A Query Language for XML. httn://www.w3.org/TRNOTE-xml-ol/.
• 13: V. Apparao, S. Byrne. M Champion, S. Isaacs, I. Jacobs, A. Le Hors, G. Nicol, J. Robie, R. Sutor, C. Wilson, L. Wood. Document Object Model, 1998. http://www.w3.oralTWEC-DOM-Level-l/.
• 14: D. Florescu, D. Kossman. A Performance Evaluation of Alternative Mapping Schemes for Storing XML Data in a Relational Database, Report 3680 INRIA, France, May 1999.
• 15: M. Fernandez, J. Simeon, P. Wadler. XML Query Languages: Experiences and Exemplars, 2000. httn:liwww-db.research.bell-labs. com/userlsimeon/xauerv.html
• 16: R. Goldman, J. McHugh, J. Widom. From Semistructured Data to XML: Migrating the Lore Data Model and Query Language, ACM SIGMOD Workshop on Web and Databases (WebDB 99), 1999.
• 17: Jim Gray, Benchmark Handbook: For Database and Transaction Processing Systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1992
• 18: B. Chang, M. Scardina, K. Karun, S. Kiritzov, I. Macky, A. Novoselsky, N. Ramakrishnan. ORACLE XML Handbook ( 184- 190), 2000.
• 19: P. Frankhauser, M. Marchiori, J. Robie. XML Query Requirements, 2000. httn://www.w3.orgiTKxmlauerv-req/.
• 20: J. Robie, D. Chamberlin, D. Florescu. Quilt: an XML query language, 2000. Available at http://www.gca.org/napers/xmleurone2OOO/papers/sO8- 01 html
• 21: zkle y, R.V. Guha. Resource Description Framework WV Schema Specification 1.0, 2000. httn:llwww.w3.orp/TRfrdf-schema/.
• 22: XML Query Requirements. W3C Working Draft 15 August 2000. http://www.w3.orp/TRmlquerv-req
• 23: J. Robie, J. Lapp, D. Schach. XML Query Language (XQU 1998.
• 24: D. Fallside. XML Schema Part 0: Primer, 2001. httu://www.w3.ora/TR/200l/REC-xmlschema-O-200 105021.
• 25: H. Thompson, D. Beech, M. Maloney, N. Mendelsohn. XML Schema Part 1: Structures, 2001. http://www.w3.org/TR2OOl/REC-xmlschema-l-20010502/
• 26: P. Biron, A. Malhotra. XML Schema Part 2: Datatypes, 2001. httn://www.w3.org/TR/20Ol/REC-xmlschema-2- 20010502/.
• 27: A. Sahuguet, L. DuPont, T. L. Nguyen. Querying XML in the New Millennium. httn://db.cis.unenn.edu/KWEELT/.
• 28: A. R. Schmidt , Florian Waas , Martin L. Kersten , D. Florescu , I. Manolescu , M. J. Carey , R. Busse, The XML benchmark project, CWI (Centre for Mathematics and Computer Science), Amsterdam, The Netherlands, 2001
• 29: Transaction Processing Performance Council. htm:/www.tnc.org/.
• 30: T. Bray, J. Paoli, C. M. Sperberg-McQueen, E. Maler. Extensible Markup Language (XML) 1.0 (Second Edition), 2000. httu://www.w3.oralTR2OOO/REC-xml-2000 1006/.
• 31: A. Deutsch, M. Femandez, D. Florescu, A. Levy, D. Suciu. XML-QL: A query language for XML, 1998. htto://www.w3.org/TR/NOTE-xml-al/.
• 32: S. Adler, A. Berglund, J. Caruso, S. Death, P. Grosso, E. Gutentag. Extensible Stylesheet Language (XSL),2000. httn://www.w3.org/TRlxsll.
• 33: D. Chamberlin, D. Florescu, J. Robie, J. Sim. XQuery: A Query Language for XML, 2000. http://www.w3.orglTIUxmlaueryl.
• 34: S. Bressan, G. Dobbie, Z. Lacroix, M.L. Lee, U. Nambiar, Y.G. Li, B. Wadhwa. X007: Applying 007 Benchmark to XML Query Processing Tools, NUS Technical Report TRB6/0 1, June 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Experimentation, Measurement, Performance, Standardization

Keywords:
XML aware database, XML benchmarks, XML management systems, XOO7, native-XML database