Metadata management for federated databases

ABSTRACT

A federated database consists of several loosely integrated databases, where each database may contain hundreds of tables and thousands of columns,interrelated by complex foreign key relationships. In general, there exists a lot of semistructured data elements outside the database represented by documents (files), created and updated by multiple users and programs. Documents have references to multiple databases and subsets of their tables and columns. Manually tracking which specific tables and columns are referred to by a document, accessed by a specific program or user is a daunting task. With such a goal in mind, we present a system that builds metadata models for a federated database using a relational database as a central object type and metadata repository. Metadata includes table and columns coming from logical data models corresponding to each database, as well as documents representing external semistructured data sources. SQL statements assemble metadata and data types to create objects and relationships as relational tables for easy querying. We discuss potential applications in federated scientific databases.

REFERENCES

• 1: M. Atkison, F. Bancilhon, D. J. DeWitt, K. Dietrich, D. Maier, and S. Zdonik. The object oriented database system manifesto. In DOOD pages 223--240, 1989.
• 2: Michael Blaha , William Premerlani, Object-oriented modeling and design for database applications, Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 3: Peter Buneman , Susan B. Davidson , Mary F. Fernandez , Dan Suciu, Adding Structure to Unstructured Data, Proceedings of the 6th International Conference on Database Theory, p.336-350, January 08-10, 1997
• 4: Shamkant B. Navathe , Ramez A. Elmasri, Fundamentals of Database Systems with Cdrom and Book, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2001
• 5: Roy Goldman , Jennifer Widom, DataGuides: Enabling Query Formulation and Optimization in Semistructured Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.436-445, August 25-29, 1997
• 6: Anuj R. Jaiswal , C. Lee Giles , Prasenjit Mitra , James Z. Wang, An architecture for creating collaborative semantically capable scientific data sharing infrastructures, Proceedings of the 8th annual ACM international workshop on Web information and data management, November 10-10, 2006, Arlington, Virginia, USA [doi>10.1145/1183550.1183566]
• 7: Tova Milo , Sagit Zohar, Using Schema Matching to Simplify Heterogeneous Data Translation, Proceedings of the 24rd International Conference on Very Large Data Bases, p.122-133, August 24-27, 1998
• 8: Svetlozar Nestorov , Serge Abiteboul , Rajeev Motwani, Extracting schema from semistructured data, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.295-306, June 01-04, 1998, Seattle, Washington, United States
• 9: C. Ordonez and J. García-García. Consistent aggregations in databases with referential integrity errors. In ACM IQIS Workshop pages 80--89, 2006.
• 10: Carlos Ordonez , Javier García-García, Referential integrity quality metrics, Decision Support Systems, v.44 n.2, p.495-508, January, 2008 [doi>10.1016/j.dss.2007.06.004]
• 11: Mark Papiani , Jasmin L. Wason , Alistair N. Dunlop , Denis A. Nicole, A distributed scientific data archive using the Web, XML and SQL/MED, ACM SIGMOD Record, v.28 n.3, p.56-62, Sept. 1999 [doi>10.1145/333607.333614]
• 12: William J. Premerlani , James E. Rumbaugh , Michael R. Blaha , Thomas A. Varwig, An object-oriented relational database, Communications of the ACM, v.33 n.11, p.99-109, Nov. 1990 [doi>10.1145/92755.92772]
• 13: Jayavel Shanmugasundaram , Kristin Tufte , Chun Zhang , Gang He , David J. DeWitt , Jeffrey F. Naughton, Relational Databases for Querying XML Documents: Limitations and Opportunities, Proceedings of the 25th International Conference on Very Large Data Bases, p.302-314, September 07-10, 1999

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.7 Database Administration
          Subjects: Data warehouse and repository

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Scientific databases

General Terms:
Documentation, Management, Standardization

Keywords:
interoperability, metadata, repository