Your mediators need data conversion!

ABSTRACT

Due to the development of the World Wide Web, the integration of heterogeneous data sources has become a major concern of the database community. Appropriate architectures and query languages have been proposed. Yet, the problem of data conversion which is essential for the development of mediators/wrappers architectures has remained largely unexplored. In this paper, we present the YAT system for data conversion. This system provides tools for the specification and the implementation of data conversions among heterogeneous data sources. It relies on a middleware model, a declarative language, a customization mechanism and a graphical interface. The model is based on named trees with ordered and labeled nodes. Like semistructured data models, it is simple enough to facilitate the representation of any data. Its main originality is that it allows to reason at various levels of representation. The YAT conversion language (called YATL) is declarative, rule-based and features enhanced pattern matching facilities and powerful restructuring primitives. It allows to preserve or reconstruct the order of collections. The customization mechanism relies on program instantiations: an existing program may be instantiated into a more specific one, and then easily modified. We also present the architecture, implementation and practical use of the YAT prototype, currently under evaluation within the OPAL* project.

REFERENCES

• 1: Witold Litwin , Leo Mark , Nick Roussopoulos, Interoperability of multiple autonomous databases, ACM Computing Surveys (CSUR), v.22 n.3, p.267-293, Sept. 1990 [doi>10.1145/96602.96608]
• 2: M. J. Carey , L. M. Haas , P. M. Schwarz , M. Arya , W. F. Cody , R. Fagin , M. Flickner , A. W. Luniewski , W. Niblack , D. Petkovic , J. Thomas , J. H. Williams , E. L. Wimmers, Towards heterogeneous multimedia information systems: the Garlic approach, Proceedings of the 5th International Workshop on Research Issues in Data Engineering-Distributed Object Management (RIDE-DOM'95), p.124, March 06-07, 1995
• 3: Yannis Papakonstantinou , Hector Garcia-Molina , Jennifer Widom, Object Exchange Across Heterogeneous Information Sources, Proceedings of the Eleventh International Conference on Data Engineering, p.251-260, March 06-10, 1995
• 4: Scaling heterogeneous databases and the design of Disco, Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96), p.449, May 27-30, 1996
• 5: S. Adali , K. S. Candan , Y. Papakonstantinou , V. S. Subrahmanian, Query caching and optimization in distributed mediator systems, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.137-146, June 04-06, 1996, Montreal, Quebec, Canada
• 6: Peter Buneman , Susan Davidson , Gerd Hillebrand , Dan Suciu, A query language and optimization techniques for unstructured data, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.505-516, June 04-06, 1996, Montreal, Quebec, Canada
• 7: S. Abiteboul, D. Quass, J. McHugh, J. Widom, and 3. L. Wiener, "The lorel query language for semistructured data," International Journal on Digital Libraries, vol. 1, no. 1, pp. 68-88, Apr. 1997.
• 8: Mary Fernandez , Daniela Florescu , Alon Levy , Dan Suciu, A query language for a Web-site management system, ACM SIGMOD Record, v.26 n.3, p.4-11, Sept. 1997 [doi>10.1145/262762.262763]
• 9: Roy Goldman , Jennifer Widom, DataGuides: Enabling Query Formulation and Optimization in Semistructured Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.436-445, August 25-29, 1997
• 10: Peter Buneman , Susan B. Davidson , Dan Suciu, Programming Constructs for Unstructured Data, Proceedings of the Fifth International Workshop on Database Programming Languages, p.12, September 06-08, 1995
• 11: Serge Abiteboul , Sophie Cluet , Tova Milo, Correspondence and Translation for Heterogeneous Data, Proceedings of the 6th International Conference on Database Theory, p.351-363, January 08-10, 1997
• 12: Michael Kifer , Won Kim , Yehoshua Sagiv, Querying object-oriented databases, Proceedings of the 1992 ACM SIGMOD international conference on Management of data, p.393-402, June 02-05, 1992, San Diego, California, United States
• 13: Yannis Papakonstantinou , Serge Abiteboul , Hector Garcia-Molina, Object Fusion in Mediator Systems, Proceedings of the 22th International Conference on Very Large Data Bases, p.413-424, September 03-06, 1996
• 14: X. Leroy, The Objective Carol system release 1.07, IN- RIA, Dec. 1997, Documentation and user's manual. f tp ://ftp. inri a. fr/lang/caml- light/.
• 15: U. Dayal and H. Hwang, "View definition and generalisation for database integration in multibase: A system for heterogeneous distributed databases," IEEE Transactions on Software Engineering, vol. 10, no. 6, pp. 628-644, Nov. 1984.
• 16: Serge Abiteboul , Richard Hull, Restructuring hierarchical database objects, Theoretical Computer Science, v.62 n.1-2, p.3-38, December 1988 [doi>10.1016/0304-3975(86)90010-1]
• 17: Anthony Simon Kosky, Transforming databases with recursive data structures, University of Pennsylvania, Philadelphia, PA, 1996
• 18: Yannis Papakonstantinou , Hector Garcia-Molina , Jeffrey D. Ullman, MedMaker: A Mediation System Based on Declarative Specifications, Proceedings of the Twelfth International Conference on Data Engineering, p.132-141, February 26-March 01, 1996
• 19: Serge Abiteboul, Querying Semi-Structured Data, Proceedings of the 6th International Conference on Database Theory, p.1-18, January 08-10, 1997
• 20: Susan B. Davidson , Anthony Kosky, WOL: A Language for Database Transformations and Constraints, Proceedings of the Thirteenth International Conference on Data Engineering, p.55-65, April 07-11, 1997
• 21: S. Cluet and J. Simeon, "Data integration based on data conversion and restructuring," Technical report, Verso database group- INRIA, Oct. 1997, hZZp : //www-rocq. inria, fr/verso / Jerome. S ime on/YAT/.
• 22: Leonidas Fegaras , David Maier, Towards an effective calculus for object query languages, Proceedings of the 1995 ACM SIGMOD international conference on Management of data, p.47-58, May 22-25, 1995, San Jose, California, United States
• 23: Leonid Libkin , Rona Machlin , Limsoon Wong, A query language for multidimensional arrays: design, implementation, and optimization techniques, Proceedings of the 1996 ACM SIGMOD international conference on Management of data, p.228-239, June 04-06, 1996, Montreal, Quebec, Canada
• 24: Arunprasad P. Marathe , Kenneth Salem, A Language for Manipulating Arrays, Proceedings of the 23rd International Conference on Very Large Data Bases, p.46-55, August 25-29, 1997
• 25: 02 Technology, Versailles, The 02 Web Reference Manual version 4.6, Sept. 1996.
• 26: K. Smaga, "Interface graphique pour la traduction de donn~es," M.S. thesis, Universit~ Paris VI-CNAM- ENST~ Sept. 1997.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Web-based interaction

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.5 Local and Wide-Area Networks
          Subjects: Internet (e.g., TCP/IP)

  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.1 Logical Design
          Subjects: Data models
      H.2.4 Systems
          Subjects: Relational databases
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Web-based services

General Terms:
Languages