Supporting annotations on relations

ABSTRACT

Annotations play a key role in understanding and curating databases. Annotations may represent comments, descriptions, lineage information, among several others. Annotation management is a vital mechanism for sharing knowledge and building an interactive and collaborative environment among database users and scientists. What makes it challenging is that annotations can be attached to database entities at various granularities, e.g., at the table, tuple, column, cell levels, or more generally, to any subset of cells that results from a select statement. Therefore, simple comment fields in tuples would not work because of the combinatorial nature of the annotations. In this paper, we present extensions to current database management systems to support annotations. We propose storage schemes to efficiently store annotations at multiple granularities, i.e., at the table, tuple, column, and cell levels. Compared to storing the annotations with the individual cells, the proposed schemes achieve more than an order-of-magnitude reduction in storage and up to 70% saving in the query execution time. We define types of annotations that inherit different behaviors. Through these types, users can specify, for example, whether or not an annotation is continuously applied over newly inserted data and whether or not an annotation is archived when the base data is modified. These annotation types raise several storage and processing challenges that are addressed in the paper. We propose declarative ways to add, archive, query, and propagate annotations. The proposed mechanisms are realized through extensions to the standard SQL. We implemented the proposed functionalities inside PostgreSQL with an easy to use Excel-based front-end graphical interface.

REFERENCES

• 1: Oracle life sciences platform, www.oracle.com/.technology/industries/life_sciences/index.html.
• 2: Deepavali Bhagwat , Laura Chiticariu , Wang-Chiew Tan , Gaurav Vijayvargiya, An annotation management system for relational databases, Proceedings of the Thirtieth international conference on Very large data bases, p.900-911, August 31-September 03, 2004, Toronto, Canada
• 3: D. Bhagwat, L. Chiticariu, W. Tan, and G. Vijayvargiya. An annotation management system for relational databases. VLDB Journal, 14(5), 2005.
• 4: Peter Buneman , James Cheney , Wang-Chiew Tan , Stijn Vansummeren, Curated databases, Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 09-12, 2008, Vancouver, Canada [doi>10.1145/1376916.1376918]
• 5: Peter Buneman , Sanjeev Khanna , Wang-Chiew Tan, On propagation of deletions and annotations through views, Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 03-05, 2002, Madison, Wisconsin [doi>10.1145/543613.543633]
• 6: Laura Chiticariu , Wang-Chiew Tan , Gaurav Vijayvargiya, DBNotes: a post-it system for relational databases based on provenance, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066296]
• 7: M. Eltabakh, M. Ouzzani, and W. Aref. bdbms: A database management system for biological data. In CIDR, pages 196--206, 2007.
• 8: M. Eltabakh, M. Ouzzani, W. Aref, A. Elmagarmid, Y. Laura-Silva, M. Arshad, D. Salt, and I. Baxter. Managing biological data using bdbms. In ICDE, pages 1600--1603, 2008.
• 9: F. Geerts and J. V. D. Bussche. Relational completeness of query languages for annotated databases. DBPL, 4797:127--137, 2007.
• 10: Floris Geerts , Anastasios Kementsietsidis , Diego Milano, MONDRIAN: Annotating and Querying Databases through Colors and Blocks, Proceedings of the 22nd International Conference on Data Engineering, p.82, April 03-07, 2006 [doi>10.1109/ICDE.2006.102]
• 11: Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alex Szalay , David J. DeWitt , Gerd Heber, Scientific data management in the coming decade, ACM SIGMOD Record, v.34 n.4, p.34-41, December 2005 [doi>10.1145/1107499.1107503]
• 12: L. M. Haas , P. M. Schwarz , P. Kodali , E. Kotlar , J. E. Rice , W. C. Swope, DiscoveryLink: a system for integrated access to life sciences data sources, IBM Systems Journal, v.40 n.2, p.489-511, February 2001
• 13: H. V. Jagadish , Frank Olken, Database management for life sciences research, ACM SIGMOD Record, v.33 n.2, June 2004 [doi>10.1145/1024694.1024697]
• 14: Yogesh L. Simmhan , Beth Plale , Dennis Gannon, A survey of data provenance in e-science, ACM SIGMOD Record, v.34 n.3, September 2005 [doi>10.1145/1084805.1084812]
• 15: W. C. Tan. Containment of relational queries with annotation propagation. In DBPL, 2003.