A method for online analytical processing of text data

ABSTRACT

There are increasingly visible demands for structured/ unstructured information integration and advanced analytics. However, conventional database technology has not been able to present a robust and practical implementation of a truly integrated architecture for such purposes. After working on several industrial applications (in particular, in the healthcare and life sciences area), we have identified fundamental issues and technical approaches to tackle the issues. In this paper, we propose data representations and algebraic operations for integrating semantic information (e.g., ontologies) into OLAP systems, which allow us to analyze a huge set of textual documents with their underlying semantic information. The performance of the prototype implementation has been evaluated using real world datasets, and the high scalability and flexibility of our approach have been confirmed with respect to the computation time.

REFERENCES

• 1: Sameet Agarwal , Rakesh Agrawal , Prasad Deshpande , Ashish Gupta , Jeffrey F. Naughton , Raghu Ramakrishnan , Sunita Sarawagi, On the Computation of Multidimensional Aggregates, Proceedings of the 22th International Conference on Very Large Data Bases, p.506-521, September 03-06, 1996
• 2: Peter Baumann , Andreas Dehmel , Paula Furtado , Roland Ritsch , Norbert Widmann, Spatio-Temporal Retrieval with RasDaMan, Proceedings of the 25th International Conference on Very Large Data Bases, p.746-749, September 07-10, 1999
• 3: P. Bonatti et al. An Ontology-extended Relational Algebra. Proc. of Int'l Conf. on Information Reuse and Integration, pp. 192--199, 2003.
• 4: Venkatesan T. Chakaravarthy , Himanshu Gupta , Prasan Roy , Mukesh Mohania, Efficiently linking text documents with relevant structured information, Proceedings of the 32nd international conference on Very large data bases, September 12-15, 2006, Seoul, Korea
• 5: Eugene Charniak, Statistical Language Learning, MIT Press, Cambridge, MA, 1996
• 6: Edith Cohen , Haim Kaplan , Tova Milo, Labeling dynamic XML trees, Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 03-05, 2002, Madison, Wisconsin [doi>10.1145/543613.543648]
• 7: Paul F. Dietz, Maintaining order in a linked list, Proceedings of the fourteenth annual ACM symposium on Theory of computing, p.122-127, May 05-07, 1982, San Francisco, California, United States [doi>10.1145/800070.802184]
• 8: Ronald Fagin , R. Guha , Ravi Kumar , Jasmine Novak , D. Sivakumar , Andrew Tomkins, Multi-structural databases, Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 13-15, 2005, Baltimore, Maryland [doi>10.1145/1065167.1065191]
• 9: D. Ferrucci , A. Lally, Building an example application with the unstructured information management architecture, IBM Systems Journal, v.43 n.3, p.455-475, July 2004
• 10: Sanjay Goil , Alok Choudhary, High performance multidimensional analysis of large datasets, Proceedings of the 1st ACM international workshop on Data warehousing and OLAP, p.34-39, November 02-07, 1998, Washington, D.C., United States [doi>10.1145/294260.294269]
• 11: Torsten Grust, Accelerating XPath location steps, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564705]
• 12: Himanshu Gupta , Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman, Index Selection for OLAP, Proceedings of the Thirteenth International Conference on Data Engineering, p.208-219, April 07-11, 1997
• 13: Marc Gyssens , Laks V. S. Lakshmanan, A Foundation for Multi-dimensional Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.106-115, August 25-29, 1997
• 14: Kazuhito Kobayashi , Wenxin Wenxin , Dai Kobayashi , Akitsugu Watanabe , Haruo Yokota, VLEI Code: An Efficient Labeling Method for Handling XML Documents in an RDB, Proceedings of the 21st International Conference on Data Engineering, p.386-387, April 05-08, 2005 [doi>10.1109/ICDE.2005.153]
• 15: Yong Kyu Lee , Seong-Joon Yoo , Kyoungro Yoon , P. Bruce Berra, Index structures for structured documents, Proceedings of the first ACM international conference on Digital libraries, p.91-99, March 20-23, 1996, Bethesda, Maryland, United States [doi>10.1145/226931.226950]
• 16: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 17: M. Catherine McCabe , Jinho Lee , Abdur Chowdhury , David Grossman , Ophir Frieder, On the design and evaluation of a multi-dimensional approach to information retrieval (poster session), Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.363-365, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345656]
• 18: Josiane Mothe , Claude Chrisment , Bernard Dousset , Joel Alaux, DocCube: multi-dimensional visualisation and exploration of large document sets, Journal of the American Society for Information Science and Technology, v.54 n.7, p.650-659, May 2003 [doi>10.1002/asi.10257]
• 19: T. Nasukawa , T. Nagano, Text analysis and knowledge mining system, IBM Systems Journal, v.40 n.4, p.967-984, October 2001
• 20: Jakob Nielsen, Designing Web Usability: The Practice of Simplicity, New Riders Publishing, Thousand Oaks, CA, 1999
• 21: T. Niemi et al. Logical Multidimensional Database Design for Ragged and Unbalanced Aggregation. Proc. of Int'l Wks. on Design and Management of Data Warehouses, pp. 7, 2001.
• 22: Multidimensional Data Modeling for Complex Data, Proceedings of the 15th International Conference on Data Engineering, p.336, March 23-26, 1999
• 23: Torben Bach Pedersen , Christian S. Jensen, Multidimensional Database Technology, Computer, v.34 n.12, p.40-46, December 2001 [doi>10.1109/2.970558]
• 24: Juan Manuel Pérez , Rafael Berlanga , María José Aramburu , Torben Bach Pedersen, A relevance-extended multi-dimensional model for a data warehouse contextualized with documents, Proceedings of the 8th ACM international workshop on Data warehousing and OLAP, November 04-05, 2005, Bremen, Germany [doi>10.1145/1097002.1097007]
• 25: J. Pérez et al. IR and OLAP in XML Document Warehouses. Proc. of European Conf. on IR Research, pp. 536--539, 2005.
• 26: Igor Tatarinov , Stratis D. Viglas , Kevin Beyer , Jayavel Shanmugasundaram , Eugene Shekita , Chun Zhang, Storing and querying ordered XML using a relational database system, Proceedings of the 2002 ACM SIGMOD international conference on Management of data, June 03-06, 2002, Madison, Wisconsin [doi>10.1145/564691.564715]
• 27: N. Uramoto , H. Matsuzawa , T. Nagano , A. Murakami , H. Takeuchi , K. Takeda, A text-mining system for knowledge discovery from biomedical documents, IBM Systems Journal, v.43 n.3, p.516-533, July 2004
• 28: Xiaodong Wu , Mong Li Lee , Wynne Hsu, A Prime Number Labeling Scheme for Dynamic Ordered XML Trees, Proceedings of the 20th International Conference on Data Engineering, p.66, March 30-April 02, 2004

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications

General Terms:
Performance

Keywords:
olap, text mining