Multidimensional content eXploration

ABSTRACT

Content Management Systems (CMS) store enterprise data such as insurance claims, insurance policies, legal documents, patent applications, or archival data like in the case of digital libraries. Search over content allows for information retrieval, but does not provide users with great insight into the data. A more analytical view is needed through analysis, aggregations, groupings, trends, pivot tables or charts, and so on. Multidimensional Content eXploration (MCX) is about effectively analyzing and exploring large amounts of content by combining keyword search with OLAP-style aggregation, navigation, and reporting. We focus on unstructured data or generally speaking documents or content with limited metadata, as it is typically encountered in CMS. We formally present how CMS content and metadata should be organized in a well-defined multidimensional structure, so that sophisticated queries can be expressed and evaluated. The CMS metadata provide traditional OLAP static dimensions that are combined with dynamic dimensions discovered from the analyzed keyword search result, as well as measures for document scores based on the link structure between the documents. In addition, we provide means for multidimensional content exploration through traditional OLAP rollupdrilldown operations on the static and dynamic dimensions, solutions for multi-cube analysis and dynamic navigation of the content. We present our prototype, called DBPubs, which stores research publications as documents that can be searched and -most importantly-- analyzed, and explored. Finally, we present experimental results of the efficiency and effectiveness of our approach.

REFERENCES

• 1: Aris Anagnostopoulos , Andrei Z. Broder , David Carmel, Sampling Search-Engine Results, World Wide Web, v.9 n.4, p.397-429, December 2006 [doi>10.1007/s11280-006-0222-z]
• 2: Akanksha Baid , Andrey Balmin , Heasoo Hwang , Erik Nijkamp , Jun Rao , Berthold Reinwald , Alkis Simitsis , Yannis Sismanis , Frank van Ham, DBPubs: multidimensional exploration of database publications, Proceedings of the VLDB Endowment, v.1 n.2, August 2008 [doi>10.1145/1454159.1454199]
• 3: Andrey Balmin , Vagelis Hristidis , Yannis Papakonstantinou, Objectrank: authority-based keyword search in databases, Proceedings of the Thirtieth international conference on Very large data bases, p.564-575, August 31-September 03, 2004, Toronto, Canada
• 4: Nilesh Bansal , Nick Koudas, BlogScope: a system for online analysis of high volume text streams, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
• 5: Kevin Beyer , Don Chambérlin , Latha S. Colby , Fatma Özcan , Hamid Pirahesh , Yu Xu, Extending XQuery for analytics, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland [doi>10.1145/1066157.1066215]
• 6: Kevin Beyer , Peter J. Haas , Berthold Reinwald , Yannis Sismanis , Rainer Gemulla, On synopses for distinct-value estimation under multiset operations, Proceedings of the 2007 ACM SIGMOD international conference on Management of data, June 11-14, 2007, Beijing, China [doi>10.1145/1247480.1247504]
• 7: David M. Blei , John D. Lafferty, Dynamic topic models, Proceedings of the 23rd international conference on Machine learning, p.113-120, June 25-29, 2006, Pittsburgh, Pennsylvania [doi>10.1145/1143844.1143859]
• 8: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Computer Networks and ISDN Systems, v.30 n.1-7, p.107-117, April 1, 1998
• 9: Surajit Chaudhuri , Umeshwar Dayal, An overview of data warehousing and OLAP technology, ACM SIGMOD Record, v.26 n.1, p.65-74, March 1997 [doi>10.1145/248603.248616]
• 10: CiteSeer. http://citeseer.ist.psu.edu.
• 11: DBLP. http://www.informatik.uni-trier.de/ley/db.
• 12: S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantic analysis. JASIS, 41(6):391--407, 1990.
• 13: Pedro DeRose , Warren Shen , Fei Chen , AnHai Doan , Raghu Ramakrishnan, Building structured web community portals: a top-down, compositional, and incremental approach, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
• 14: J. Diederich. Faceted DBLP, http://dblp.13s.de.
• 15: Eventseer. http://eventseer.net.
• 16: G. H. Golub and C. Reinsch. Singular value decomposition and least squares solutions. Numerische Mathematik, 14(5):403--420, 1970.
• 17: Jim Gray , Adam Bosworth , Andrew Layman , Hamid Pirahesh, Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total, Proceedings of the Twelfth International Conference on Data Engineering, p.152-159, February 26-March 01, 1996
• 18: Harzing. Publish or Perish, http://www.harzing.com/pop.htm.
• 19: Thomas Hofmann, Probabilistic latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.50-57, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312649]
• 20: Carlos A. Hurtado , Claudio Gutierrez , Alberto O. Mendelzon, Capturing summarizability with integrity constraints in OLAP, ACM Transactions on Database Systems (TODS), v.30 n.3, p.854-886, September 2005 [doi>10.1145/1093382.1093388]
• 21: Y. E. Ioannidis, D. Maier, S. Abiteboul, P. Buneman, S. B. Davidson, E. A. Fox, A. Y. Halevy, C. A. Knoblock, F. Rabitti, H.-J. Schek, and G. Weikum. Digital library information-technology infrastructures. Int. J. on Digital Libraries, 5(4):266--274, 2005.
• 22: Ralph Kimball , Laura Reeves , Warren Thornthwaite , Margy Ross , Warren Thornwaite, The Data Warehouse Lifecycle Toolkit: Expert Methods for Designing, Developing and Deploying Data Warehouses with CD Rom, John Wiley & Sons, Inc., New York, NY, 1998
• 23: Jens Lechtenbörger , Gottfried Vossen, Multidimensional normal forms for data warehouse design, Information Systems, v.28 n.5, p.415-434, July 2003 [doi>10.1016/S0306-4379(02)00024-8]
• 24: Wolfgang Lehner , Jens Albrecht , Hartmut Wedekind, Normal Forms for Multidimensional Databases, Proceedings of the 10th International Conference on Scientific and Statistical Database Management, p.63-72, July 01-03, 1998 [doi>10.1109/SSDM.1998.688112]
• 25: Hans-Joachim Lenz , Arie Shoshani, Summarizability in OLAP and Statistical Data Bases, Proceedings of the Ninth International Conference on Scientific and Statistical Database Management, p.132-143, August 11-13, 1997 [doi>10.1109/SSDM.1997.621175]
• 26: Gurmeet Singh Manku , Rajeev Motwani, Approximate frequency counts over data streams, Proceedings of the 28th international conference on Very Large Data Bases, p.346-357, August 20-23, 2002, Hong Kong, China
• 27: Andrew McCallum , Kamal Nigam , Lyle H. Ungar, Efficient clustering of high-dimensional data sets with application to reference matching, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.169-178, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347123]
• 28: Mondial, http://www.dbis.informatik.uni-goettingen.de/mondial.
• 29: Torben Bach Pedersen , Christian S. Jensen , Curtis E. Dyreson, A foundation for capturing and querying complex multidimensional data, Information Systems, v.26 n.5, p.383-423, July 2001 [doi>10.1016/S0306-4379(01)00023-0]
• 30: Maurizio Rafanelli , Arie Shoshani, STORM: A Statistical Object Representation Model, Proceedings of the 5th International Conference SSDBM on Statistical and Scientific Database Management, p.14-29, April 03-05, 1990
• 31: Amit Shukla , Prasad Deshpande , Jeffrey F. Naughton, Materialized View Selection for Multi-Cube Data Models, Proceedings of the 7th International Conference on Extending Database Technology: Advances in Database Technology, p.269-284, March 27-31, 2000
• 32: D. Takuma and I. Yoshida. Top-n keyword calculation on dynamically selected documents. IBM Research Report, RT-0760, October 2007.
• 33: Daniel S. Whelan, FileNet integrated document management database usage and issues, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.533, June 01-04, 1998, Seattle, Washington, United States
• 34: Ping Wu , Yannis Sismanis , Berthold Reinwald, Towards keyword-driven analytical processing, Proceedings of the 2007 ACM SIGMOD international conference on Management of data, June 11-14, 2007, Beijing, China [doi>10.1145/1247480.1247549]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
      H.3.3 Information Search and Retrieval
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Design, Management, Performance