On the design and evaluation of a multi-dimensional approach to information retrieval (poster session)

ABSTRACT

We present a method of searching text collections that takes advantage of hierarchrical information within documents and integrates searches of structured and unstructured data. We show that Multidimensional databases (MDB), designed for accessing data along hierarchical dimensions, are effective for information retrieval. We demonstrate a method of using On-Line Analytic Processing (OLAP) techniques on a text collection. This combines traditional information retrieval and the slicing, dicing, drill-down, and roll-up of OLAP. We demonstrate use of a prototype for searching documents from the TREC collection.

REFERENCES

• 1: Marc Gyssens , Laks V. S. Lakshmanan, A Foundation for Multi-dimensional Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.106-115, August 25-29, 1997
• 2: G. Salton , A. Wong , C. S. Yang, A vector space model for automatic indexing, Communications of the ACM, v.18 n.11, p.613-620, Nov. 1975 [doi>10.1145/361219.361220]
• 3: David A. Grossman , Ophir Frieder, Information Retrieval: Algorithms and Heuristics, Kluwer Academic Publishers, Norwell, MA, 1998
• 4: Proceedings of the Text Retrieval Evaluation Conference TREC8, by NIST and ARPA 1999.
• 5: David A. Grossman , Ophir Frieder , David O. Holmes , David C. Roberts, Integrating structured data and text: a relational approach, Journal of the American Society for Information Science, v.48 n.2, p.122-132, Feb. 1997 [doi>10.1002/(SICI)1097-4571(199702)48:2<122::AID-ASI3>3.0.CO;2-#]
• 6: Clifford A. Lynch , Michael Stonebraker, Extended User-Defined Indexing with Application to Textual Databases, Proceedings of the 14th International Conference on Very Large Data Bases, p.306-317, August 29-September 01, 1988
• 7: I. Macleod. Sequel as a language for document retrieval. JASIS, Pages 243-249, September 1979.
• 8: Jinho Lee , David Grossman , Ophir Frieder , M. Catherine McCabe, Integrating Structured Data and Text: A Multi-Dimensional Approach, Proceedings of the The International Conference on Information Technology: Coding and Computing (ITCC'00), p.264, March 27-29, 2000
• 9: R. Kimball, Data Warehouse Toolkit, John Wiley & Sons, '96.
• 10: Amit Singhal , Chris Buckley , Mandar Mitra, Pivoted document length normalization, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.21-29, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243206]
• 11: Advanced MDX query available at http://msdn.microsoft.com/library/sdlcdoc/dasdk/olap8rg 8:html.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Text processing

General Terms:
Design, Experimentation, Performance