Searching XML documents via XML fragments

ABSTRACT

Most of the work on XML query and search has stemmed from the publishing and database communities, mostly for the needs of business applications. Recently, the Information Retrieval community began investigating the XML search issue to answer information discovery needs. Following this trend, we present here an approach where information needs can be expressed in an approximate manner as pieces of XML documents or "XML fragments" of the same nature as the documents that are being searched. We present an extension of the vector space model for searching XML collections via XML fragments and ranking results by relevance. We describe how we have extended a full-text search engine to comply with this model. The value of the proposed method is demonstrated by the relative high precision of our system, which was among the top performers in the recent INEX workshop. Our results indicate that certain queries are more appropriate than others for the extended vector space model. Specifically, queries with relatively specific contexts but vague information needs are best situated to reap the benefit of this model. Finally our results show that one method may not fit all types of queries and that it could be worthwhile to use different solutions for different applications.

REFERENCES

• 1: Alain Azagury , Michael E. Factor , Yoelle S. Maarek , Benny Mandler, A novel navigation paradigm for XML repositories, Journal of the American Society for Information Science and Technology, v.53 n.6, p.515-525, May, 2002 [doi>10.1002/asi.10062]
• 2: R. Baeza-Yates, D. Carmel, Y. Maarek and A. Soffer (eds), JASIST Special Issue on XML and Information Retrieval, 53: 6, 2002
• 3: R. Baeza-Yates, N. Fuhr and Y. Maarek, Second Edition of the XML and IR Workshop, In SIGIR Forum, Volume 36 Number 2, Fall 2002
• 4: Andrei Broder, A taxonomy of web search, ACM SIGIR Forum, v.36 n.2, Fall 2002 [doi>10.1145/792550.792552]
• 5: D. Carmel, E. Amitay, M. Herscovici, Y. Maarek, Y. Petruschka and A. Soffer, "Juru at TREC 10 - Experiments with Index Pruning", in Proceedings of NIST TREC 10, Nov 2001.
• 6: D. Carmel, N. Efraty, G. Landau, Y. Maarek, and Y. Mass, "An Extension of the Vector Space Model for Querying XML Documents via XML Fragments", in {3}.
• 7: David Carmel , Yoelle Maarek , Aya Soffer, XML and information retrieval: a SIGIR 2000 workshop, ACM SIGIR Forum, v.34 n.1, p.31-36, April 2000 [doi>10.1145/373593.373624]
• 8: D. Chamberlin, P. Fankhauser, M. Marchiori and J. Robie, XML Query Use Cases, W3C Working Draft 20 Dec 2001, http://www.w3.org/TR/2001/WD-xmlquery-use-cases-20011220
• 9: Norbert Fuhr , Kai Großjohann, XIRQL: a query language for information retrieval in XML documents, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.172-180, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383985]
• 10: N. Fuhr and K. GrossJohann, "Query Formulation and Results Visualization for XML Retrieval", in {3}.
• 11: T. Grabs and H. J. Schek, "Generating Vector Spaces On-the-fly for Flexible XML Retrieval", in {3}.
• 12: INEX evaluation software, downloadable from http://ls6-www.cs.uni-dortmund.de/ir/projects/inex/download
• 13: Initiative for the evaluation of XML retrieval http://qmir.dcs.qmul.ac.uk/INEX/
• 14: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 15: Gerard Salton , J. Allan , Chris Buckley, Approaches to passage retrieval in full text information systems, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.49-58, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160693]
• 16: Ellen M. Voorhees , Chris Buckley, The effect of topic set size on retrieval experiment error, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564432]
• 17: XQuery, the XML Query language, http://www.w3.org/TR/2002/WD-xquery-20020430

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Experimentation

Keywords:
XML fragments, XML search & retrieval, vector space model