Configurable indexing and ranking for XML information retrieval

ABSTRACT

Indexing and ranking are two key factors for efficient and effective XML information retrieval. Inappropriate indexing may result in false negatives and false positives, and improper ranking may lead to low precisions. In this paper, we propose a configurable XML information retrieval system, in which users can configure appropriate index types for XML tags and text contents. Based on users' index configurations, the system transforms XML structures into a compact tree representation, Ctree, and indexes XML text contents. To support XML ranking, we propose the concepts of "weighted term frequency" and "inverted element frequency," where the weight of a term depends on its frequency and location within an XML element as well as its popularity among similar elements in an XML dataset. We evaluate the effectiveness of our system through extensive experiments on the INEX 03 dataset and 30 content and structure (CAS) topics. The experimental results reveal that our system has significantly high precision at low recall regions and achieves the highest average precision (0.3309) as compared with 38 official INEX 03 submissions using the strict evaluation metric.

REFERENCES

• 1: S. Amer-Yahia, M. Fernandez, D. Srivastava and Y. Xu. Phrase Matching in XML. In VLDB 2003, pp. 177--188, 2003.
• 2: Ricardo Baeza Yates , Norbert Fuhr , Yoelle S. Maarek, Second edition of the "XML and information retrieval" workshop held at SIGIR'2002, Tampere, Finland, Aug 15^th, 2002, ACM SIGIR Forum, v.36 n.2, Fall 2002 [doi>10.1145/792550.792560]
• 3: David Carmel , Yoelle S. Maarek , Matan Mandelbrod , Yosi Mass , Aya Soffer, Searching XML documents via XML fragments, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860464]
• 4: Norbert Fuhr , Kai Großjohann, XIRQL: a query language for information retrieval in XML documents, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.172-180, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383985]
• 5: T. Grabs and H. J. Schek. Generating Vector Spaces On-the-fly for Flexible XML Retrieval. In {1}.
• 6: Roy Goldman , Jennifer Widom, DataGuides: Enabling Query Formulation and Optimization in Semistructured Databases, Proceedings of the 23rd International Conference on Very Large Data Bases, p.436-445, August 25-29, 1997
• 7: G. Kazai, M. Lalmas and S. Malik. INEX'03 Guidelines for Topic Development.
• 8: G. Kazai, M. Lalmas and B. Piwowarski. INEX'03 Relevance Assessment Guide.
• 9: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 10: Torsten Schlieder , Holger Meuss, Querying and ranking XML documents, Journal of the American Society for Information Science and Technology, v.53 n.6, p.489-503, May, 2002 [doi>10.1002/asi.10060]
• 11: Anja Theobald , Gerhard Weikum, Adding Relevance to XML, Selected papers from the Third International Workshop WebDB 2000 on The World Wide Web and Databases, p.105-124, May 18-19, 2000
• 12: Q. Zou, S. Liu and W. Chu. Ctree: A Compact Two-level Bidirectional Tree for Indexing XML Data. UCLA-CS Technical Report #TR040010, 2004.
• 13: INitiative for the evaluation of XML Retrieval. http://qmir.dcs.qmul.ac.uk/INEX
• 14: XPATH. http://www.w3.org/TR/xpath. http://fargo.cs.ucla.edu/inexdemo/inexsearch.aspx.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Experimentation

Keywords:
XML indexing, XML information retrieval, XML ranking, ranking