Semantic term matching in axiomatic approaches to information retrieval

ABSTRACT

A common limitation of many retrieval models, including the recently proposed axiomatic approaches, is that retrieval scores are solely based on exact (i.e., syntactic) matching of terms in the queries and documents, without allowing distinct but semantically related terms to match each other and contribute to the retrieval score. In this paper, we show that semantic term matching can be naturally incorporated into the axiomatic retrieval model through defining the primitive weighting function based on a semantic similarity function of terms. We define several desirable retrieval constraints for semantic term matching and use such constraints to extend the axiomatic model to directly support semantic term matching based on the mutual information of terms computed on some document set. We show that such extension can be efficiently implemented as query expansion. Experiment results on several representative data sets show that, with mutual information computed over the documents in either the target collection for retrieval or an external collection such as the Web, our semantic expansion consistently and substantially improves retrieval accuracy over the baseline axiomatic retrieval model. As a pseudo feedback method, our method also outperforms a state-of-the-art language modeling feedback method.

REFERENCES

• 1: Mirna Adriani, Using Statistical Term Similarity for Sense Disambiguationin Cross-Language Information Retrieval, Information Retrieval, v.2 n.1, p.71-82, February 2000 [doi>10.1023/A:1009989801965]
• 2: Jing Bai , Dawei Song , Peter Bruza , Jian-Yun Nie , Guihong Cao, Query expansion using term relationships in language models for information retrieval, Proceedings of the 14th ACM international conference on Information and knowledge management, October 31-November 05, 2005, Bremen, Germany [doi>10.1145/1099554.1099725]
• 3: Adam Berger , John Lafferty, Information retrieval as statistical translation, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.222-229, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312681]
• 4: Guihong Cao , Jian-Yun Nie , Jing Bai, Integrating word relationships into language models, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076086]
• 5: Hui Fang , Tao Tao , ChengXiang Zhai, A formal study of information retrieval heuristics, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009004]
• 6: Hui Fang , ChengXiang Zhai, An exploration of axiomatic approaches to information retrieval, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076116]
• 7: Jianfeng Gao , Ming Zhou , Jian-Yun Nie , Hongzhao He , Weijun Chen, Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564409]
• 8: Jianfeng Gao , Jian-Yun Nie , Endong Xun , Jian Zhang , Ming Zhou , Changning Huang, Improving query translation for cross-language information retrieval using statistical models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.96-104, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383966]
• 9: Myung-Gil Jang , Sung Hyon Myaeng , Se Young Park, Using mutual information to resolve query translation ambiguities and query term weighting, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.223-229, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034718]
• 10: Y. Jing and W. B. Croft. An association thesaurus for information retreival. In Proceedings of RIAO 1994.
• 11: M. Lesk. Word-word associations in document retrieval systems. American Documentation 20:27--38, 1969.
• 12: Shuang Liu , Fang Liu , Clement Yu , Weiyi Meng, An effective approach to document retrieval via utilizing WordNet and recognizing phrases, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009039]
• 13: Akira Maeda , Fatiha Sadat , Masatoshi Yoshikawa , Shunsuke Uemura, Query term disambiguation for Web cross-language information retrieval using a search engine, Proceedings of the fifth international workshop on on Information retrieval with Asian languages, p.25-32, September 30-October 01, 2000, Hong Kong, China [doi>10.1145/355214.355218]
• 14: R. Mandala, T. Tokunaga, H. Tanaka, A. Okumura, and K. Satoh. Ad hoc retrieval experiments using wordnet and automatically constructed thesauri.In Proceedings of the Seventh Text REtrieval Conference (TREC-7), pages 475--481, 1998.
• 15: M. E. Maron , J. L. Kuhns, On Relevance, Probabilistic Indexing and Information Retrieval, Journal of the ACM (JACM), v.7 n.3, p.216-244, July 1960 [doi>10.1145/321033.321035]
• 16: Mandar Mitra , Amit Singhal , Chris Buckley, Improving automatic query expansion, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.206-214, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290995]
• 17: Dan Moldovan , Adrian Novischi, Lexical chains for question answering, Proceedings of the 19th international conference on Computational linguistics, p.1-7, August 24-September 01, 2002, Taipei, Taiwan [doi>10.3115/1072228.1072395]
• 18: H. J. Peat and P. Willett. The limitations of term co-occurence data for query expansion in document retrieval systems. Journal of the american society for information science 42(5): 378--383, 1991.
• 19: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]
• 20: Yonggang Qiu , Hans-Peter Frei, Concept based query expansion, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.160-169, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160713]
• 21: J. Rocchio. Relevance feedback in information retrieval. In The SMART Retrieval System: Experiments in Automatic Document Processing pages 313--323. Prentice-Hall Inc., 1971.
• 22: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 23: Hinrich Schütze , Jan O. Pedersen, A cooccurrence-based thesaurus and two applications to information retrieval, Information Processing and Management: an International Journal, v.33 n.3, p.307-318, May 1997 [doi>10.1016/S0306-4573(96)00068-4]
• 24: A. F. Smeaton and C. J. van Rijsbergen. The retrieval effects of query expansion on feedback document retrieval system. The Computer Journal 26(3): 239--246, 1983.
• 25: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 26: Ellen M. Voorhees, Query expansion using lexical-semantic relations, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.61-69, July 03-06, 1994, Dublin, Ireland
• 27: E. M. Voorhees. Overview of the trec 2004 robust retrieval track. In Proceedings of the Thirteenth Text REtrieval Conference (TREC2004), 2005.
• 28: E. M. Voorhees. Overview of the trec 2005 robust retrieval track. In Proceedings of the Fourteenth Text REtrieval Conference (TREC2005), 2006.
• 29: Jinxi Xu , W. Bruce Croft, Query expansion using local and global document analysis, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.4-11, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243202]
• 30: C. Zhai and J. Lafferty. Model-based feedback in the KL-divergence retrieval model. In Tenth International Conference on Information and Knowledge Management (CIKM 2001), pages 403--410,2001.
• 31: Chengxiang Zhai , John Lafferty, A study of smoothing methods for language models applied to Ad Hoc information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.334-342, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384019]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Experimentation

Keywords:
axiomatic model, constraints, feedback, query expansion, retrieval heuristics