Positional language models for information retrieval

ABSTRACT

Although many variants of language models have been proposed for information retrieval, there are two related retrieval heuristics remaining "external" to the language modeling approach: (1) proximity heuristic which rewards a document where the matched query terms occur close to each other; (2) passage retrieval which scores a document mainly based on the best matching passage. Existing studies have only attempted to use a standard language model as a "black box" to implement these heuristics, making it hard to optimize the combination parameters.

In this paper, we propose a novel positional language model (PLM) which implements both heuristics in a unified language model. The key idea is to define a language model for each position of a document, and score a document based on the scores of its PLMs. The PLM is estimated based on propagated counts of words within a document through a proximity-based density function, which both captures proximity heuristics and achieves an effect of "soft" passage retrieval. We propose and study several representative density functions and several different PLM-based document ranking strategies. Experiment results on standard TREC test collections show that the PLM is effective for passage retrieval and performs better than a state-of-the-art proximity-based retrieval model.

REFERENCES

• 1: Milton Abramowitz and Irene A. Stegun. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. Dover, New York, 1964.
• 2: Stefan Buttcher and Charles L. A. Clarke. E±ciency vs. effectiveness in terabyte-scale information retrieval. In Proceedings of TREC '05, 2005.
• 3: Stefan Büttcher , Charles L. A. Clarke , Brad Lushman, Term proximity scoring for ad-hoc retrieval on very large text collections, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148285]
• 4: James P. Callan, Passage-level evidence in document retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.302-310, July 03-06, 1994, Dublin, Ireland
• 5: Charles L. A. Clarke, Gordon V. Cormack, and Forbes J. Burkowski. Shortest substring ranking (multitext experiments for trec-4). In Proceedings of TREC '95, pages 295--304, 1995.
• 6: Owen de Kretser , Alistair Moffat, Effective document presentation with a locality-based similarity heuristic, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.113-120, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312664]
• 7: David Hawking and Paul B. Thistlewaite. Proximity operators -- so near and yet so far. In Proceedings of TREC '95, pages 500--236, 1995.
• 8: Marcin Kaszkiel , Justin Zobel, Passage retrieval revisited, Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, p.178-185, July 27-31, 1997, Philadelphia, Pennsylvania, United States
• 9: Marcin Kaszkiel , Justin Zobel, Effective ranking with arbitrary passages, Journal of the American Society for Information Science and Technology, v.52 n.4, p.344-364, Feb. 2001 [doi>10.1002/1532-2890(2000)9999:9999<::AID-ASI1075>3.3.CO;2-R]
• 10: Marcin Kaszkiel , Justin Zobel , Ron Sacks-Davis, Efficient passage ranking for document databases, ACM Transactions on Information Systems (TOIS), v.17 n.4, p.406-439, Oct. 1999 [doi>10.1145/326440.326445]
• 11: E. Michael Keen, The use of term position devices in ranked output experiments, Journal of Documentation, v.47 n.1, p.1-22, March 1991 [doi>10.1108/eb026869]
• 12: E. Michael Keen, Some aspects of proximity searching in text retrieval systems, Journal of Information Science, v.18 n.2, p.89-98, 1992 [doi>10.1177/016555159201800202]
• 13: Koichi Kise, Markus Junker, Andreas Dengel, and Keinosuke Matsumoto. Passage Retrieval Based on Density Distributions of Terms and Its Applications to Document Retrieval and Question Answering, volume 2956 of Lecture Notes in Computer Science. Springer Berlin/Heidelberg, 2004.
• 14: John Lafferty , Chengxiang Zhai, Document language models, query models, and risk minimization for information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.111-119, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383970]
• 15: Victor Lavrenko , W. Bruce Croft, Relevance based language models, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.120-127, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383972]
• 16: Xiaoyong Liu , W. Bruce Croft, Passage retrieval based on language models, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA [doi>10.1145/584792.584854]
• 17: Xiaoyong Liu , W. Bruce Croft, Cluster-based retrieval using language models, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009026]
• 18: David E. Losada , Leif Azzopardi, An analysis on document length retrieval trends in language modeling smoothing, Information Retrieval, v.11 n.2, p.109-138, April 2008 [doi>10.1007/s10791-007-9040-x]
• 19: Annabelle Mercier and Michel Beigbeder. Fuzzy proximity ranking with boolean queries. In Proceedings of TREC '05, 2005.
• 20: Donald Metzler , W. Bruce Croft, A Markov random field model for term dependencies, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076115]
• 21: Christof Monz. Minimal span weighting retrieval for question answering. In Rob Gaizauskas, Mark Greenwood, and Mark Hepple, editors, SIGIR Workshop on Information Retrieval for Question Answering, pages 23--30, 2004.
• 22: Desislava Petkova , W. Bruce Croft, Proximity-based document representation for named entity retrieval, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321542]
• 23: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]
• 24: Yves Rasolofo and Jacques Savoy. Term proximity scoring for keyword--based retrieval systems. In Proceedings of ECIR '03, pages 207--218, 2003.
• 25: Gerard Salton , J. Allan , Chris Buckley, Approaches to passage retrieval in full text information systems, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.49-58, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160693]
• 26: Fei Song , W. Bruce Croft, A general language model for information retrieval, Proceedings of the eighth international conference on Information and knowledge management, p.316-321, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.320022]
• 27: Ruihua Song, Ji-Rong Wen, and Wei-Ying Ma. Viewing term proximity from a different perspective. In Proceedings of ECIR'08, 2008.
• 28: Tao Tao , ChengXiang Zhai, An exploration of proximity measures in information retrieval, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277794]
• 29: Stefanie Tellex , Boris Katz , Jimmy Lin , Aaron Fernandes , Gregory Marton, Quantitative evaluation of passage retrieval algorithms for question answering, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860445]
• 30: ChengXiang Zhai, Statistical Language Models for Information Retrieval A Critical Review, Foundations and Trends in Information Retrieval, v.2 n.3, p.137-213, March 2008 [doi>10.1561/1500000008]
• 31: Chengxiang Zhai , John Lafferty, Model-based feedback in the language modeling approach to information retrieval, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502654]
• 32: Chengxiang Zhai , John Lafferty, A study of smoothing methods for language models applied to Ad Hoc information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.334-342, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384019]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms

Keywords:
passage retrieval, positional language models, proximity