A proximity language model for information retrieval

ABSTRACT

The proximity of query terms in a document is a very important information to enable ranking models go beyond the "bag of word" assumption in information retrieval. This paper studies the integration of term proximity information into the unigram language modeling. A new proximity language model (PLM) is proposed which views query terms' proximity centrality as the Dirichlet hyper-parameter that weights the parameters of the unigram document language model. Several forms of proximity measure are developed to be used in PLM which could compute a query term's proximate centrality in a specific document. In experiments, the proximity language model is compared with the basic language model and previous works that combine the proximity information with language model using linear score combination. The experiment results show that the proposed model performs better in both top precision and average precision.

REFERENCES

• 1: J. Bai, Y. Chang, H. Cui, Z. Zheng, G. Sun, and X. Li. Investigation of partial query proximity in web search. 2008.
• 2: Doug Beeferman , Adam Berger , John Lafferty, A model of lexical attraction and repulsion, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.373-380, July 07-12, 1997, Madrid, Spain
• 3: S. Buttcher and C. Clarke. Efficiency vs. Effectiveness in Terabyte-Scale Information Retrieval. Proceedings of the 14th Text Retrieval Conference (Gaithersburg, USA, November 2005).
• 4: Charles L. A. Clarke , Gordon V. Cormack , Elizabeth A. Tudhope, Relevance ranking for one to three term queries, Information Processing and Management: an International Journal, v.36 n.2, p.291-311, Jan.1.2000 [doi>10.1016/S0306-4573(99)00017-5]
• 5: William S. Cooper, Some inconsistencies and misidentified modeling assumptions in probabilistic information retrieval, ACM Transactions on Information Systems (TOIS), v.13 n.1, p.100-111, Jan. 1995 [doi>10.1145/195705.195735]
• 6: W. Croft. Boolean queries and term dependencies in probabilistic retrieval models. Journal of the American Society for Information Science, 37(2):71--77, 1986.
• 7: W. Bruce Croft , Howard R. Turtle , David D. Lewis, The use of phrases and structured queries in information retrieval, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.32-45, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122864]
• 8: J. Fagan. Experiments in Automatic Phrase Indexing For Document Retrieval: A Comparison of Syntactic and Non-Syntactic Methods. 1987.
• 9: T. Ferguson. A Bayesian analysis of some nonparametric problems. Ann. Statist, 1(2):209--230, 1973.
• 10: Jianfeng Gao , Jian-Yun Nie , Guangyuan Wu , Guihong Cao, Dependence language model for information retrieval, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009024]
• 11: D. Hawking and P. Thistlewaite. Proximity operators-So near and yet so far. Proceedings of the 4th Text Retrieval Conference, pages 131--143, 1995.
• 12: William Hersh , Chris Buckley , T. J. Leone , David Hickam, OHSUMED: an interactive retrieval evaluation and new large test collection for research, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.192-201, July 03-06, 1994, Dublin, Ireland
• 13: K. Jones, S. Walker, and S. Robertson. A Probabilistic Model of Information Retrieval: Development and Status. University of Cambridge, Computer Laboratory, 1998.
• 14: Charles L. A. Clarke , Gordon V. Cormack, Shortest-substring retrieval and ranking, ACM Transactions on Information Systems (TOIS), v.18 n.1, p.44-78, Jan. 2000 [doi>10.1145/333135.333137]
• 15: John Lafferty , Chengxiang Zhai, Document language models, query models, and risk minimization for information retrieval, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.111-119, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383970]
• 16: Donald Metzler , W. Bruce Croft, A Markov random field model for term dependencies, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076115]
• 17: David R. H. Miller , Tim Leek , Richard M. Schwartz, A hidden Markov model information retrieval system, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.214-221, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312680]
• 18: M. Mitra, C. Buckley, A. Singhal, and C. Cardie. An analysis of statistical and syntactic phrases. Proceedings of RIAO-97, 5th International Conference "Recherche d'Information Assistee par Ordinateur, pages 200--214, 1997.
• 19: Ramesh Nallapati , James Allan, Capturing term dependencies using a language model based on sentence trees, Proceedings of the eleventh international conference on Information and knowledge management, November 04-09, 2002, McLean, Virginia, USA [doi>10.1145/584792.584855]
• 20: P. Ogilvie and J. Callan. Experiments Using the Lemur Toolkit. NIST Special Publication SP, pages 103--108, 2002.
• 21: J. Ponte and W. Croft. A language modeling approach to information retrieval. ACM New York, NY, USA, 1998.
• 22: Y. Rasolofo and J. Savoy. Term Proximity Scoring for Keyword-Based Retrieval Systems. Lecture Notes in Computer Science, pages 207--218, 2003.
• 23: S. Robertson, S. Jones, et al. Relevance Weighting of Search Terms. Journal of the American Society for Information Science, 27(3):129--46, 1976.
• 24: S. Robertson, S. Walker, and M. Beaulieu. Okapi at TREC-7: automatic ad hoc, filtering, VLC and interactive track. NIST Special Publication SP, pages 253--264, 1999.
• 25: Fei Song , W. Bruce Croft, A general language model for information retrieval, Proceedings of the eighth international conference on Information and knowledge management, p.316-321, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.320022]
• 26: Munirathnam Srikanth , Rohini Srihari, Biterm language models for document retrieval, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564476]
• 27: Tao Tao , ChengXiang Zhai, An exploration of proximity measures in information retrieval, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands [doi>10.1145/1277741.1277794]
• 28: C. Yu, C. Buckley, K. Lam, and G. Salton. A Generalized Term Dependence Model in Information Retrieval. Information technology: research and development, 2(4):129--154, 1983.
• 29: Chengxiang Zhai , John Lafferty, A study of smoothing methods for language models applied to information retrieval, ACM Transactions on Information Systems (TOIS), v.22 n.2, p.179-214, April 2004 [doi>10.1145/984321.984322]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation, Theory

Keywords:
information retrieval, proximity language model, proximity model