Improving weak ad-hoc queries using wikipedia asexternal corpus

ABSTRACT

In an ad-hoc retrieval task, the query is usually short and the user expects to find the relevant documents in the first several result pages. We explored the possibilities of using Wikipedia's articles as an external corpus to expand ad-hoc queries. Results show promising improvements over measures that emphasize on weak queries.

REFERENCES

• 1: Amanda Spink , Bernard J. Jansen , Dietmar Wolfram , Tefko Saracevic, From E-Sex to E-Commerce: Web Search Changes, Computer, v.35 n.3, p.107-109, March 2002 [doi>10.1109/2.989940]
• 2: Chris Buckley, Why current IR engines fail, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009132]
• 3: K.L. Kwok, L. Grunfeld and P. Deng. Improving weak ad-hoc retrieval by web assistance and data fusion. In AIRS, pages 17--30, 2005.
• 4: Wikipedia, the free encyclopedia. http://www.wikipedia.org.
• 5: E.M. Voorhees. Overview of TREC 2003. In TREC, pages 1--13, 2003.
• 6: Stephen Robertson, On GMAP: and other transformations, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183630]
• 7: S. E. Robertson , S. Walker, Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.232-241, July 03-06, 1994, Dublin, Ireland
• 8: T. Strohman, D. Metzler, H. Turtle and W.B. Croft. Indri: A language-model based search engine for complex queries. In International Conference on Intelligence Analysis, 2005.
• 9: Donald Metzler , W. Bruce Croft, A Markov random field model for term dependencies, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076115]
• 10: D. Metzler, F. Diaz, T. Strohman, and W.B. Croft. Umass robust 2005: Using mixture of relevance models for query expansion, 2005.
• 11: Fernando Diaz , Donald Metzler, Improving the estimation of relevance models using large external corpora, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148200]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

General Terms:
Algorithms, Experimentation

Keywords:
Wikipedia, external corpus, pseudo-relevance feedback