Applying summarization techniques for term selection in relevance feedback

ABSTRACT

Query-expansion is an effective Relevance Feedback technique for improving performance in Information Retrieval. In general query-expansion methods select terms from the complete contents of relevant documents. One problem with this approach is that expansion terms unrelated to document relevance can be introduced into the modified query due to their presence in the relevant documents and distribution in the document collection. Motivated by the hypothesis that query-expansion terms should only be sought from the most relevant areas of a document, this investigation explores the use of document summaries in query-expansion. The investigation explores the use of both context-independent standard summaries and query-biased summaries. Experimental results using the Okapi BM25 probabilistic retrieval model with the TREC-8 ad hoc retrieval task show that query-expansion using document summaries can be considerably more effective than using full-document expansion. The paper also presents a novel approach to term-selection that separates the choice of relevant documents from the selection of a pool of potential expansion terms. Again, this technique is shown to be more effective that standard methods.

REFERENCES

• 1: J.J.Rocchio. "Relevance Feedback in Information Retrieval" In The smart retrieval system, G. Salton, pages 313-323, 1971, Prentice Hall, Inc.
• 2: G.Salton and C.Buckley. Improving retrieval performance by relevance feedback, Journal of the American Society for Information Science, 41, pages 288-297, 1990.
• 3: C.Buckley, G.Salton, J.Allan, A.Singhal. Automatic Query Expansion using SMART, In Proceedings of the Third Text REtrieval Conference (TREC-3), pages 65-80, 1995, NIST.
• 4: S.E.Robertson, S.Walker, S.Jones, M. M.Hancock- Beaulieu and M.Gatford, Okapi at TREC-3, In Proceedings of the Third Text REtrieval Conference (TREC-3), pp109-216, 1995, NIST.
• 5: S. E. Robertson, On term selection for query expansion, Journal of Documentation, v.46 n.4, p.359-364, Dec. 1990 [doi>10.1108/eb026866]
• 6: T.Strzalkowski, J.Wang and B.Wise. Summarization- Based Query Expansion in Information Retrieval, In Proceedings of the 17 th COLING, pages 1-21, Montreal, 1998.
• 7: Donna Harman, Relevance feedback and other query modification techniques, Information retrieval: data structures and algorithms, Prentice-Hall, Inc., Upper Saddle River, NJ, 1992
• 8: Mandar Mitra , Amit Singhal , Chris Buckley, Improving automatic query expansion, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.206-214, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290995]
• 9: Mark Sanderson, Word sense disambiguation and information retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.142-151, July 03-06, 1994, Dublin, Ireland
• 10: James P. Callan, Passage-level evidence in document retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.302-310, July 03-06, 1994, Dublin, Ireland
• 11: D.Knaus, E.Mittendorf, P.Schauble, P.Sheridan. Highlighting Relevant Passages for users of the Interactive SPIDER Retrieval System, In Proceedings of the Fourth Text Retrieval Conference (TREC-4), pages 233-238, 1995, NIST.
• 12: Anastasios Tombros , Mark Sanderson, Advantages of query biased summaries in information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.2-10, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290947]
• 13: C. D. Paice, Constructing literature abstracts by computer: techniques and prospects, Information Processing and Management: an International Journal, v.26 n.1, p.171-186, 1990 [doi>10.1016/0306-4573(90)90014-S]
• 14: S.E.Robertson, S.Walker and M.Beaulieu, Okapi at TREC-7: automatic ad hoc, filtering, VLS and interactive track, In Proceedings of the Seventh Text Retrieval Conference (TREC-7), pages 253-264, 1998, NIST.
• 15: S.E.Robertson and S.Walker, Okapi/Keenbow at TREC-8, In Proceedings of the Eighth Text REtrieval Conference (TREC-8), pages 151-162, 1999, NIST
• 16: Anastasios Tombros. Reflecting user information needs through query biased summaries. Thesis submitted towards the award of MSc in Advanced Information systems in the University of Glasgow. September 1997.
• 17: H.P.Luhn. The Automatic Creation of Literature Abstracts, IBM Journal of Research and Development, 2(2), pages 159-165, 1958.
• 18: H. P. Edmundson, New Methods in Automatic Extracting, Journal of the ACM (JACM), v.16 n.2, p.264-285, April 1969 [doi>10.1145/321510.321519]
• 19: D.E.Kieras. Thematic Processes in the Comprehension of Technical Prose. In B.K Briton and J. B. Black eds, Understanding expository text: A theoretical and practical handbook for analyzing explanatory text, pages 89- 108, 1985, Lawrence Erlbaum Associates.
• 20: M.F.Porter, An algorithm for suffix stripping, Program, 14(3), pages 130-137, 1980
• 21: S. E. Robertson , S. Walker, Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.232-241, July 03-06, 1994, Dublin, Ireland
• 22: S.E.Robertson and K.Sparck Jones. Relevance Weighting of Search Terms, Journal of the American Society for Information Science, 27(3), pages 129-146, 1976.
• 23: Jinxi Xu , W. Bruce Croft, Query expansion using local and global document analysis, Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval, p.4-11, August 18-22, 1996, Zurich, Switzerland [doi>10.1145/243199.243202]
• 24: James Allan, Relevance feedback with too much data, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.337-343, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215380]
• 25: Mark T. Maybury , Inderjeet Mani, Advances in Automatic Text Summarization, MIT Press, Cambridge, MA, 1999
• 26: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Relevance feedback

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models; Search process

General Terms:
Design, Experimentation, Performance