Towards interactive query expansion

ABSTRACT

In an era of online retrieval, it is appropriate to offer guidance to users wishing to improve their initial queries. One form of such guidance could be short lists of suggested terms gathered from feedback, nearest neighbors, and term variants of original query terms. To verify this approach, a series of experiments were run using the Cranfield test collection to discover techniques to select terms for these lists that would be effective for further retrieval. The results show that significant improvement can be expected from this approach to query expansion.

REFERENCES

• CROFT83: Croft W.B., "Experiment# with Representation in a Document P, etrievai System", Inlormation Technology: Research and Development 2 (1983)# pp. 1-21.
• DENNIS64: Dennis S.F., "The Construction of a Thesaurus Automatically frc,m a Sample of Text",Symposium Proceedings, StalJstical Assflciation Me;,hods for Mechanized Documentation, 1964. (National Bureau of Standards Miscellaneous Publication 269).
• HARMAN86: Donna Williamson Harman, An experimental study of factors important in document ranking, Proceedings of the 9th annual international ACM SIGIR conference on Research and development in information retrieval, p.186-193, September 1986, Palazzo dei Congressi, Pisa, Italy [doi>10.1145/253168.253206]
• HARMAN87: D. Harman, A failure analysis of the limitation of suffixing in an online environment, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.102-107, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42017]
• HARPER78: Harper D.j. and van Rijsbergen C.J., "An Evaluation of Feedback in Dcx:ument Retrieval using Co-Occurrence Data", Journal of Documentation, Vol. 34, No. 3, pp. 189-216, 1978.
• LENNON81: Lennon M., Peirce D., Tarry B. and Willett P., "An Evaluation of Some Conflation Algorithms for Information Retrieval", Journal of Information Science 3, pp. 177-188, 1981.
• LOVINS68: Lovins J.B., "Development of a Stemming Algorithm", Mechanical Translation and ComputaUonal Linguistics 11, March 1968, pp. 22-31.
• PORTER80: Porter M.F., "An Algorithm for Suffix Stripping", Program, Vol. 14, July 1980, pp. 130- 137.
• PORTER82: Porter M.F., "Implementing a Probabilistic Information Retrieval System", Information Technology: Research and Development 1 (1982), pp. 131-156.
• ROBERTSON76: Robertson S.E. and Sparck Jones K., "Relevance Weighting of search terms", Journal of the ASIS, Vol. 27, No. 3, pp. 129-146, 1976.
• ROCCHIO68: Rocchio J.J., Jr., Relevance Feedback in Information Retrieval, Chapter I4 in {SAL-TON68}.
• SALTON68: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• SALTON70: Salton G., "Evaluation Problerns in Interactive Information Retrieval", lnfomaation Storage Retrieval, VoL. 6, pp. 29-44, 1970.
• SALTON83: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• SMEATON82: Smeaton A.F., The Retrieval Effects of Query Expansion on a Feedback Document Retrieval System, Technical Report 2, Department of Computer Science, University College Dublin (#982).
• SMEATON83: Smeaton A.F. and van Rijsbergcn C.J., "The Retrieval Effects o1" Query Expansion on a Feexlback Document Retrieval System", The Computer Journal, Vol. 26, pp. 239-246, 1983.
• SPARCK JONES72: Sparck Jones K., "A Stati.,;tical Interpretation of Term Specificity and Its Application in Retrieval", Journal of Documentation, Vol. 28, No. 1, March 1972, pp. 11-20.
• VAN RIJSBERGEN81: van Rijsbcrgen C,J., Harper D.J. and Porter M,F., "The Selection of Good Search Terms", Information Processing and Management, Vol, 17, pp. 77-91, 198I.
• WILLETT81: Wiilett P., "A Fast Procedure for the Calculation of Similarity Coefficients in Automatic Classification", Information Processing and Management, Vol. 17, pp. 53-60, 1981.
• WU81: Wu H. and Salton G., "The Estimation of Term Relevance using Relevance Feedback", Journal of Documentation, Vol. 37, No. 4, December I981, pp. 194-214.
• YU76: C. T. Yu , G. Salton, Precision Weighting—An Effective Automatic Indexing Method, Journal of the ACM (JACM), v.23 n.1, p.76-88, Jan. 1976 [doi>10.1145/321921.321930]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.6 Programming Environments
          Subjects: Interactive environments

General Terms:
Algorithms, Design, Performance