Experiments with query acquisition and use in document retrieval systems

ABSTRACT

In some recent experimental document retrieval systems, emphasis has been placed on the acquisition of a detailed model of the information need through interaction with the user. It has been argued that these “enhanced” queries, in combination with relevance feedback, will improve retrieval performance. In this paper, we describe a study with the aim of evaluating how easily enhanced queries can be acquired from users and how effectively this additional knowledge can be used in retrieval. The results indicate that significant effectiveness benefits can be obtained through the acquisition of domain concepts related to query concepts, together with their level of importance to the information need.

REFERENCES

• 1: Damaris M. Ayuso , Varda Shaked , Ralph M. Weischedel, An environment for acquiring semantic information, Proceedings of the 25th annual meeting on Association for Computational Linguistics, p.32-40, July 06-09, 1987, Stanford, California [doi>10.3115/981175.981180]
• 2: Bruce W. Ballard , Douglas E. Stumberger, Semantic acquisition in TELI: a transportable, user-customized natural language processor, Proceedings of the 24th annual meeting on Association for Computational Linguistics, p.20-29, July 10-13, 1986, New York, New York [doi>10.3115/981131.981136]
• 3: Croft, W. B. "Document Representation in Probabilistic Models of I_nformation Retrieval". Journal of the American Society of Infov'mation Science, 32: 451-457; 1981.
• 4: Croft, V#r. B. "Boolean Queries and Term Dependencies in Probabilistic Retrieval Models". Journal of the American Society for Information Science, 37: 71-77; 1986.
• 5: Croft, W.B.; Harper, D.J. *'Using probabilistic models of document retrieval without relevaz#ce in.formation", Journal of Documentation, 35, 285-295, 1979.
• 6: W. B. Croft , R. H. Thompson, I3R: a new approach to the design of document retrieval systems, Journal of the American Society for Information Science, v.38 n.6, p.389-404, Nov. 1987 [doi>10.1002/(SICI)1097-4571(198711)38:6<389::AID-ASI1>3.0.CO;2-4]
• 7: W. B. Croft , T. J. Lucia , J. Cringean , P. Willett, Retrieving documents by plausible inference: an experimental study, Information Processing and Management: an International Journal, v.25 n.6, p.599-614, 1989 [doi>10.1016/0306-4573(89)90095-2]
• 8: FagaxL# J. Ezperiments in Automatic Phrase Indezing for Document Reirieval: A Comparison of Syntactic and Non-Syntactic Methods. Ph.D. Thesis, TR 87-868, Cornell University, Computer Science Department, 1987.
• 9: Norbert Fuhr, Models for retrieval with probabilistic indexing, Information Processing and Management: an International Journal, v.25 n.1, p.55-72, 1989 [doi>10.1016/0306-4573(89)90091-5]
• 10: D. Harman, Towards interactive query expansion, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.321-331, May 1988, Grenoble, France [doi>10.1145/62437.62469]
• 11: Harper, D.J. Relevance Feedback in Documer, t Retrieval Systems: An Evaluation of Probabilistic Strategies. Ph.D. Thesis, Computer Laboratory, University of Cambridge, 1980.
• 12: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 13: Van l#ijsbergen, C.J. "A Non-Classical Logic for Lrfformation RetrievM". Computer Journal, 29" 481-485; 1986.
• 14: l#obertson, S.E. "The methodology of information retrieval experiment". In" Spa#ck Jones, editor, Information Retrieval Ezperzment. London" Butterworths, 9-31, 1981.
• 15: Gerard. Salton, Automatic Information Organization and Retrieval., McGraw Hill Text, 1968
• 16: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 17: Gerard Salton , Chris Buckley, Improving Retrieval Performance by Relevance Feedback, Cornell University, Ithaca, NY, 1988
• 18: Salton, G; V#raldstein, R.G. "Term Relevance Weights in On-Line information Retrieval", Information Processing and Management, 14, 29-35, 1978.
• 19: Gerard Salton , Edward A. Fox , Harry Wu, Extended Boolean information retrieval, Communications of the ACM, v.26 n.11, p.1022-1036, Nov. 1983 [doi>10.1145/182.358466]
• 20: Siegel, S. Nonparametric Statistics, McGraw-Hill, 1956.
• 21: A. F. Smeaton , C. J. van Rijsbergen, Experiments on incorporating syntactic processing of user queries into a document retrieval strategy, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.31-51, May 1988, Grenoble, France [doi>10.1145/62437.62439]
• 22: Spaxck 3ones, K. Automatic Keyword Classification for Information Retrieval. Butterworths, London, 1971.
• 23: Sparck :}ones, K.; Bates, K.G. Report on a design }or the 'ideal' test collection. British Library R.eport 5428, Computer Laboratory, University of Cambridge, 1977.
• 24: Spaxck Jones, K.; Webster, C. Research on Relevance 14"eighting. British Libraxy Report 5553, Computer Laboratory, University of Caxnbridge, 1980.
• 25: Tou, F.M. et al. "RABBIT: An intelligent database assistax#t". Proceedings AAAI-82, 314- 318, 1982.
• 26: Yu, C.T.; Buckley# D.; Lain, K; Salton, G. "A genera}iT#ed term dependence model in information retrievM". Inforrna$ion Technology: Research and Development, 4, 129-154, 1983.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Design, Experimentation, Human Factors, Languages