Retrieving documents by plausible inference: a priliminary study

ABSTRACT

Choosing an appropriate document representation and search strategy for document retrieval has been largely guided by achieving good average performance instead of optimizing the results for each individual query. A model of retrieval based on plausible inference gives us a different perspective and suggests that techniques should be found for combining multiple sources of evidence (or search strategies) into an overall assessment of a document's relevance, rather than attempting to pick a single strategy. In this paper, we explain our approach to plausible inference for retrieval and describe some preliminary experiments designed to test this approach. The experiments use a spreading activation search to implement the plausible inference process. The results show that significant effectiveness improvements are possible using this approach.

REFERENCES

• BELKIN87: Nicholas J. Belkin , W. Bruce Croft, Retrieval techniques, Annual review of information science and technology, vol. 22, Elsevier Science Inc., New York, NY, 1987
• COHEN87: Paul R. Cohen , Rick Kjeldsen, Information retrieval by constrained spreading activation in semantic networks, Information Processing and Management: an International Journal, v.23 n.4, p.255-268, July 1987 [doi>10.1016/0306-4573(87)90017-3]
• CROFT79: Croft, V#r.B. and Harper, D.J. 1979. "Using Probabilistic Models of Document Retrieval Without Relevance Information", Journal of Documentation, 35,285-295 (1979).
• CROFT87a: B. Croft, An approach to natural language for document retrieval, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.26-32, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42009]
• CROFT84: W. Bruce Croft , Roger H. Thompson, The use of adaptive mechanisms for selection of search strategies in document retrieval systems, Proc. of the third joint BCS and ACM symposium on Research and development in information retrieval, p.95-110, November 1984, King's College, Cambridge
• CROFT87b: W. B. Croft , R. H. Thompson, I3R: a new approach to the design of document retrieval systems, Journal of the American Society for Information Science, v.38 n.6, p.389-404, Nov. 1987 [doi>10.1002/(SICI)1097-4571(198711)38:6<389::AID-ASI1>3.0.CO;2-4]
• KATZER82: Katzer, J., McGill, M.J., Tessier, J.A., Frakes, W. and Dasgupta, P., 1982. "A Study of the Overlap among Document Representations". Information Technology, 1, 261-274.
• LEWIS88: Lewis, D., Croft, V#r.B. and Bhandaru, N., 1988. "Language-Oriented Information RetrievaJ', International Journal of Intelligent Syatem,, (to appear).
• MCCALL86: F. McCall , P. Willett, Criteria for the selection of search strategies in best-match document-retrieval systems, International Journal of Man-Machine Studies, v.25 n.3, p.317-326, Sept. 1986 [doi>10.1016/S0020-7373(86)80063-3]
• RAU87: Lisa F. Rau, Knowledge organization and access in a conceptual information system, Information Processing and Management: an International Journal, v.23 n.4, p.269-283, July 1987 [doi>10.1016/0306-4573(87)90018-5]
• RIJSBERGEN86: Van Rijsbergen, C.J., 1986. "A Non-Classical Logic for Information Retrieval". Computer Journal, 29, 481-485.
• SALTON83: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• THOMPSON88: R. H. Thompson , W. B. Croft, Support for browsing in an intelligent text retrieval system, International Journal of Man-Machine Studies, v.30 n.6, p.639-668, June 1989
• TONG87: R. Tong , L. Appelbaum , V. Askman , J. Cunningham, Conceptual information retrieval using RUBRIC, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.247-253, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42033]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

General Terms:
Algorithms, Design, Performance