“Is this document relevant?…probably”: a survey of probabilistic models in information retrieval

ABSTRACT

This article surveys probablistic approaches to modeling information retrieval. The basic concepts of probabilistic approaches to information retrieval are outlined and the principles and assumptions upon which the approaches are based are presented. The various models proposed in the development of IR are described, classified, and compared using a common formalism. New approaches that constitute the basis of future research are described.

REFERENCES

• 1: AMATI, G. AND KERPEDJIEV, S. 1992. An information retrieval logical model: Implementation and experiments. Tech. Rep. Rel 5B04892 (March), Fondazione Ugo Bordoni, Roma, Italy.
• 2: AMATI, G. AND VAN RIJSBERGEN, C. J. 1995. Probability, information and information retrieval. In Proceedings of the First International Workshop on Information Retrieval, Uncertainty and Logic (Glasgow, Sept.).
• 3: P. Biebricher , N. Fuhr , G. Lustig , M. Schwantner , G. Knorz, The automatic indexing system AIR/PHYS - from research to applications, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.333-342, May 1988, Grenoble, France [doi>10.1145/62437.62470]
• 4: BOOKSTEIN, A. AND COOPER, W.S. 1976. A general mathematical model for information retrieval systems. Libr. Quart. 46, 2.
• 5: BOOKSTEIN, A. AND SWANSON, D. 1974. Probabilistic models for automatic indexing. J. Am. Soc. Inf. Sci. 25, 5, 312-318.
• 6: BORGOGNA, G. AND PASI, G. 1993. A fuzzy linguistic approach generalizing Boolean information retrieval: A model and its evaluation. J. Am. Soc. Inf. Sci. 2, 70-82, 44.
• 7: BRUZA, P. D. 1993. Stratified information disclosure: A synthesis between hypermedia and information retrieval. Ph.D. Thesis, Katholieke Universiteit Nijmegen, The Netherlands.
• 8: P. D. Bruza , T. P. van der Weide, Stratified hypermedia structures for information disclosure, The Computer Journal, v.35 n.3, p.208-220, June 1992 [doi>10.1093/comjnl/35.3.208]
• 9: CAMPBELL, I. AND VAN RIJSBERGEN, C. J. 1996. The ostensive model of developing information needs. In Proceedings of CoLIS 2 (Copenhagen, Oct.), 251-268.
• 10: Y. Chiaramella , J. P. Chevallet, About retrieval models and logic, The Computer Journal, v.35 n.3, p.233-242, June 1992 [doi>10.1093/comjnl/35.3.233]
• 11: COOPER, W. S. 1971. A definition of relevance for information retrieval. Inf. Storage Retrieval 7, 19-37.
• 12: William S. Cooper, Some inconsistencies and misidentified modeling assumptions in probabilistic information retrieval, ACM Transactions on Information Systems (TOIS), v.13 n.1, p.100-111, Jan. 1995 [doi>10.1145/195705.195735]
• 13: William S. Cooper , Fredric C. Gey , Daniel P. Dabney, Probabilistic retrieval based on staged logistic regression, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.198-210, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133199]
• 14: Cox, D. R. 1970. Analysis of Binary Data. Methuen, London.
• 15: CRESTANI, F. AND VAN RIJSBERGEN, C.J. 1995a. Information retrieval by logical imaging. J. Doc. 51, 1, 1-15.
• 16: F. Crestani , C. J. van Rijsbergen, Probability kinematics in information retrieval, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.291-299, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215373]
• 17: W. Bruce Croft, Approaches to intelligent information retrieval, Information Processing and Management: an International Journal, v.23 n.4, p.249-254, July 1987 [doi>10.1016/0306-4573(87)90016-1]
• 18: CROFT, W. B. AND HARPER, D. J. 1979. Using probabilistic models of document retrieval without relevance information. J. Doc. 35, 285-295.
• 19: W. B. Croft , R. H. Thompson, I3R: a new approach to the design of document retrieval systems, Journal of the American Society for Information Science, v.38 n.6, p.389-404, Nov. 1987 [doi>10.1002/(SICI)1097-4571(198711)38:6<389::AID-ASI1>3.0.CO;2-4]
• 20: W. B. Croft , T. J. Lucia , P. R. Cohen, Retrieving documents by plausible inference: a priliminary study, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.481-494, May 1988, Grenoble, France [doi>10.1145/62437.62491]
• 21: W. B. Croft , T. J. Lucia , J. Cringean , P. Willett, Retrieving documents by plausible inference: an experimental study, Information Processing and Management: an International Journal, v.25 n.6, p.599-614, 1989 [doi>10.1016/0306-4573(89)90095-2]
• 22: W. Bruce Croft , Lisa A. Smith , Howard R. Turtle, A loosely-coupled integration of a text retrieval system and an object-oriented database system, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.223-232, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133203]
• 23: DE SILVA, W. T. AND MILIDIU, R.L. 1993. Belief function model for information retrieval. J. Am. Soc. Inf. Sci. 4, 1, 10-18.
• 24: DEMPSTER, A. P. 1968. A generalization of the Bayesian inference. J. Royal Stat. Soc. 30, 205-447.
• 25: DUNLOP, M. D. 1991. Multimedia information retrieval. Ph.D. Thesis, Department of Computing Science, University of Glasgow, Glasgow.
• 26: Norbert Fuhr, Models for retrieval with probabilistic indexing, Information Processing and Management: an International Journal, v.25 n.1, p.55-72, 1989 [doi>10.1016/0306-4573(89)90091-5]
• 27: Norbert Fuhr, A probabilistic framework for vague queries and imprecise information in databases, Proceedings of the sixteenth international conference on Very large databases, p.696-707, September 1990, Brisbane, Australia
• 28: Norbert Fuhr, Integration of probabilistic fact and text retrieval, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.211-222, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133202]
• 29: Norbert Fuhr, Probabilistic models in information retrieval, The Computer Journal, v.35 n.3, p.243-255, June 1992 [doi>10.1093/comjnl/35.3.243]
• 30: Norbert Fuhr, A probabilistic relational model for the integration of IR and databases, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.309-317, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160754]
• 31: Norbert Fuhr , Chris Buckley, A probabilistic learning approach for document indexing, ACM Transactions on Information Systems (TOIS), v.9 n.3, p.223-248, July 1991 [doi>10.1145/125187.125189]
• 32: FUHR, N. AND BUCKLEY, C. 1993. Optimizing document indexing and search term weighting based on probabilistic models. In The First Text Retrieval Conference (TREC-1), D. Harman, Ed., Special Publication 500-207. National Institute of Standards and Technology, Gaithersburg, MD, 89-100.
• 33: N. Fuhr , G. E. Knorz, Retrieval test evaluation of a rule based automatic indexing (AIR/PHYS), Proc. of the third joint BCS and ACM symposium on Research and development in information retrieval, p.391-408, November 1984, King's College, Cambridge
• 34: Norbert Fuhr , Ulrich Pfeifer, Combining model-oriented and description-oriented approaches for probabilistic indexing, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.46-56, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122865]
• 35: R. M. Fung , S. L. Crawford , L. A. Appelbaum , R. M. Tong, An architecture for probabilistic concept-based information retrieval, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.455-467, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98252]
• 36: GOOD, I.J. 1950. Probability and the Weighing of Evidence. Charles Griffin Symand.
• 37: Donna Harman, Relevance feedback and other query modification techniques, Information retrieval: data structures and algorithms, Prentice-Hall, Inc., Upper Saddle River, NJ, 1992
• 38: Donna Harman, Relevance feedback revisited, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.1-10, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133167]
• 39: Donna Harman, Overview of the first TREC conference, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.36-47, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160692]
• 40: HARMAN, D. 1996. Overview of the fifth text retrieval conference (TREC-5). In Proceeding of the TREC Conference (Gaithersburg, MD, Nov.).
• 41: David J. Harper , Andrew D. M. Walker, ECLAIR: an extensible class library for information retrieval, The Computer Journal, v.35 n.3, p.256-267, June 1992 [doi>10.1093/comjnl/35.3.256]
• 42: HARTER, S.P. 1975. A probabilistic approach to automatic keyword indexing: Part 1. J. Am. Soc. Inf. Sci. 26, 4, 197-206.
• 43: HUIBERS, T. W. C. 1996. An axiomatic theory for information retrieval. Ph.D. Thesis, Utrecht University, The Netherlands.
• 44: JEFFREY, R. C. 1965. The Logic of Decision. McGraw-Hill, New York.
• 45: K. L. Kwok, Experiments with a component theory of probabilistic information retrieval based on single terms as document components, ACM Transactions on Information Systems (TOIS), v.8 n.4, p.363-386, Oct. 1990 [doi>10.1145/102675.102677]
• 46: LALMAS, M. 1992. A logic model of information retrieval based on situation theory. In Proceedings of the Fourteenth BCS Information Retrieval Colloquium (Lancaster, UK, Dec.).
• 47: Mounia Lalmas, Logical models in information retrieval: introduction and overview, Information Processing and Management: an International Journal, v.34 n.1, p.19-33, 1998 [doi>10.1016/S0306-4573(97)00041-1]
• 48: Eugene L. Margulis, N-Poisson document modelling, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.177-189, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133195]
• 49: Eugene L. Margulis, Modelling documents with multiple Poisson distributions, Information Processing and Management: an International Journal, v.29 n.2, p.215-227, March-April 1993 [doi>10.1016/0306-4573(93)90005-X]
• 50: M. E. Maron , J. L. Kuhns, On Relevance, Probabilistic Indexing and Information Retrieval, Journal of the ACM (JACM), v.7 n.3, p.216-244, July 1960 [doi>10.1145/321033.321035]
• 51: MILLER, W. L. 1971. A probabilistic search strategy for MEDLARS. J. Doc. 27, 254-266.
• 52: MIZZARO, S. 1996. Relevance: The whole (hi)story. Tech. Rep. UDMI/12/96/RR (Dec.), Dipartimento di Matematica e Informatica, Universita' di Udine, Italy.
• 53: Richard E. Neapolitan, Probabilistic reasoning in expert systems: theory and algorithms, John Wiley & Sons, Inc., New York, NY, 1990
• 54: J. Nie, An outline of a general model for information retrieval systems, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.495-506, May 1988, Grenoble, France [doi>10.1145/62437.62493]
• 55: NIL, J.Y. 1989. An information retrieval model based on modal logic. Inf. Process. Manage. 25, 5, 477-491.
• 56: Jian-Yun Nie, Towards a probabilistic modal logic for semantic-based information retrieval, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.140-151, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133188]
• 57: NIL, J. Y., LEPAGE, F., AND BRISEBOIS, M. 1996. Information retrieval as counterfactual. Comput. J. 38, 8, 643-657.
• 58: Judea Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1988
• 59: PEARL, g. 1990. Jeffrey's rule, passage of experience and Neo-Bayesianism. In Knowledge Representation and Defeasible Reasoning, H. E. Kyburg, R. P. Luoi, and G. N. Carlson, Eds., Kluwer Academic, Dordrecht, The Netherlands, 245-265.
• 60: ROBERTSON, S.E. 1977. The probability ranking principle in IR. J. Doc. 33, 4 (Dec.), 294-304.
• 61: ROBERTSON, S. E. AND SPARCK JONES, K. 1976. Relevance weighting of search terms. J. Am. Soc. Inf. Sci. 27, 129-146.
• 62: S. E. Robertson , S. Walker, Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.232-241, July 03-06, 1994, Dublin, Ireland
• 63: ROBERTSON, S. E., MARON, M. E., AND COOPER, W.S. 1982. Probability of relevance: A unification of two competing models for document retrieval. Inf. Technol. Res. Dev. 1, 1-21.
• 64: Gerard. Salton, Automatic Information Organization and Retrieval., McGraw Hill Text, 1968
• 65: Jacques Savoy, Bayesian inference networks and spreading activation in hypertext systems, Information Processing and Management: an International Journal, v.28 n.3, p.389-406, 1992 [doi>10.1016/0306-4573(92)90082-B]
• 66: Shimon Schocken , Robert A. Hummel, On the use of the Dempster Shafer model in information indexing and retrieval applications, International Journal of Man-Machine Studies, v.39 n.5, p.843-879, Nov. 1993 [doi>10.1006/imms.1993.1086]
• 67: Fabrizio Sebastiani, A probabilistic terminological logic for modelling information retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.122-130, July 03-06, 1994, Dublin, Ireland
• 68: SEMBOK, T. M. T. AND VAN RIJSBERGEN, C. J. 1993. Imaging: A relevance feedback retrieval with nearest neighbour clusters. In Proceedings of the BCS Colloquium in Information Retrieval (Glasgow, March), 91-107.
• 69: SERACEVIC, T. 1970. The concept of "relevance" in information science: A historical review. In Introduction to Information Science, T. Seracevic, Ed., R. R. Bower, New York, Chapter 14.
• 70: SHAPER, G. 1976. A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ.
• 71: SMITH, S. AND STANFILL, C. 1988. An analysis of the effects of data corruption on text retrieval performance. Tech. Rep. (Dec.), Thinking Machines Corporation, Cambridge, MA.
• 72: Karen Sparck Jones, Information Retrieval Experiment, Butterworth-Heinemann, Newton, MA, 1981
• 73: STALNAKER, R. 1981. Probability and conditionals. In Ifs, W. L. Harper, R. Stalnaker, and G. Pearce, Eds., The University of Western Ontario Series in Philosophy of Science, D. Riedel, Dordrecht, Holland, 107-128.
• 74: P. Thompson, A combination of expert opinion approach to probabilistic information retrieval, part 1: The conceptual model, Information Processing and Management: an International Journal, v.26 n.3, p.371-382, 1990 [doi>10.1016/0306-4573(90)90097-L]
• 75: P. Thompson, A combination of expert opinion approach to probabilistic information retrieval, part 2: Mathematical treatment of CEO model 3, Information Processing and Management: an International Journal, v.26 n.3, p.383-394, 1990 [doi>10.1016/0306-4573(90)90098-M]
• 76: Roger H Thompson, The Design and Implementation of an Intelligent Interface for Information, University of Massachusetts, Amherst, MA, 1988
• 77: Howard Robert Turtle, Inference networks for document retrieval, University of Massachusetts, Amherst, MA, 1991
• 78: H. Turtle , W. B. Croft, Inference networks for document retrieval, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.1-24, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98006]
• 79: Howard Turtle , W. Bruce Croft, Evaluation of an inference network-based retrieval model, ACM Transactions on Information Systems (TOIS), v.9 n.3, p.187-222, July 1991 [doi>10.1145/125187.125188]
• 80: Howard R. Turtle , W. Bruce Croft, A comparison of text retrieval models, The Computer Journal, v.35 n.3, p.279-290, June 1992 [doi>10.1093/comjnl/35.3.279]
• 81: TURTLE, H. R. AND CROFT, W.B. 1992b. Uncertainty in information retrieval systems. Unpublished paper.
• 82: VAN RIJSBERGEN, C.J. 1977. A theoretical basis for the use of co-occurrence data in information retrieval. J. Doc. 33, 2 (June), 106-119.
• 83: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 84: VAN RIJSBERGEN, C. J. 1986. A non-classical logic for information retrieval. Comput. J. 29, 6, 481-485.
• 85: C. J. van Rijsbergen, Towards an information logic, Proceedings of the 12th annual international ACM SIGIR conference on Research and development in information retrieval, p.77-86, June 25-28, 1989, Cambridge, Massachusetts, United States
• 86: VAN RIJSBERGEN, C. J. 1992. Probabilistic retrieval revisited. Departmental Research Report 1992/R2 (Jan.), Computing Science Department, University of Glasgow, Glasgow.
• 87: C. J. van Rijsbergen , M. Lalmas, Information calculus for information retrieval, Journal of the American Society for Information Science, v.47 n.5, p.385-398, May 1996 [doi>10.1002/(SICI)1097-4571(199605)47:5<385::AID-ASI6>3.3.CO;2-V]
• 88: S. K. M. Wong , Y. Y. Yao, A probability distribution model for information retrieval, Information Processing and Management: an International Journal, v.25 n.1, p.39-53, 1989 [doi>10.1016/0306-4573(89)90090-3]
• 89: S. K. M. Wong , Y. Y. Yao, On modeling information retrieval with probabilistic inference, ACM Transactions on Information Systems (TOIS), v.13 n.1, p.38-68, Jan. 1995 [doi>10.1145/195705.195713]
• 90: R. R. Yager , S. Ovchinnikov , R. M. Tong , H. T. Nguyen, Fuzzy sets and applications, Wiley-Interscience, New York, NY, 1987

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

General Terms:
Algorithms, Theory

Keywords:
information retrieval, probabilistic indexing, probabilistic modeling, probabilistic retrieval, uncertain inference modeling