Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Probabilistic document retrieval systems consistent with the two Poisson independence model outperforms the binary independence model if the terms are distributed as described by the model's assumptions. The Two Poisson Effectiveness Hypothesis suggests that retrieval models based upon the two Poisson model will outperform binary independent models when used on a “real-world” database, where independence and two Poisson term occurrence distributions fail to hold, because the added information obtained from incorporating term frequency information will more than compensate for the non-Poisson distributions of terms. Searches of the MED1033 database suggest that if terms are not independent and frequencies of term occurrence are not distributed in a two Poisson manner, the binary independence sequential retrieval model outperforms the two Poisson independence retrieval model.

REFERENCES

• 1: Bookstein, A. and Swanson, D. "A Decision Theoretic Foundation for Indexing." Journal of the American Society for Information Science. XXVI (January 1975): 45-50.
• 2: Booketein# A. "Information Retrieval: A Seguential Learning Process." Journal of the American Society for Information Science. XXXIV (September 1983): 331-342.
• 3: Paul Bratley , Bennett L Fox , Linus E Schrage, A guide to simulation (2nd ed.), Springer-Verlag New York, Inc., New York, NY, 1986
• 4: Croft, W. and Harper, D. "Using Probabillstlc Models of Document Retrieval without Relevance Information." Journal of Documentation~ XXXV (December 1979): 285-295.
• 5: FOx, E. Characterization of Two New Experimental Collections in Computerand Information Science Containing Textual and Bibliographic #. Technical Report 83-561, Cornell Eniverslty Department of Computer Science. Ithaca, New York: September, 1983.
• 6: Hatter, S. "A Probabilistic Approach to Keyword Indexing." Ph.D. dissertation, University of Chicago, 1974.
• 7: Losee, R. "The Performance of Probabillstic Models of Document Retrieval Systems." Ph.D. dissertation, University of Chicago, 1986.
• 8: Vijay V. Raghavan , Hong-pao Shi , C. T. Yu, Evaluation of the 2-Poisson model as a basis for using term frequency data in searching, Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval, June 06-08, 1983, Bethesda, Maryland
• 9: D11man, J. Princlples of Database Systems, second edition. (Rockville, Maryland: Computer Science Press, 1982).
• 10: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 11: Voorhees, E. Computer Science Department, Cornell University, Ithaca, New YOrk. Letter of 18 June, 1984 and persona# co~#aunication of 19 June, 1985.