Information retrieval and digital libraries: lessons of research

ABSTRACT

This paper reviews lessons from the history of information retrieval research, with particular emphasis on recent developments. These have demonstrated the value of statistical techniques for retrieval, and have also shown that they have an important, though not exclusive, part to play in other information processing tasks, like question asnwering and summarising. The heterogeneous materials that digital libraries are expected to cover, their scale, and their changing composition, imply that statistical methods, which are general-purpose and very flexible, have significant potential value for the digital libraries of the future.

REFERENCES

• 1: Christine L. Borgman, From Gutenberg to the global information infrastructure: access to information in the networked world, MIT Press, Cambridge, MA, 2000
• 2: C. W. Cleverdon. The cranfield tests on index language devices. Aslib Proceedings, 19:173--192, 1967.
• 3: W. Bruce Croft , John Lafferty, Language Modeling for Information Retrieval, Kluwer Academic Publishers, Norwell, MA, 2003
• 4: C. K. Schultz (Ed.). H. P. Luhn: Pioneer of information science. NY: Spartan Books, New York, 1968.
• 5: G. Salton (Ed.). The SMART retrieval system, Englewood Cliffs. NJ:Prentice-Hall, 1971.
• 6: W. Bruce Croft, Advances in Informational Retrieval: Recent Research from the Center for Intelligent Information Retrieval, Kluwer Academic Publishers, Norwell, MA, 2000
• 7: Karen Sparck Jones , Julia R. Galliers, Evaluating Natural Language Processing Systems: An Analysis and Review, Springer-Verlag New York, Inc., Secaucus, NJ, 1996
• 8: K. Sprck Jones, P. Jourlin, S. E. Johnson, and P. C. Woodland. The cambridge multimedia document retrieval (mdr) project: Summary of experiments, 2001.
• 9: K. Sparck Jones , S. Walker , S. E. Robertson, A probabilistic model of information retrieval: development and comparative experiments, Information Processing and Management: an International Journal, v.36 n.6, p.779-808, Nov.06.2000 [doi>10.1016/S0306-4573(00)00015-7]
• 10: Karen Sparck Jones , Peter Willett, Readings in information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 11: Finley Lacatusu, Andrew Hickl, Paul Aarseth, and Lara Taylor. Lite-gistexter at duc 2005. In Proceedings of Document Understanding Workshop (DUC) 2005, pages 88--94, 2005.
• 12: M. E. Maron , J. L. Kuhns, On Relevance, Probabilistic Indexing and Information Retrieval, Journal of the ACM (JACM), v.7 n.3, p.216-244, July 1960 [doi>10.1145/321033.321035]
• 13: Gerard. Salton, Automatic Information Organization and Retrieval., McGraw Hill Text, 1968
• 14: Carol Tenopir , Pamela Cahn, TARGET & FREESTYLE: Dialog and Mead join the relevance ranks, Online, v.18 n.3, p.31-47, May 1994
• 15: B. C. Vickery. Faceted classification schemes. Graduate School of Library Service, Rutgers, the State University, New Brunswick, N.J., 1966.
• 16: Ellen M. Voorhees , Donna K. Harman, TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing), The MIT Press, 2005
• 17: H. Yang and T. Chua. The integration of lexical knowledge and external resources for question answering, 2002.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Performance measures; Complexity measures

Keywords:
ACM proceedings, Delphi theory, LATEX, text tagging