TREC: Continuing information retrieval's tradition of experimentation

ABSTRACT

Large-scale test collections drive improvement in search technology to help users find information in free text.

REFERENCES

• 1: Buckley, C. and Voorhees, E. Retrieval system evaluation. In TREC: Experiment and Evaluation in Information Retrieval, E. Voorhees and D. Harman, Eds. MIT Press, Cambridge, MA, 2005, 53--75.
• 2: Cyril Cleverdon, The Cranfield tests on index language devices, Readings in information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 3: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• 4: Spärck Jones, K., Ed. Information Retrieval Experiment. Butterworths, London, 1981.
• 5: Spärck Jones, K. and van Rijsbergen, C. Report on the need for and provision of an `ideal' information retrieval test collection. British Library Research and Development Report 5266, Computer Laboratory, University of Cambridge, 1975.
• 6: Ellen M. Voorhees , Donna K. Harman, TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing), The MIT Press, 2005

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.0 General

Additional Classification:
  C. Computer Systems Organization
  C.4 PERFORMANCE OF SYSTEMS

  E. Data
  E.0 GENERAL

  H. Information Systems
  H.0 GENERAL
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
      H.3.7 Digital Libraries

  I. Computing Methodologies
  I.0 GENERAL

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.0 General
  K.7 THE COMPUTING PROFESSION
      K.7.3 Testing, Certification, and Licensing