Experiments in automatic statistical thesaurus construction

ABSTRACT

A well constructed thesaurus has long been recognized as a valuable tool in the effective operation of an information retrieval system. This paper reports the results of experiments designed to determine the validity of an approach to the automatic construction of global thesauri (described originally by Crouch in [1] and [2] based on a clustering of the document collection. The authors validate the approach by showing that the use of thesauri generated by this method results in substantial improvements in retrieval effectiveness in four test collections. The term discrimination value theory, used in the thesaurus generation algorithm to determine a term's membership in a particular thesaurus class, is found not to be useful in distinguishing a “good” from an “indifferent” or “poor” thesaurus class). In conclusion, the authors suggest an alternate approach to automatic thesaurus construction which greatly simplifies the work of producing viable thesaurus classes. Experimental results show that the alternate approach described herein in some cases produces thesauri which are comparable in retrieval effectiveness to those produced by the first method at much lower cost.

REFERENCES

• 1: C. J. Crouch, A cluster-based approach to thesaurus construction, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.309-320, May 1988, Grenoble, France [doi>10.1145/62437.62467]
• 2: C. J. Crouch, An approach to the automatic construction of global thesauri, Information Processing and Management: an International Journal, v.26 n.5, p.629-640, 1990 [doi>10.1016/0306-4573(90)90106-C]
• 3: Cleverdon, C.W.; Mills, J.; Keen, M. Factors determining the performance of indexing systems. Aslib Cranfield Project, Vol. 1; 1966.
• 4: Salton, G. Scientific reports on information storage and retrieval (ISR 11). Department of Computer Science, Cornell University, 1966.
• 5: Salton, G. Scientific reports on information storage and retrieval (ISR 13). Department of Computer Science, Cornell University, 1968.
• 6: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• 7: Sparck Jones, K. Automatic keyword classification for information retrieval. London: Butterworths; 1971.
• 8: Edward A. Fox, Lexical relations: enhancing effectiveness of information retrieval systems, ACM SIGIR Forum, v.15 n.3, p.5-36, Winter 1980 [doi>10.1145/1095403.1095404]
• 9: Yih-Chen Wang , James Vandendorpe , Martha Evens, Relational thesauri in information retrieval, Journal of the American Society for Information Science, v.36 n.1, p.15-27, Jan. 1985
• 10: Edward A. Fox , J. Terry Nutter , Thomas Ahlswede , Martha Evens , Judith Markowitz, Building a large thesaurus for information retrieval, Proceedings of the second conference on Applied natural language processing, February 09-12, 1988, Austin, Texas [doi>10.3115/974235.974253]
• 11: Edward A. Fox , Robert C. Wohlwend , Phyllis R. Sheldon , Qi Chen , Robert K. France, Building the CODER Lexicon: The Collins English Dictionary and Its Adverb Definitions, Virginia Polytechnic Institute & State University, Blacksburg, VA, 1986
• 12: Chen, H.; Lynch, K. Semantics-based information management and retrieval: A knowledge discovery approach. IEEE Transactions on Systems, Man and Cybernetics, 1992.
• 13: Hsinchun Chen , Vasant Dhar, Cognitive process as a basis for intelligent retrieval systems design, Information Processing and Management: an International Journal, v.27 n.5, p.405-432, 1991 [doi>10.1016/0306-4573(91)90060-Y]
• 14: Salton, G.; Yang, C.S.; Yu, C. T. A theory of term importance in automatic text analysis. Journal of the American Society for Information Science, 26(1):33-44; 1975.15.
• 15: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 16: Abdelmoula El-Hamdouchi , Peter Willett, An improved algorithm for the calculation of exact term discrimination values, Information Processing and Management: an International Journal, v.24 n.1, p.17-22, January 1988 [doi>10.1016/0306-4573(88)90073-8]
• 17: Ellen Marie Voorhees, The effectiveness and efficiency of agglomerative hierarchic clustering in document retrieval, Cornell University, Ithaca, NY, 1986
• 18: Ellen M. Voorhees, Implementing Agglomerative Hierarchic Clustering Algorithms for Use in Document Retrieval, Cornell University, Ithaca, NY, 1986
• 19: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979
• 20: Chris Buckley, Implementation of the SMART Information Retrieval System, Cornell University, Ithaca, NY, 1985
• 21: Fox, E. Characteristics of two new experimental collections in computer and information science containing textual and bibliographic concepts. Tech. Report 83-561, Department of Computer Science, Comell University.
• 22: Edward Alan Fox, Extending the boolean and vector space models of information retrieval with p-norm queries and multiple concept types, 1983

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Thesauruses

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Dictionaries

General Terms:
Algorithms, Experimentation, Languages