Use of syntactic context to produce term association lists for text retrieval

ABSTRACT

One aspect of world knowledge essential to information retrieval is knowing when two words are related. Knowing word relatedness allows a system given a user's query terms to retrieve relevant documents not containing those exact terms. Two words can be said to be related if they appear in the same contexts Document co-occurrence gives a measure of word relatedness that has proved to be too rough to be useful. The relatively recent apparition of on-line dictionaries and robust and rapid parsers permits the extraction of finer word contexts from large corpora. In this paper, we will describe such an extraction technique that uses only coarse syntactic analysis and no domain knowledge. This technique produces lists of words related to any work appearing in a corpus. When the closest related terms were used in query expansion of a standard information retrieval testbed, the results were much better than that given by document co-occurence techniques, and slightly better than using unexpanded queries, supporting the contention that semantically similar words were indeed extracted by this technique.

REFERENCES

• Crouch 1990: C. J. Crouch, An approach to the automatic construction of global thesauri, Information Processing and Management: an International Journal, v.26 n.5, p.629-640, 1990 [doi>10.1016/0306-4573(90)90106-C]
• DeRose 1988: Steven J. DeRose, Grammatical category disambiguation by statistical optimization, Computational Linguistics, v.14 n.1, p.31-39, Winter 1988
• Dumais 1990: Susan T. Dumais. Enhancing performance in latent semantic (LSI) retrieval. Unpublished manuscript, 1990.
• Evans et al. 1991a: David A. Evans, K. Ginther-Webster, Mary Hart, R. G. Lefferts, and Ira A. Monarch. Automatic indexing using selective NLP and first-order thesauri. In RIAO'91, pages 624- 643, Barcelona, April 2-5 1991. CID, Paris.
• Evans et al. 1991b: David A. Evans, Steve K. Henderson, Robert G. Lefferts, and Ira A. Monarch. A summary of the CLARIT project. Technical Report CMU-LCL-91-2, Laboratory for Computational Linguistics, Carnegie-Mellon University, November 1991.
• Grefenstette 1992: G. Grefenstette. Sextant: Extracting semantics from raw text implementation details. Technical Report CS92-05, University of Pittsburgh, Computer Science Dept., February 1992.
• Hearst 1992: Marti A. Hearst, Automatic acquisition of hyponyms from large text corpora, Proceedings of the 14th conference on Computational linguistics, August 23-28, 1992, Nantes, France [doi>10.3115/992133.992154]
• Hindle 1989: Donald Hindle, Acquiring disambiguation rules from text, Proceedings of the 27th annual meeting on Association for Computational Linguistics, p.118-125, June 26-29, 1989, Vancouver, British Columbia, Canada [doi>10.3115/981623.981638]
• Lewis and Croft 1990: D. D. Lewis , W. B. Croft, Term clustering of syntactic phrases, Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval, p.385-404, September 05-07, 1990, Brussels, Belgium [doi>10.1145/96749.98244]
• Miller et al. 1990: George A. Miller, R. Beckwith, C. Fellbaum, D. Gross, and K. j. Miller. Introduction to WordNet: An on-line lexical database. Journal of Lexicography, 3(4)" 235- 244, 1990.
• Minker et al. 1972: J. Minker, G. A. Wilson, and B. H. Zimmerman. Query expansion by the addition of clustered terms for a document retrieval system. Information Storage and Retrieval, 8:329-348, 1972.
• Peat and Willet 1991: Helen J. Peat and Peter Willet. The limitations of term cooccurrence data for query expansion in doc- - ument retrieval systems. Journal of the American Society for information Science, 42(5)'378-383, 1991.
• Phillips 1985: Martin Phillips. Aspects of Text Structure: An investigation of the lexical organization of text. Elsevier, Amsterdam, 1985.
• Romesburg 1984: H. C. Romesburg. Cluster Analysis for Researchers. Lifetime Learning Publications, Belmont, CA, 1984.
• Ruge 1991: Gerda Rage. Experiments on linguistically based term associations. In RIA 0'91, pages 528-545, Barcelona, April 2- 5 1991. CID, Paris.
• Salton 1971: G. Salton, The SMART Retrieval System—Experiments in Automatic Document Processing, Prentice-Hall, Inc., Upper Saddle River, NJ, 1971
• Salton 1972: G. Salton. Comment on "query expansion by the addition of clustered terms for a document retrieval system". Information Storage and Retrieval, 8:349, 1972.
• Smeaton and van Rijsbergen 1983: A. F. Smeaton and C. J. van Rijsbergen. The retrieval effectiveness of query expansion on a feedback document retrieval system. Computer Journal, 26:239-246, 1983.
• Sparck Jones 1971: Karen Sparck Jones. Automatic Keyword Classification and Information Retrieval. Butterworths, London, 1971.
• Sparck Jones 1991: Karen Sparck Jones, Notes and references on early automatic classification work, ACM SIGIR Forum, v.25 n.1, p.10-17, Spring 1991 [doi>10.1145/122642.122644]
• Tanimoto 1958: T. T. Tanimoto. An elementary mathematical theory of classification. I.B.M. Research, 1958.
• Yu and Raghavan 1977: C. T. Yu and V. V. Raghavan. Single-pass method for determining the semantic relationships between terms. JASIS, 26(11):345-354, 1977.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Dictionaries

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Linguistics

General Terms:
Experimentation, Languages