Automatic acquisition of hyponyms from large text corpora

ABSTRACT

We describe a method for the automatic acquisition of the hyponymy lexical relation from unrestricted text. Two goals motivate the approach: (i) avoidance of the need for pre-encoded knowledge and (ii) applicability across a wide range of text. We identify a set of lexico-syntactic patterns that are easily recognizable, that occur frequently and across text genre boundaries, and that indisputably indicate the lexical relation of interest. We describe a method for discovering these patterns and suggest that other lexical relations will also be acquirable in this way. A subset of the acquisition algorithm is implemented and the results are used to augment and critique the structure of a large hand-built thesaurus. Extensions and applications to areas such as information retrieval are suggested.

REFERENCES

• 1: Thomas Ahlswede , Martha Evens, Parsing vs. text processing in the analysis of dictionary definitions, Proceedings of the 26th annual meeting on Association for Computational Linguistics, p.217-224, June 07-10, 1988, Buffalo, New York [doi>10.3115/982023.982050]
• 2: Hiyan Alshawi, Processing dictionary definitions with phrasal pattern hierarchies, Computational Linguistics, v.13 n.3-4, July-December 1987
• 3: John Dino Batali , Gerald Jay Sussman, Automatic acquisition and use of some of the knowledge in physics texts, 1991
• 4: Michael R. Brent, Automatic acquisition of subcategorization frames from untagged text, Proceedings of the 29th annual meeting on Association for Computational Linguistics, p.209-214, June 18-21, 1991, Berkeley, California [doi>10.3115/981344.981371]
• 5: Nicoletta Calzolari , Remo Bindi, Acquisition of lexical information: from a large textual Italian corpus, Proceedings of the 13th conference on Computational linguistics, p.54-59, August 20-25, 1990, Helsinki, Finland [doi>10.3115/991146.991156]
• 6: Coates-Stephens, S. (1991). Coping with lexical inadequacy - the automatic acquisition of proper nouns from news text. In The Proceedings of the 7th Annual Conference of the UW Centre for the New OED and Text Research: Using Corpora, pages 154--169, Oxford.
• 7: Doug Cutting , Julian Kupiec , Jan Pedersen , Penelope Sibun, A practical part-of-speech tagger, Proceedings of the third conference on Applied natural language processing, March 31-April 03, 1992, Trento, Italy [doi>10.3115/974499.974523]
• 8: Grolier (1990). Academic American Encyclopedia Grolier Electronic Publishing, Danbury, Connecticut.
• 9: Hearst, M. A. (1991). Noun homograph disambiguation using local context in large text corpora. In The Proceedings of the 7th Annual Conference of the UW Centre for the New OED and Text Research: Using Corpora, Oxford.
• 10: Donald Hindle, Noun classification from predicate-argument structures, Proceedings of the 28th annual meeting on Association for Computational Linguistics, p.268-275, June 06-09, 1990, Pittsburgh, Pennsylvania [doi>10.3115/981823.981857]
• 11: Jacobs, P. & U. Zernik (1988). Acquiring lexical knowledge from text: A case study. In Proceedings of AAAI88, pages 739--744.
• 12: Karen Jensen , Jean-Louis Binot, Disambiguating prepositional phrase attachments by using on-line dictionary definitions, Computational Linguistics, v.13 n.3-4, July-December 1987
• 13: Judith Markowitz , Thomas Ahlswede , Martha Evens, Semantically significant patterns in dictionary definitions, Proceedings of the 24th annual meeting on Association for Computational Linguistics, p.112-119, July 10-13, 1986, New York, New York [doi>10.3115/981131.981149]
• 14: Miller, G. A., R. Beckwith, C. Fellbaum, D. Gross, & K. J. Miller (1990). Introduction to wordnet: An on-line lexical database. Journal of Lexicography, 3(4):235--244.
• 15: Jane Morris , Graeme Hirst, Lexical cohesion computed by thesaural relations as an indicator of the structure of text, Computational Linguistics, v.17 n.1, p.21-48, March 1991
• 16: Jun-ichi Nakramura , Makoto Nagao, Extraction of semantic information from an ordinary English dictionary and its evaluation, Proceedings of the 12th conference on Computational linguistics, p.459-464, August 22-27, 1988, Budapest, Hungry [doi>10.3115/991719.991734]
• 17: Frank A. Smadja , Kathleen R. McKeown, Automatically extracting and representing collocations for language generation, Proceedings of the 28th annual meeting on Association for Computational Linguistics, p.252-259, June 06-09, 1990, Pittsburgh, Pennsylvania [doi>10.3115/981823.981855]
• 18: Paola Velardi , Maria Teresa Pazienza, Computer aided interpretation of lexical cooccurrences, Proceedings of the 27th annual meeting on Association for Computational Linguistics, p.185-192, June 26-29, 1989, Vancouver, British Columbia, Canada [doi>10.3115/981623.981646]
• 19: Wilks, Y. A., D. C. Fass, C. ming Guo, J. E. McDonald, T. Plate, & B. M. Slator (1990). Providing machine tractable dictionary tools. Journal of Machine Translation, 2.