Rule based synonyms for entity extraction from noisy text

ABSTRACT

Identification of named entities such as person, organization and product names from text is an important task in information extraction. In many domains, the same entity could be referred to in multiple ways due to variations introduced by different user groups, variations of spellings across regions or cultures, usage of abbreviations, typographical errors and other reasons associated with conventional usage. Identifying a piece of text as a mention of an entity in such noisy data is difficult, even if we have a dictionary of possible entities. Previous approaches treat the synonym problem as part entity disambiguation and use learning-based methods that use the context of the words to identify synonyms. In this paper, we show that existing domain knowledge, encoded as rules, can be used effectively to address the synonym problem to a considerable extent. This makes the disambiguation task simpler, without the need for much training data. We look at a subset of application scenarios in named entity extraction, categorize the possible variations in entity names, and define rules for each category. Using these rules, we generate synonyms for the canonical list and match these synonyms to the actual occurrence in the data sets. In particular, we describe the rule categories that we developed for several named entities and report the results of applying our technique of extracting named entities by generating synonyms for two different domains.

REFERENCES

• 1: Amit Bagga , Breck Baldwin, Entity-based cross-document coreferencing using the Vector Space Model, Proceedings of the 17th international conference on Computational linguistics, August 10-14, 1998, Montreal, Quebec, Canada
• 2: Michael W. Berry , Susan T. Dumais , Todd A. Letsche, Computational Methods for Intelligent Information Access, Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM), p.20, December 04-08, 1995, San Diego, California, United States [doi>10.1145/224170.285569]
• 3: Indrajit Bhattacharya , Lise Getoor, Iterative record linkage for cleaning and integration, Proceedings of the 9th ACM SIGMOD workshop on Research issues in data mining and knowledge discovery, June 13, 2004, Paris, France [doi>10.1145/1008694.1008697]
• 4: M. Blume. Automatic entity disambiguation: Benefits to ner, relation extraction, link analysis, and inference. In International Conference on Intelligence Analysis, 2005.
• 5: R. C. Bunescu and M. Pasca. Using encyclopedic knowledge for named entity disambiguation. In EACL, 2006.
• 6: S. Cucerzan. Large-scale named entity disambiguation based on wikipedia data. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 708--716, 2007.
• 7: S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantic analysis. JASIS, 41(6):391--407, 1990.
• 8: J. Hassell, B. Aleman-Meza, and I. B. Arpinar. Ontology-driven automatic entity disambiguation in unstructured text. In International Semantic Web Conference, pages 44--57, 2006.
• 9: M. J. H. Lee and Y. J. Lee. Information retrieval based-on conceptual distance in is-a hierarchies. Journal of Documentation, 49:188--207, 1993.
• 10: J. J. Jiang and D. W. Conrath. Semantic similarity based on corpus statistics and lexical taxonomy. CoRR, cmp-lg/9709008, 1997.
• 11: D. V. Kalashnikov, S. Mehrotra, and Z. Chen. Exploiting relationships for domain-independent data cleaning. In SDM, 2005.
• 12: Dekang Lin, Automatic retrieval and clustering of similar words, Proceedings of the 17th international conference on Computational linguistics, p.768-774, August 10-14, 1998, Montreal, Quebec, Canada
• 13: D. Lin, S. Zhao, L. Qin, and M. Zhou. Identifying synonyms among distributionally similar words. In IJCAI, pages 1492--1493, 2003.
• 14: B. Malin. Unsupervised name disambiguation via social network similarity. In Workshop on Link Analysis, Counterterrorism, and Security, ICDM, pages 93--102, 2005.
• 15: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 16: Youngja Park , Roy J Byrd , Branimir K Boguraev, Automatic glossary extraction: beyond terminology identification, Proceedings of the 19th international conference on Computational linguistics, p.1-7, August 24-September 01, 2002, Taipei, Taiwan [doi>10.3115/1072228.1072370]
• 17: Y. Ravin and Z. Kazi. Is hillary rodham clinton the president? In ACL Workshop on Coreference and it's Applications, 1999.
• 18: P. Resnik. Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. J. Artif. Intell. Res. (JAIR), 11:95--130, 1999.
• 19: R. Richardson, A. F. Smeaton, and J. Murphy. Using WordNet as a knowledge base for measuring semantic similarity between words. Technical Report CA-1294, Dublin City University, Dublin, Ireland, 1994.
• 20: J. Toole. A hybrid approach to the identification and expansion of abbreviations, 2000.
• 21: Peter D. Turney, Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL, Proceedings of the 12th European Conference on Machine Learning, p.491-502, September 05-07, 2001
• 22: Nina Wacholder , Yael Ravin , Misook Choi, Disambiguation of proper names in text, Proceedings of the fifth conference on Applied natural language processing, p.202-208, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974587]
• 23: H. Yu, V. Hatzivassiloglou, C. Friedman, A. Rzhetsky, and W. Wilbur. Automatic extraction of gene and protein synonyms from medline and journal articles, 2002.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Keywords:
named entity extraction, product name extraction, synonym generation