Address standardization with latent semantic association

ABSTRACT

Address standardization is a very challenging task in data cleansing. To provide better customer relationship management and business intelligence for customer-oriented cooperates, millions of free-text addresses need to be converted to a standard format for data integration, de-duplication and householding. Existing commercial tools usually employ lots of hand-craft, domain-specific rules and reference data dictionary of cities, states etc. These rules work better for the region they are designed. However, rule-based methods usually require more human efforts to rewrite these rules for each new domain since address data are very irregular and varied with countries and regions. Supervised learning methods usually are more adaptable than rule-based approaches. However, supervised methods need large-scale labeled training data. It is a labor-intensive and time-consuming task to build a large-scale annotated corpus for each target domain. For minimizing human efforts and the size of labeled training data set, we present a free-text address standardization method with latent semantic association (LaSA). LaSA model is constructed to capture latent semantic association among words from the unlabeled corpus. The original term space of the target domain is projected to a concept space using LaSA model at first, then the address standardization model is active learned from LaSA features and informative samples. The proposed method effectively captures the data distribution of the domain. Experimental results on large-scale English and Chinese corpus show that the proposed method significantly enhances the performance of standardization with less efforts and training data.

REFERENCES

• 1: Eugene Agichtein , Venkatesh Ganti, Mining reference tables for automatic text segmentation, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014058]
• 2: R. Associates. Raab associates guide to customer matching systems. 2003.
• 3: K. Brinker. Incorporating diversity in active learning with support vector machines. In Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), 2003.
• 4: Kenneth Ward Church , Patrick Hanks, Word association norms, mutual information, and lexicography, Computational Linguistics, v.16 n.1, p.22-29, March 1990
• 5: David M. Blei , Andrew Y. Ng , Michael I. Jordan, Latent dirichlet allocation, The Journal of Machine Learning Research, 3, p.993-1022, 3/1/2003 [doi>10.1162/jmlr.2003.3.4-5.993]
• 6: S. Deerwester, S. T. Dumais, and R. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391--407, 1990.
• 7: S. A. Engelson and I. Dagan. Committee-based sample selection for probabilistic classifiers. Journal of Artifical Intelligence Research, 11:335--360, 1999.
• 8: Radu Florian , Abe Ittycheriah , Hongyan Jing , Tong Zhang, Named entity recognition through classifier combination, Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003, p.168-171, May 31, 2003, Edmonton, Canada [doi>10.3115/1119176.1119201]
• 9: Freitag. Trained named entity recognition using distributional clusters. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing (EMNLP 2004), 2004.
• 10: Hong Lei Guo , Li Zhang , Zhong Su, Empirical study on the performance stability of named entity recognition model across domains, Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, July 22-23, 2006, Sydney, Australia
• 11: Thomas Hofmann, Probabilistic latent semantic indexing, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.50-57, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312649]
• 12: Hongyan Jing , Radu Florian , Xiaoqiang Luo , Tong Zhang , Abraham Ittycheriah, HowtogetaChineseName(Entity): segmentation and combination issues, Proceedings of the 2003 conference on Empirical methods in natural language processing, p.200-207, July 11, 2003 [doi>10.3115/1119355.1119381]
• 13: D. Lewis and J. Catlett. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the Eleventh International Conference on Machine Learning (ICML-1994), 1994.
• 14: S. Miller, J. Guinness, and A. Zamanian. Name tagging with word clusters and discriminative training. In Proceedings of North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL HLT) 2004 conference, pages 337--342, 2004.
• 15: Erik F. Tjong Kim Sang , Fien De Meulder, Introduction to the CoNLL-2003 shared task: language-independent named entity recognition, Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003, p.142-147, May 31, 2003, Edmonton, Canada [doi>10.3115/1119176.1119195]
• 16: Dan Shen , Jie Zhang , Jian Su , Guodong Zhou , Chew-Lim Tan, Multi-criteria-based active learning for named entity recognition, Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p.589-es, July 21-26, 2004, Barcelona, Spain [doi>10.3115/1218955.1219030]
• 17: Min Tang , Xiaoqiang Luo , Salim Roukos, Active learning for statistical natural language parsing, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073105]
• 18: Cynthia A. Thompson , Mary Elaine Califf , Raymond J. Mooney, Active Learning for Natural Language Parsing and Information Extraction, Proceedings of the Sixteenth International Conference on Machine Learning, p.406-414, June 27-30, 1999
• 19: Simon Tong , Daphne Koller, Support vector machine active learning with applications to text classification, The Journal of Machine Learning Research, 2, p.45-66, 3/1/2002 [doi>10.1162/153244302760185243]
• 20: Vinayak Borkar , Kaustubh Deshmukh , Sunita Sarawagi, Automatic segmentation of text into structured records, Proceedings of the 2001 ACM SIGMOD international conference on Management of data, p.175-186, May 21-24, 2001, Santa Barbara, California, United States
• 21: Xing Wei , W. Bruce Croft, LDA-based document models for ad-hoc retrieval, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148204]
• 22: Tong Zhang , David Johnson, A robust risk minimization based named entity recognition system, Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003, p.204-207, May 31, 2003, Edmonton, Canada [doi>10.3115/1119176.1119210]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Text analysis

General Terms:
Algorithms, Experimentation

Keywords:
address, data standardization