Author name disambiguation in MEDLINE

ABSTRACT

Background: We recently described “Author-ity,” a model for estimating the probability that two articles in MEDLINE, sharing the same author name, were written by the same individual. Features include shared title words, journal name, coauthors, medical subject headings, language, affiliations, and author name features (middle initial, suffix, and prevalence in MEDLINE). Here we test the hypothesis that the Author-ity model will suffice to disambiguate author names for the vast majority of articles in MEDLINE. Methods: Enhancements include: (a) incorporating first names and their variants, email addresses, and correlations between specific last names and affiliation words; (b) new methods of generating large unbiased training sets; (c) new methods for estimating the prior probability; (d) a weighted least squares algorithm for correcting transitivity violations; and (e) a maximum likelihood based agglomerative algorithm for computing clusters of articles that represent inferred author-individuals. Results: Pairwise comparisons were computed for all author names on all 15.3 million articles in MEDLINE (2006 baseline), that share last name and first initial, to create Author-ity 2006, a database that has each name on each article assigned to one of 6.7 million inferred author-individual clusters. Recall is estimated at ∼98.8%. Lumping (putting two different individuals into the same cluster) affects ∼0.5% of clusters, whereas splitting (assigning articles written by the same individual to >1 cluster) affects ∼2% of articles. Impact: The Author-ity model can be applied generally to other bibliographic databases. Author name disambiguation allows information retrieval and data integration to become person-centered, not just document-centered, setting the stage for new data mining and social network tools that will facilitate the analysis of scholarly publishing and collaboration behavior. Availability: The Author-ity 2006 database is available for nonprofit academic research, and can be freely queried via http://arrowsmith.psych.uic.edu.

REFERENCES

• 1: Bhattacharya, I. and Getoor, L. 2006. A latent Dirichlet model for unsupervised entity resolution. In Proceedings of the 6th SIAM Conference on Data Mining, J. Ghosh, D. Lambert, D. B. Skillicorn, and J. Srivastava Eds. SIAM, 47--58.
• 2: Indrajit Bhattacharya , Lise Getoor, Collective entity resolution in relational data, ACM Transactions on Knowledge Discovery from Data (TKDD), v.1 n.1, p.5-es, March 2007 [doi>10.1145/1217299.1217304]
• 3: Mikhail Bilenko , Beena Kamath , Raymond J. Mooney, Adaptive Blocking: Learning to Scale Up Record Linkage, Proceedings of the Sixth International Conference on Data Mining, p.87-96, December 18-22, 2006 [doi>10.1109/ICDM.2006.13]
• 4: Culotta, A. and McCallum, A. 2006. Tractable learning and inference of high-order representations. In Proceedings of the ICML Workshop on Open Problems in Statistical Relational Learning. http://www.cs.umd.edu/projects/srl2006/proceedings.html.
• 5: Culotta, A., Kanani, P., Hall, R., Wick, M., and McCallum, A. 2007. Author disambiguation using error-driven machine learning with a ranking loss function. In Proceedings of the 6th AAAI International Workshop on Information Integration on the Web.
• 6: Dominguez, J. and Gonzalez-Lima, M. D. 2006. A primal-dual interior-point algorithm for quadratic programming. Numer. Algor. 42, 1--30.
• 7: Douglas H. Fisher, Knowledge Acquisition Via Incremental Conceptual Clustering, Machine Learning, v.2 n.2, p.139-172, September 1987 [doi>10.1023/A:1022852608280]
• 8: James C. French , Allison L. Powell , Eric Schulman, Using clustering strategies for creating authority files, Journal of the American Society for Information Science, v.51 n.8, p.774-786, May 2000 [doi>10.1002/(SICI)1097-4571(2000)51:8<774::AID-ASI90>3.3.CO;2-G]
• 9: Carmen Galvez , Félix Moya-Anegón, Approximate personal name-matching through finite-state graphs, Journal of the American Society for Information Science and Technology, v.58 n.13, p.1960-1976, November 2007 [doi>10.1002/asi.v58:13]
• 10: Garfield, E. 1969. British quest for uniqueness versus American egocentrism. Nature 223, 763.
• 11: Hui Han , Hongyuan Zha , C. Lee Giles, Name disambiguation in author citations using a K-way spectral clustering method, Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2005, Denver, CO, USA [doi>10.1145/1065385.1065462]
• 12: Hui Han , Lee Giles , Hongyuan Zha , Cheng Li , Kostas Tsioutsiouliklis, Two supervised learning approaches for name disambiguation in author citations, Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2004, Tuscon, AZ, USA [doi>10.1145/996350.996419]
• 13: Herskovic, J. R., Tanaka, L. Y., Hersh, W., and Bernstam, E. V. 2007. A day in the life of PubMed: analysis of a typical day's query log. J. Amer. Med. Inform. Ass. 14, 212--220.
• 14: Holmes, D. I., Robertson, M., and Paez, R. 2001. Stephen Crane and the New-York Tribune: A case study in traditional and non-traditional authorship attribution. Comput. Human. 35, 315--331.
• 15: Huang, J., Ertekin, S., and Giles, C. L. 2006. Efficient name disambiguation for large-scale databases. In Proceedings of the 10th European Conference on Principles and Practice of Knowledge Discovery in Databases, J. F&#252;rnkranz, T. Scheffer, and M. Spiliopoulou Eds. Springer-Verlag, 536--544.
• 16: Jaro, M. A. 1995. Probabilistic linkage of large public health data files. Statis. Med. 14, 491--498.
• 17: Dmitri V. Kalashnikov , Sharad Mehrotra, Domain-independent data cleaning via analysis of entity-relationship graph, ACM Transactions on Database Systems (TODS), v.31 n.2, p.716-767, June 2006 [doi>10.1145/1138394.1138401]
• 18: Kanani, P., McCallum, A., and Pal, C. 2007. Improving author coreference by resource-bounded information gathering from the Web. In Proceedings of the 20th International Joint Conference on Artificial Intelligence, M. M. Veloso Ed. 429--434.
• 19: Nick Koudas , Sunita Sarawagi , Divesh Srivastava, Record linkage: similarity measures and algorithms, Proceedings of the 2006 ACM SIGMOD international conference on Management of data, June 27-29, 2006, Chicago, IL, USA [doi>10.1145/1142473.1142599]
• 20: Madigan, D., Genkin, A., Lewis, D. D., Argamon, S., Fradkin, D., and Ye, L. 2005. Author identification on the large-scale. Annual Meeting of the Classification Society of North America. http://www.stat.rutgers.edu/~madigan/PAPERS/authorid-csna05.pdf.
• 21: Gideon S. Mann , David Yarowsky, Unsupervised personal name disambiguation, Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003, p.33-40, May 31, 2003, Edmonton, Canada [doi>10.3115/1119176.1119181]
• 22: Byung-Won On , Dongwon Lee , Jaewoo Kang , Prasenjit Mitra, Comparative study of name disambiguation problem using a scalable blocking-based framework, Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2005, Denver, CO, USA [doi>10.1145/1065385.1065463]
• 23: Qiu, J. 2008. Scientific publishing: identity crisis. Nature 451, 766--767.
• 24: Patrick Reuther , Bernd Walter, Survey on test collections and techniques for personal name matching, International Journal of Metadata, Semantics and Ontologies, v.1 n.2, p.89-99, January 2006 [doi>10.1504/IJMSO.2006.011006]
• 25: Scoville, C. L., Johnson, E. D., and McConnell, A. L. 2003. When A. rose is not A. Rose: The vagaries of author searching. Med. Refer. Serv. Quart. 22, 1--11.
• 26: Smalheiser, N. R., Zhou, W., and Torvik, V. I. 2008. Anne O'Tate: A tool to support user-driven summarization, drill-down and browsing of PubMed search results. J. Biomed. Discov. Collab. 3, 2.
• 27: Smalheiser, N. R. and Torvik, V. I. 2009. Author name disambiguation. In Annual Review of Information Science and Technology 43, B. Cronin Ed. 287--313.
• 28: Neil R. Smalheiser , Vetle I. Torvik , Wei Zhou, Arrowsmith two-node search interface: A tutorial on finding meaningful links between two disparate sets of articles in MEDLINE, Computer Methods and Programs in Biomedicine, v.94 n.2, p.190-197, May, 2009 [doi>10.1016/j.cmpb.2008.12.006]
• 29: Soler, J. M. 2007. Separating the articles of authors with the same name. Scientometrics 72, 281--290.
• 30: Yang Song , Jian Huang , Isaac G. Councill , Jia Li , C. Lee Giles, Efficient topic-based unsupervised name disambiguation, Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries, June 18-23, 2007, Vancouver, BC, Canada [doi>10.1145/1255175.1255243]
• 31: Yee Fan Tan , Min Yen Kan , Dongwon Lee, Search engine driven author disambiguation, Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries, June 11-15, 2006, Chapel Hill, NC, USA [doi>10.1145/1141753.1141826]
• 32: Vetle I. Torvik , Marc Weeber , Don R. Swanson , Neil R. Smalheiser, A probabilistic similarity metric for Medline records: A model for author name disambiguation: Research Articles, Journal of the American Society for Information Science and Technology, v.56 n.2, p.140-158, January 2005 [doi>10.1002/asi.v56:2]
• 33: Vetle I. Torvik , Neil R. Smalheiser, A quantitative model for linking two disparate sets of articles in MEDLINE, Bioinformatics, v.23 n.13, p.1658-1665, July 2007 [doi>10.1093/bioinformatics/btm161]
• 34: Wilbur, W. J. and Yang, Y. 1996. An analysis of statistical term-strength and its use in the indexing and retrieval of molecular biology texts. Comput. Bio. Med. 26, 209--222.
• 35: Winkler, W. E. 1995. Matching and record linkage. In Business Survey Methods, B. G. Cox, D. A. Binder, B. N. Chinnappa, A. Christianson, M. J. Colledge, and P. S. Kott Eds. Wiley, New York, 355--384.
• 36: Yin, X., Han, J., and Yu, P. S. 2007. Object distinction: Distinguishing objects with identical names by link analysis. In Proceedings of the IEEE 23rd International Conference on Data Engineering. IEEE, 1242--1246.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.1 Models
      I.5.2 Design Methodology
      I.5.3 Clustering

General Terms:
Algorithms, Experimentation, Performance

Keywords:
Name disambiguation, bibliographic databases