Learning metadata from the evidence in an on-line citation matching scheme

ABSTRACT

Citation matching, or the automatic grouping of bibliographic references that refer to the same document, is a data management problem faced by automatic digital libraries for scientific literature such as CiteSeer and Google Scholar. Although several solutions have been offered for citation matching in large bibliographic databases, these solutions typically require expensive batch clustering operations that must be run offline. Large digital libraries containing citation information can reduce maintenance costs and provide new services through efficient online processing of citation data, resolving document citation relationships as new records become available. Additionally, information found in citations can be used to supplement document metadata, requiring the generation of a canonical citation record from merging variant citation subfields into a unified "best guess" from which to draw information. Citation information must be merged with other information sources in order to provide a complete document record. This paper outlines a system and algorithms for online citation matching and canonical metadata generation. A Bayesian framework is employed to build the ideal citation record for a document that carries the added advantages of fusing information from disparate sources and increasing system resilience to erroneous data.

REFERENCES

• 1: Apache Lucene. Apache Software Foundation, http://lucene.apache.org/java/docs/index.html, 2005.
• 2: Donna Bergmark, Automatic Extraction of Reference Linking Information from Online Documents, Cornell University, Ithaca, NY, 2000
• 3: Dominique Besagni , Abdel Belaïd, Citation Recognition for Scientific Publications in Digital Libraries, Proceedings of the First International Workshop on Document Image Analysis for Libraries (DIAL'04), p.244, January 23-24, 2004
• 4: Culotta, A. and McCallum, A. Confidence Estimation for Information Extraction. In Proceedings of Human Language Technology Conference and North American Chapter of the Association for Computational Linguistics (HLT-NAACL), 2004.
• 5: Egghe, L. and Rousseau, R. Co-citation, bibliographic coupling and a characterization of lattice citation networks. Scientometrics, 55, Number 3, 2002, 349--361.
• 6: Garfield, E. Quantitative measures of communication in science. Science 144, 1964, 649--654.
• 7: C. Lee Giles , Kurt D. Bollacker , Steve Lawrence, CiteSeer: an automatic citation indexing system, Proceedings of the third ACM conference on Digital libraries, p.89-98, June 23-26, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276675.276685]
• 8: Hui Han , Hongyuan Zha , C. Lee Giles, Name disambiguation in author citations using a K-way spectral clustering method, Proceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries, June 07-11, 2005, Denver, CO, USA [doi>10.1145/1065385.1065462]
• 9: Shawndra Hill , Foster Provost, The myth of the double-blind review?: author identification using only citations, ACM SIGKDD Explorations Newsletter, v.5 n.2, December 2003 [doi>10.1145/980972.981001]
• 10: Pairin Katerattanakul , Bernard Han , Soongoo Hong, Objective quality ranking of computing journals, Communications of the ACM, v.46 n.10, p.111-114, October 2003 [doi>10.1145/944217.944221]
• 11: Steve Lawrence , Kurt Bollacker , C. Lee Giles, Distributed error correction, Proceedings of the fourth ACM conference on Digital libraries, p.232, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313390]
• 12: Steve Lawrence , Frans Coetzee , Eric Glover , Gary Flake , David Pennock , Bob Krovetz , Finn Nielsen , Andries Kruger , Lee Giles, Persistence of information on the web: analyzing citations contained in research articles, Proceedings of the ninth international conference on Information and knowledge management, p.235-242, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354824]
• 13: Steve Lawrence , C. Lee Giles , Kurt Bollacker, Digital Libraries and Autonomous Citation Indexing, Computer, v.32 n.6, p.67-71, June 1999 [doi>10.1109/2.769447]
• 14: Marthi, B., Milch, B., and Russell, S. First-Order Probabilistic Models for Information Extraction. IJCAI 2003 Workshop on Learning Statistical Models from Relational Data, Acapulco, Mexico, August 2003.
• 15: Andrew McCallum , Kamal Nigam , Lyle H. Ungar, Efficient clustering of high-dimensional data sets with application to reference matching, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, p.169-178, August 20-23, 2000, Boston, Massachusetts, United States [doi>10.1145/347090.347123]
• 16: Pasula, H., Marthi, B., Milch, B., and Russell, S., and Shpitser, I. Identity uncertainty and citation matching. Advances in Neural Information Processing (NIPS), 2003.
• 17: Judea Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1988
• 18: Yves Petinot , C. Lee Giles , Vivek Bhatnagar , Pradeep B. Teregowda , Hui Han , Isaac Councill, A service-oriented architecture for digital libraries, Proceedings of the 2nd international conference on Service oriented computing, November 15-19, 2004, New York, NY, USA [doi>10.1145/1035167.1035205]
• 19: Sarawagi, S., Vydiswaran, V., Srinivasan, S., and Bhudhia, K. Resolving citations in a paper repository. In Proc SIGKDD, 5, Number 2, 2003, 156--157.
• 20: Ben Wellner , Andrew McCallum , Fuchun Peng , Michael Hay, An integrated, conditional model of information extraction and coreference with application to citation matching, Proceedings of the 20th conference on Uncertainty in artificial intelligence, p.593-601, July 07-11, 2004, Banff, Canada

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.6 Library Automation
          Subjects: Large text archives

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.3 Deduction and Theorem Proving
          Subjects: Uncertainty, "fuzzy," and probabilistic reasoning; Inference engines

General Terms:
Algorithms, Experimentation, Management, Security

Keywords:
CiteSeer, bayesian inference, citation matching