NNexus: an automatic linker for collaborative web-based corpora

ABSTRACT

Collaborative online encyclopedias or knowledge bases such as Wikipedia and PlanetMath are becoming increasingly popular. We demonstrate NNexus, a generalization of the automatic linking engine of PlanetMath.org and the first system that automates the process of linking disparate "encyclopedia" entries into a fully-connected conceptual network. The main challenges of this problem space include: 1) linking quality (correctly identifying which terms to link and which entry to link to with minimal effort on the part of users), 2) efficiency and scalability, and 3) generalization to multiple knowledge bases and web-based information environment. We present NNexus that utilizes subject classification and other metadata to address these challenges and demonstrate its effectiveness and efficiency through multiple real world corpora.

REFERENCES

• 1: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 2: J. Gardner, A. Krowne, and L. Xiong. NNexus: Towards a Subject-Steered Automatic Linker for a Massively-Distributed Collaborative Corpus. In 2nd IEEE Collaborate Com Workshop, 2006.
• 3: J. Gardner, A. Krowne, and L. Xiong. NNexus: An automatic linker for collaborative web-based corpora. IEEE Transactions on Knowledge and Data Engineering, 2008.
• 4: D. W. Huang, Y. Xu, A. Trotman, and S. Geva. Overview of INEX 2007 link the wiki track. pages 373--387, 2008.
• 5: J. Kolbitsch and H. Maurer. Community building around encyclopeadic knowledge. Journal of Computing and Information Technology, 14, 2006.
• 6: David Milne , Ian H. Witten, Learning to link with wikipedia, Proceeding of the 17th ACM conference on Information and knowledge management, October 26-30, 2008, Napa Valley, California, USA [doi>10.1145/1458082.1458150]
• 7: Adam Souzis, Building a Semantic Wiki, IEEE Intelligent Systems, v.20 n.5, p.87-91, September 2005 [doi>10.1109/MIS.2005.83]
• 8: S. E. R. Tazzoli and P. Castagna. Towards a semantic wiki wiki web. In In Demo Session at ISWC2004, 2004.
• 9: Max Völkel , Markus Krötzsch , Denny Vrandecic , Heiko Haller , Rudi Studer, Semantic Wikipedia, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135863]