Concept vector extraction from Wikipedia category network

ABSTRACT

The availability of machine readable taxonomy has been demonstrated by various applications such as document classification and information retrieval. One of the main topics of automated taxonomy extraction research is Web mining based statistical NLP and a significant number of researches have been conducted. However, existing works on automatic dictionary building have accuracy problems due to the technical limitation of statistical NLP (Natural Language Processing) and noise data on the WWW. To solve these problems, in this work, we focus on mining Wikipedia, a large scale Web encyclopedia. Wikipedia has high-quality and huge-scale articles and a category system because many users in the world have edited and refined these articles and category system daily. Using Wikipedia, the decrease of accuracy deriving from NLP can be avoided. However, affiliation relations cannot be extracted by simply descending the category system automatically since the category system in Wikipedia is not in a tree structure but a network structure. We propose concept vectorization methods which are applicable to the category network structured in Wikipedia.

REFERENCES

• 1: J. Becker and D. Kuropka. Topic-based vector space model. In Proc. of International Conference on Business Information Systems (BIS), pages 7--12, June 2003.
• 2: C. Brewster. Techniques for automated taxonomy building: Towards ontologies for knowledge management. In Proc. of Computational Linguistics UK Research Colloquium (CLUK), Jan. 2002.
• 3: Peter F. Brown , Peter V. deSouza , Robert L. Mercer , Vincent J. Della Pietra , Jenifer C. Lai, Class-based n-gram models of natural language, Computational Linguistics, v.18 n.4, p.467-479, December 1992
• 4: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 5: E. Gabrilovich and S. Markovitch. Computing semantic relatedness using Wikipedia-based explicit semantic analysis. In Proc. of International Joint Conference on Artificial Intelligence (IJCAI), pages 1606--1611, Jan. 2007.
• 6: J. Giles. Internet encyclopedias go head to head. Nature, 438(7070):900--901, Dec. 2005.
• 7: S. Ikehara, M. Miyazaki, S. Shirai, A. Yokoo, H. Nakaiwa, K. Ogura, Y. Ooyama, and Y. Hayashi. Goi-Taikei --- A Japanese Lexicon. Iwanami Shoten, 1997.
• 8: B. Leuf and W. Cunningham. The Wiki Way: Collaboration and sharing on the Internet. Addison-Wesley, 2001.
• 9: John G. McMahon , Francis J. Smith, Improving statistical language model performance with automatically generated word hierarchies, Computational Linguistics, v.22 n.2, p.217-247, June 1996
• 10: George A. Miller, WordNet: a lexical database for English, Communications of the ACM, v.38 n.11, p.39-41, Nov. 1995 [doi>10.1145/219717.219748]
• 11: K. Nakayama, T. Hara, and S. Nishio. Wikipedia mining to construct a thesaurus(information retrieval). Transactions of Information Processing Society of Japan, 47(10):2917--2928, Oct. 2006.
• 12: M. Ruiz-Casado, E. Alfonseca, and P. Castells. Automatic assignment of Wikipedia encyclopedic entries to WordNet synsets. In Proc. of International Atlantic Web Intelligence Conference (AWIC), pages 380--386, June 2005.
• 13: M. Strube and S. Ponzetto. WikiRelate! computing semantic relatedness using Wikipedia. In Proc. of National Conference on Artificial Intelligence (AAAI), pages 1419--1424, July 2006.
• 14: Max Völkel , Markus Krötzsch , Denny Vrandecic , Heiko Haller , Rudi Studer, Semantic Wikipedia, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135863]
• 15: Wikimedia Foundation. Categorytree. http://en.wikipedia.Org/wiki/Special:CategoryTree.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.6 Library Automation

General Terms:
Algorithms, Experimentation

Keywords:
Wikipedia, categorization, concept vector, web mining