Graph-based text representation and knowledge discovery

ABSTRACT

For information retrieval and text-mining, a robust scalable framework is required to represent the information extracted from documents and enable visualization and query of such information. One very widely used model is the vector space model which is based on the bag-of-words approach. However, it suffers from the fact that it loses important information about the original text, such as information about the order of the terms in the text or about the frontiers between sentences or paragraphs. In this paper, we propose a graph-based text representation, which is capable of capturing (i) Term order (ii) Term frequency (iii) Term co-occurrence (iv) Term context in documents. We also apply the graph model into our text mining task, which is to discover unapparent associations between two and more concepts (e.g. individuals) from a large text corpus. Counterterrorism corpus is used to evaluate the performance of various retrieval models, which demonstrates feasibility and effectiveness of graphic text representation in information retrieval and text mining.

REFERENCES

• 1: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 2: Norbert Fuhr, Models for retrieval with probabilistic indexing, Information Processing and Management: an International Journal, v.25 n.1, p.55-72, 1989 [doi>10.1016/0306-4573(89)90091-5]
• 3: Hensman, S. Construction of conceptual graph representation of texts. In Proceedings of Student Research Workshop at HLT-NAACL, Boston, 2004, 49--54.
• 4: Bhoopesh, P. Text clustering using semantics. The 11^th International Word Wide Web Conference, (WWW 2002), Hawai, USA, 2002.
• 5: Mani, I., Bloedorn, E. Multi-document summarization by graph search and matching. In Proceedings of Fifteenth National Conference Artificial Intelligence, 1997, 622--628.
• 6: Adam Schenker , Mark Last , Horst Bunke , Abraham Kandel, Classification of Web Documents Using a Graph Model, Proceedings of the Seventh International Conference on Document Analysis and Recognition, p.240, August 03-06, 2003
• 7: Manuel Montes-y-Gómez , Aurelio López-López , Alexander F. Gelbukh, Information Retrieval with Conceptual Graph Matching, Proceedings of the 11th International Conference on Database and Expert Systems Applications, p.312-321, September 04-08, 2000
• 8: Srihari, R. K., Li, W., Niu, C. and Cornell, T. Infoxtract: A customizable intermediate level information extraction engine. Natural Language Engineering, 12 (4): 1--37, 2006.
• 9: Padmini Srinivasan, Text mining: generating hypotheses from MEDLINE, Journal of the American Society for Information Science and Technology, v.55 n.5, p.396-413, March 2004 [doi>10.1002/asi.10389]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

General Terms:
Algorithms, Design, Experimentation, Security

Keywords:
information retrieval, knowledge discovery, text representation