Adapting associative classification to text categorization

ABSTRACT

Associative classification, which originates from numerical data mining, has been applied to deal with text data recently. Text data is firstly digitalized to database of transactions, and then training and prediction is actually conducted on the derived numerical dataset. This intuitive strategy has demonstrated quite good performance. However, it doesn't take into consideration the inherent characteristics of text data as much as possible, although it has to deal with some specific problems of text data such as lemmatizing and stemming during digitalization. In this paper, we propose a bottom-up strategy to adapt associative classification to text categorization, in which we take into account structure information of text. Experiments on Reuters-21578 dataset show that the proposed strategy can make use of text structure information and achieve better performance.

REFERENCES

• 1: Liu B., Hsu W., and Ma Y. Integrating classification and association rule mining. In Proceedings of the Fourth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'98), New York, NY, August 1998.
• 2: Wenmin Li , Jiawei Han , Jian Pei, CMAR: Accurate and Efficient Classification Based on Multiple Class-Association Rules, Proceedings of the 2001 IEEE International Conference on Data Mining, p.369-376, November 29-December 02, 2001
• 3: Yin X. and Han J. CPAR: Classification based on predictive association rules. In Proceedings of SIAM International Conference on Data Mining (SDM'03), San Francisco, CA, May 2003.
• 4: Wang J. and Karypis G. Harmony: Efficiently mining the best rules for classification. In Proceedings of SIAM international conference on Data Mining Proceedings (SDM'05), 2005.
• 5: Maria-Luiza Antonie , Osmar R. Zaïane, Text Document Categorization by Term Association, Proceedings of the 2002 IEEE International Conference on Data Mining (ICDM'02), p.19, December 09-12, 2002
• 6: Fayyad, U. M. and Irani, K. B. Multi-interval discretization of continuous-valued attributes for classification learning. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-1993), 1993.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Information filtering

Additional Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Text processing

General Terms:
Algorithms

Keywords:
associative classification, text categorization