Automatic scientific text classification using local patterns: KDD CUP 2002 (task 1)

ABSTRACT

In this paper, we describe our approach for addressing Task 1 in the KDD CUP 2002 competition. The approach is based on developing and using an improved automatic feature selection method in conjunction with traditional classifiers. The feature selection method used is based on capturing frequently occurring keyword combinations (or motifs) within short segments of the text of a document and has proved to produce more accurate classification results than approaches relying solely on using keyword-based features.

REFERENCES

• 1: SVM light, http://svmlight.joachims.org/
• 2: Foundations of statistical natural language preprocessing. Christopher D. manning and Hinrich Schutze, 2000, The MIT Press.
• 3: Kensington Discovery Edition, http://www.inforsense.com

INDEX TERMS

Keywords:
SVM, document categorization, feature selection