Semantic text classification of disease reporting

ABSTRACT

Traditional text classification studied in the IR literature is mainly based on topics. That is, each class or category represents a particular topic, e.g., sports, politics or sciences. However, many real-world text classification problems require more refined classification based on some semantic aspects. For example, in a set of documents about a particular disease, some documents may report the outbreak of the disease, some may describe how to cure the disease, some may discuss how to prevent the disease, and yet some others may include all the above information. To classify text at this semantic level, the traditional "bag of words" model is no longer sufficient. In this paper, we report a text classification study at the semantic level and show that sentence semantic and structure features are very useful for such kind of classification. Our experimental results based on a disease outbreak dataset demonstrated the effectiveness of the proposed approach.

REFERENCES

• 1: Joachims, T. Making large-Scale SVM Learning Practical. Advances in Kernel Methods -- Support Vector Learning. Ed. Schölkopf, B., Burges, C. and Smola, A. MIT-Press, 1999.
• 2: Dekang Lin , Patrick Pantel, Discovery of inference rules for question-answering, Natural Language Engineering, v.7 n.4, p.343-360, December 2001 [doi>10.1017/S1351324901002765]
• 3: McCallum, A. K. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. http://www.cs.cmu.edu/~mccallum/bow, 1996.
• 4: ProMED-mail. http://www.promedmail.org, 2007.
• 5: Yusuke Shinyama , Satoshi Sekine, Paraphrase acquisition for information extraction, Proceedings of the second international workshop on Paraphrasing, p.65-71, July 11-11, 2003, Sapporo, Japan [doi>10.3115/1118984.1118993]
• 6: Yiming Yang , Xin Liu, A re-examination of text categorization methods, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.42-49, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312647]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

General Terms:
Algorithms, Experimentation

Keywords:
semantics, text classfication