Combining linguistic and machine learning techniques for email summarization

ABSTRACT

This paper shows that linguistic techniques along with machine learning can extract high quality noun phrases for the purpose of providing the gist or summary of email messages. We describe a set of comparative experiments using several machine learning algorithms for the task of salient noun phrase extraction. Three main conclusions can be drawn from this study: (i) the modifiers of a noun phrase can be semantically as important as the head for the task of gisting, (ii) linguistic filtering improves the performance of machine learning algorithms, (iii) a combination of classifiers improves accuracy.

REFERENCES

• 1: Adam L. Berger , Vibhu O. Mittal, OCELOT: a system for summarizing Web pages, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.144-151, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345565]
• 2: B. Boguraev and C. Kennedy. 1999. Salience-based content characterisation of text documents. In Interjit Mani and T. Maybury, Mark, editors, Advances in Automatic Text Summarization, pages 99--111. The MIT Press.
• 3: W. Cohen. 1995. Fast effective rule induction. In Machine-Learning: Proceedings of the Twelfth International Conference.
• 4: Tin Kam Ho, The Random Subspace Method for Constructing Decision Forests, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.8, p.832-844, August 1998 [doi>10.1109/34.709601]
• 5: J. Justeson and S. Katz. 1995. Technical terminology: Some linguistic properties and an algorithm for identification in text. Natural Language Engineering, (1):9--27.
• 6: J. L. Klavans, M. S. Chodorow, and N. Wacholder. 1990. From dictionary to knowledge base via taxonomy. In Proceedings of the Sixth Conference of the University of Waterloo Centre for the New Oxford English Dictionary and Text Research: Electronic Text Research, University of Waterloo, Canada.
• 7: Julian Kupiec , Jan Pedersen , Francine Chen, A trainable document summarizer, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.68-73, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215333]
• 8: R. J Mooney and C. Cardie. 1999. Symbolic machine learning for natural language processing. In ACL'99 Tutorial.
• 9: S. K. Murthy, S. Kasif, S. Salzberg, and R. Beigel. 1993. OCI: Randomized induction of oblique decision trees. In Proceedings of the Eleventh National Conference on Artificial Intelligence, pages 322--327, Washington, D.C.
• 10: J. Ross Quinlan, C4.5: programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 11: L. A. Ramshaw and M. P. Marcus. 1995. Text chunking using transformation-based learning. In Proceedings of Third ACL Workshop on Very Large Corpora.
• 12: A. Smeaton. 1999. Using NLP or NLP resources for information retrieval tasks. In Tomek Strzalkowski, editor, Natural Language Information Retrieval. Kluwer, Boston, MA.
• 13: K. Sparck Jones. 1999. What is the role for NLP in text retrieval. In Tomek Strzalkowski, editor, Natural Language Information Retrieval, pages 1--12. Kluwer, Boston, MA.
• 14: T. Strzalkowski, F. Lin, J. Wang, and J. Perez-Carballo. 1999. Evaluating natural language processing techniques in information retrieval. In Tomek Strzalkowski, editor, Natural Language Information Retrieval. Kluwer, Boston, MA.
• 15: Peter D. Turney, Learning Algorithms for Keyphrase Extraction, Information Retrieval, v.2 n.4, p.303-336, May 2000 [doi>10.1023/A:1009976227802]
• 16: Evelyne Tzoukermann , Smaranda Muresan , Judith L. Klavans, GIST-IT: summarizing email using linguistic knowledge and machine learning, Proceedings of the workshop on Human Language Technology and Knowledge Management, p.1-8, July 06-07, 2001, Toulouse, France [doi>10.3115/1118220.1118231]
• 17: N. Wacholder. 1998. Simplex NPS sorted by head: A method for identifying significant topics within a document. In Proceedings of the COLING-ACL Workshop on the Computational Treatment of Nominals, Montreal, Canada.
• 18: Ian H. Witten , Gordon W. Paynter , Eibe Frank , Carl Gutwin , Craig G. Nevill-Manning, KEA: practical automatic keyphrase extraction, Proceedings of the fourth ACM conference on Digital libraries, p.254-255, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313437]