A learning based model for headline extraction of news articles to find explanatory sentences for events

ABSTRACT

Metadata information plays a crucial role in augmenting document organising efficiency and archivability. News metadata includes DateLine, ByLine, HeadLine and many others. We found that HeadLine information is useful for guessing the theme of the news article. Particularly for financial news articles, we found that HeadLine can thus be specially helpful to locate explanatory sentences for any major events such as significant changes in stock prices. In this paper we explore a support vector based learning approach to automatically extract the HeadLine metadata. We find that the classification accuracy of finding the HeadLines improves if DateLines are identified first. We then used the extracted HeadLines to initiate a pattern matching of keywords to find the sentences responsible for story theme. Using this theme and a simple language model it is possible to locate any explanatory sentences for any significant price change.

REFERENCES

• 1: Eric Brill, A simple rule-based part of speech tagger, Proceedings of the third conference on Applied natural language processing, March 31-April 03, 1992, Trento, Italy [doi>10.3115/974499.974526]
• 2: S. Debnath, P. Mitra, and C. L. Giles. Finding base time-line of a news article. In proceedings of FLAIRS, pages 142--147, 2005.
• 3: Robert Krovetz, Viewing morphology as an inference process, Artificial Intelligence, v.118 n.1-2, p.277-294, April 2000 [doi>10.1016/S0004-3702(99)00101-0]
• 4: D. M. Pennock, S. Debnath, E. J. Glover, and C. L. Giles. Modelling information incorporation in markets, with application to detecting and explaining events. In proceedings of UAI, pages 405--413, 2002.
• 5: Jay M. Ponte , W. Bruce Croft, A language modeling approach to information retrieval, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.275-281, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.291008]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Additional Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.4 Electronic Publishing
      I.7.m Miscellaneous

General Terms:
Algorithms, Experimentation

Keywords:
explanatory sentence, metadata extraction, news metadata