Text summarization with harmony search algorithm-based sentence extraction

ABSTRACT

Currently vast amounts of textual information exist in large repositories such as Web. To processes such a huge amount of information, automatic text summarization has been of great interests. Unlike many approaches which focus on sentence or paragraph extraction, in this research, we introduce a method to make extractions based on three factors of Readability, Cohesion and Topic relation. We use Harmony Search-based sentence selection to make such a summary. Once the summary is created, it is evaluated using a fitness function based on those three factors. The evaluation of the algorithm on a test collection is also presented in the paper. Our results indicate that the extracted summaries by our proposed scheme have better precision and recall than the other approaches.

REFERENCES

• 1: Ricardo A. Baeza-Yates , Berthier Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 2: Ronald Brandow , Karl Mitze , Lisa F. Rau, Automatic condensation of electronic publications by sentence selection, Information Processing and Management: an International Journal, v.31 n.5, p.675-685, Sept. 1995 [doi>10.1016/0306-4573(95)00052-I]
• 3: Document Understanding Conference (DUC 2002) http://www-nlpir.nist.gov
• 4: H. P. Edmundson, New Methods in Automatic Extracting, Journal of the ACM (JACM), v.16 n.2, p.264-285, April 1969 [doi>10.1145/321510.321519]
• 5: Eduard Hovy , Chin-Yew Lin, Automated text summarization and the SUMMARIST system, Proceedings of a workshop on held at Baltimore, Maryland: October 13-15, 1998, October 13-15, 1998, Baltimore, Maryland [doi>10.3115/1119089.1119121]
• 6: Julian Kupiec , Jan Pedersen , Francine Chen, A trainable document summarizer, Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval, p.68-73, July 09-13, 1995, Seattle, Washington, United States [doi>10.1145/215206.215333]
• 7: Lee K. S. and Geem Z. W. 2004. A new structural optimization method based on harmony search algorithm. Computers & Structures. 82(2004):781--798.
• 8: Lee K. S. and Geem Z. W. 2005. A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice. Computer Methods in Applied mechanics and engineering. 194(2005):3902--3933.
• 9: Luhn, H. The automatic creation of literature abstracts. IBM Journal of Research and Development, 2(2), 1958.
• 10: Christopher D. Manning , Prabhakar Raghavan , Hinrich Schtze, Introduction to Information Retrieval, Cambridge University Press, New York, NY, 2008
• 11: Mitra, M., Singhal, A., and Buckly, C. Automatic text summarization by paragraph extraction. In proceeding of the ACL'97/EACL'97 Workshop on Intelligent Scalable Text Summarization, 1997, 39--46.
• 12: Qazvinian, V., Sharif, L. and Halavati R. Summarization Text with a Genetic Algorithm-Based Sentence Extraction. International Journal of Knowledge Management Studies (IJKMS), Volume 4, Number 2: 2008, 426--444.
• 13: Gerard Salton , Christopher Buckley, Term-weighting approaches in automatic text retrieval, Information Processing and Management: an International Journal, v.24 n.5, p.513-523, 1988 [doi>10.1016/0306-4573(88)90021-0]
• 14: Silla, J., Nascimento, C., Pappa, G. L., Freitas, A. A., and Kaestner, C. A. A. Automatic text summarization, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

General Terms:
Algorithms, Human Factors, Performance

Keywords:
automatic text summarization, evolutionary algorithm, harmony search algorithm, sentence extraction