Interactive multimedia summaries of evaluative text

ABSTRACT

We present an interactive multimedia interface for automatically summarizing large corpora of evaluative text (e.g. online product reviews). We rely on existing techniques for extracting knowledge from the corpora but present a novel approach for conveying that knowledge to the user. Our system presents the extracted knowledge in a hierarchical visualization mode as well as in a natural language summary. We propose a method for reasoning about the extracted knowledge so that the natural language summary can include only the most important information from the corpus. Our approach is interactive in that it allows the user to explore in the original dataset through intuitive visual and textual methods. Results of a formative evaluation of our interface show general satisfaction among users with our approach.

REFERENCES

• 1: Rie Kubota Ando , Branimir K. Boguraev , Roy J. Byrd , Mary S. Neff, Multi-document summarization by visualizing topical content, NAACL-ANLP 2000 Workshop on Automatic summarization, p.79-98, April 30-30, 2000, Seattle, Washington [doi>10.3115/1117575.1117584]
• 2: D. Brodbeck and L. Girardin. Visualization of large-scale customer satisfacyion surveys using a parallel coordinate tree. In Proc. of the IEEE Symposium on Information Visualization, 2003.
• 3: Giuseppe Carenini , Johanna D. Moore, A strategy for generating evaluative arguments, Proceedings of the first international conference on Natural language generation, June 12-16, 2000, Mitzpe Ramon, Israel [doi>10.3115/1118253.1118261]
• 4: G. Carenini and J. D. Moore. An empirical study of the influence of user tailoring on evaluative argument effectiveness. In Proceedings of the 17th International Joint Conference on Artificial Intelligence, Seattle, USA, 2001.
• 5: Giuseppe Carenini , Raymond T. Ng , Ed Zwart, Extracting knowledge from evaluative text, Proceedings of the 3rd international conference on Knowledge capture, October 02-05, 2005, Banff, Alberta, Canada [doi>10.1145/1088622.1088626]
• 6: Nancy L. Green , Giuseppe Carenini , Stephan Kerpedjiev , Joe Mattis , Johanna D. Moore , Steven F. Roth, Autobrief: an experimental system for the automatic generation of briefings in integrated text and information graphics, International Journal of Human-Computer Studies, v.61 n.1, p.32-70, July 2004 [doi>10.1016/j.ijhcs.2003.10.007]
• 7: H. Guo and A. J. Stent. Trainable adaptable multimedia presentation generation. In Proceedings of the International conferences on Multimodal Interfaces, Trento, Italy, 2005.
• 8: M. Hu and B. Liu. Feature based summary of customer reviews dataset. http://www.cs.uic.edu/~liub/FBS/FBS.html, 2004.
• 9: Minqing Hu , Bing Liu, Mining and summarizing customer reviews, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014073]
• 10: M. Hu and B. Liu. Mining opinion features in customer reviews. In Proc. AAAI, 2004.
• 11: Michael Johnston , Srinivas Bangalore , Gunaranjan Vasireddy , Amanda Stent , Patrick Ehlen , Marilyn Walker , Steve Whittaker , Preetam Maloor, MATCH: an architecture for multimodal dialogue systems, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, July 07-12, 2002, Philadelphia, Pennsylvania [doi>10.3115/1073083.1073146]
• 12: D. Kusui, K. Tateishi, and T. Fukoshima. Information extraction and visualization from internet documents. NEC Journal of Advanced technology, 2(2):157--163, 2005.
• 13: Massimo Fasciano , Guy Lapalme, Intentions in the coordinated generation of graphics and text from tabular data, Knowledge and Information Systems, v.2 n.3, p.310-339, August 2000 [doi>10.1007/PL00011645]
• 14: Mark T. Maybury , Inderjeet Mani, Advances in Automatic Text Summarization, MIT Press, Cambridge, MA, 1999
• 15: Satoshi Morinaga , Kenji Yamanishi , Kenji Tateishi , Toshikazu Fukushima, Mining product reputations on the Web, Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, July 23-26, 2002, Edmonton, Alberta, Canada [doi>10.1145/775047.775098]
• 16: Guidelines of the 2004 document understanding conference. http://www-nlpir.nist.gov/projects/duc/guidelines/2004.html, 2004.
• 17: Online proceedings of the 2004 document understanding conference. http://duc.nist.gov/pubs.html\#2004, 2004.
• 18: Catherine Plaisant, The challenge of information visualization evaluation, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989880]
• 19: C. Plaisant, B. Shneiderman, G. Chintalapani, and A. Aris. Treemap home page. http://www.cs.umd.edu/hcil/treemap/.
• 20: Ehud Reiter , Robert Dale, Building natural language generation systems, Cambridge University Press, New York, NY, 2000
• 21: S. F. Roth , P. Lucas , J. A. Senn , C. C. Gomberg , M. B. Burks , P. J. Stroffolino , A. J. Kolojechick , C. Dunmire, Visage: a user interface environment for exploring information, Proceedings of the 1996 IEEE Symposium on Information Visualization (INFOVIS '96), p.3, October 28-29, 1996
• 22: H. Saggion and R. Gaizauskas. Multi-document summarization by cluster/profile relevance and redundancy removal. In Proceedings of Document Understanding Conference DUC04, 2004.
• 23: B. Schiffman, A. Nenkova, and K. McKeown. Experiments in multidocument summarization. In Proceedings of Human Language Technology HLT02, San Diego, Ca., 2002.
• 24: Ben Shneiderman, Tree visualization with tree-maps: 2-d space-filling approach, ACM Transactions on Graphics (TOG), v.11 n.1, p.92-99, Jan. 1992 [doi>10.1145/102377.115768]
• 25: Edward R. Tufte, Visual explanations: images and quantities, evidence and narrative, Graphics Press, Cheshire, CT, 1997
• 26: J. Yu, E. Reiter, J. Hunter, and C. Mellish. Choosing the content of textual summaries of large time-series data sets. Natural Language Engineering, to appear, 2005.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Natural language

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Experimentation

Keywords:
automatic summarization, natural language generation