Automatic generation of biased video sequences

ABSTRACT

We describe our experimental rhetoric engine <i>Vox Populi</i> that generates biased video-sequences from a repository of video interviews and other related audio-visual web sources. Users are thus able to explore their own opinions on controversial topics covered by the repository. The repository contains interviews with United States residents stating their opinion on the events occurring after the terrorist attack on the United States on the 11th of September 2001. We present a model for biased documentary statements, such as interviews, and explain in detail how this model facilitates the automatic generation of rhetorical arguments on a micro-level. We outline the required representations of relevant rhetorical structures and the way they can be processed. The processes are described via examples generated by our experimental engine. The first example shows how to logically counter an opinion using semantics contained in the audio tracks from the database, while the second example describes the generation of an emotional counterargument using visual material.

REFERENCES

• 1: Aidministrator Nederland B.V. SeRQL user manual, April 4, 2003.
• 2: D. Bordwell and K. Thompson. Film Art: An Introduction. McGraw-Hill, 7 edition, 2003.
• 3: Jeen Broekstra , Arjohn Kampman , Frank van Harmelen, Sesame: A Generic Architecture for Storing and Querying RDF and RDF Schema, Proceedings of the First International Semantic Web Conference on The Semantic Web, p.54-68, June 09-12, 2002
• 4: G. Burton. Silva Rhetoricae. http://humanities.byu.edu/rhetoric/.
• 5: J. Clark. XSL Transformations (XSLT) Version 1.0. W3C Recommendation, 16 November 1999.
• 6: A. R. Cline. The Rhetorica Network. http://www.rhetorica.net/.
• 7: Michel Crampes , Jean Paul Veuillez , Sylvie Ranwez, Adaptive narrative abstraction, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.97-105, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276638]
• 8: Glorianna Davenport , Michael Murtaugh, ConText towards the evolving documentary, Proceedings of the third ACM international conference on Multimedia, p.381-389, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215302]
• 9: Marc Davis, Media Streams: an iconic visual language for video representation, Human-computer interaction: toward the year 2000, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1995
• 10: W. Grosso, H. Eriksson, R. Fergerson, J. Gennari, S. Tu, and M. Musen. Knowledge Modeling at the Millennium The Design and Evolution of P rotege-2000). Technical Report SMI Report Number: SMI-1999-0801, Stanford Medical Informatics (SMI), 1999.
• 11: G. Houbart. Viewpoints on Demand: Tailoring the Presentation of Opinions in Video. PhD thesis, Massachusetts Institute of Technology, 1994.
• 12: Research & Education Association, C++, Research & Education Association, 2000
• 13: W. C. Mann, C. M. I. M. Matthiesen, and S. A. Thompson. Rhetorical Structure Theory and Text Analysis. Technical Report ISI/RR-89-242, Information Sciences Institute, University of Southern California, November 1989.
• 14: Michael Mateas , Paul Vanouse , Steffi Domike, Generation of Ideologically-Biased Historical Documentaries, Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, p.236-242, July 30-August 03, 2000
• 15: G. A. Miller, R. Beckwith, C. Fellbaum, D. Gross, and K. Miller. Introduction to Word Net: An On-line Lexical Database. Journal of Lexicography, 3(4):234--244, 1990.
• 16: F. Nack. AUTEUR: The Application of Video Semantics and Theme Representation in Automated Video Editing. PhD thesis, Lancaster University, 1996.
• 17: Frank Nack , Wolfgang Putz, Designing annotation before it's needed, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500180]
• 18: Nitin Sawhney , David Balcom , Ian Smith, HyperCafe: narrative and aesthetic properties of hypervideo, Proceedings of the the seventh ACM conference on Hypertext, p.1-10, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234829]
• 19: M. Rabiger. Directing the Documentary. Focal Press, 1998.
• 20: S. B. Shum, E. Motta, and J. Domingue. ScholOnto: an Ontology- Based Digital Library Server for Research Documents and Discourse. International Journal on Digital Libraries, 3(3), August/September 2000.
• 21: W3C. Synchronized Multimedia Integration Language (SMIL 2.0) Specification. W3C Recommendation, August 7, 2001. Edited by Aaron Cohen.
• 22: W3C. RDF Vocabulary Description Language 1.0: RDF Schema. W3C Recommendation, 10 February 2004. Edited by Dan Brickley and R.V. Guha.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation; User issues

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Multi/mixed media; Hypertext/hypermedia

General Terms:
Design, Experimentation, Human Factors

Keywords:
automated video editing, media rhetorics, media semantics, multimedia presentation generation, video documentaries