Videolyzer: quality analysis of online informational video for bloggers and journalists

ABSTRACT

Tools to aid people in making sense of the information quality of online informational video are essential for media consumers seeking to be well informed. Our application, Videolyzer, addresses the information quality problem in video by allowing politically motivated bloggers or journalists to analyze, collect, and share criticisms of the information quality of online political videos. Our interface innovates by providing a fine-grained and tightly coupled interaction paradigm between the timeline, the time-synced transcript, and annotations. We also incorporate automatic textual and video content analysis to suggest areas of interest for further assessment by a person. We present an evaluation of Videolyzer looking at the user experience, usefulness, and behavior around the novel features of the UI as well as report on the collaborative dynamic of the discourse generated with the tool.

REFERENCES

• 1: Compendium. http://compendium.open.ac.uk/
• 2: Open Calais. http://www.opencalais.com
• 3: Gregory D. Abowd , Matthias Gauger , Andreas Lachenmann, The Family Video Archive: an annotation and browsing environment for home movies, Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval, November 07-07, 2003, Berkeley, California [doi>10.1145/973264.973266]
• 4: Eric Brill, A simple rule-based part of speech tagger, Proceedings of the workshop on Speech and Natural Language, February 23-26, 1992, Harriman, New York [doi>10.3115/1075527.1075553]
• 5: Timothy Chklovski , Varun Ratnakar , Yolanda Gil, User interfaces with semi-formal representations: a study of designing argumentation structures, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040864]
• 6: Andy Cockburn , Tony Dale, CEVA: a tool for collaborative video analysis, Proceedings of the international ACM SIGGROUP conference on Supporting group work: the integration challenge, p.47-55, November 16-19, 1997, Phoenix, Arizona, United States [doi>10.1145/266838.266857]
• 7: Nicholas Diakopoulos , Irfan Essa, An annotation model for making sense of information quality in online video, Proceedings of the 3rd International Conference on the Pragmatic Web: Innovating the Interactive Society, p.31-34, November 28-30, 2008, Uppsala, Sweden [doi>10.1145/1479190.1479195]
• 8: Nicholas Diakopoulos , Kurt Luther , Irfan Essa, Audio Puzzler: piecing together time-stamped speech transcripts with a puzzle game, Proceeding of the 16th ACM international conference on Multimedia, October 26-31, 2008, Vancouver, British Columbia, Canada [doi>10.1145/1459359.1459507]
• 9: Dieberger, A., Dourish, P., Höök, K., Resnick, P. and Wexelblat, A. Social Navigation: Techniques for Building More Usable Systems interactions, 2000.
• 10: Franklin, B., Hamer, M., Hanna, M., Kinsey, M. and Richardson, J.E. Key Concepts in Journalism Studies. Sage Publications, 2005.
• 11: Yolanda Gil , Varun Ratnakar, Trusting Information Sources One Citizen at a Time, Proceedings of the First International Semantic Web Conference on The Semantic Web, p.162-176, June 09-12, 2002
• 12: Jeffrey Heer , Fernanda B. Viégas , Martin Wattenberg, Voyagers and voyeurs: supporting asynchronous collaborative information visualization, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240781]
• 13: Jackson, B. and Jamieson, K.H. unSpun: finding facts in a world of disinformation. Random House Trade Paperbacks, 2007.
• 14: Keelan, J., Pavri-Garcia, V., Tomlinson, G. and Wilson, K. YouTube as a source of Information on Immunization: A Content Analysis. Journal of the American Medical Association, 298 (21). 2482--2284.
• 15: Paul A. Kirschner , Simon J. Buckingham Shum , Chad S. Carr, Visualizing argumentation: software tools for collaborative and educational sense-making, Springer-Verlag, London, 2003
• 16: Kovach, B. and Rosenstiel, T. The Elements of Journalism: What Newspeople Should Know and the Public Should Expect. Three Rivers Press, 2007.
• 17: Leech, G. Meaning and The English Verb. Pearson Education Limited, 2004.
• 18: Francis C. Li , Anoop Gupta , Elizabeth Sanocki , Li-wei He , Yong Rui, Browsing digital video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.169-176, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332425]
• 19: W. E. Mackay, EVA: an experimental video annotator for symbolic analysis of video data, ACM SIGCHI Bulletin, v.21 n.2, p.68-71, Oct. 1989 [doi>10.1145/70609.70617]
• 20: Nicholas J. Pioch , John O. Everett, POLESTAR: collaborative knowledge management and sensemaking tools for intelligence analysts, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA [doi>10.1145/1183614.1183688]
• 21: Bertrand Sereno , Simon Buckingham Shum , Enrico Motta, ClaimSpotter: an environment to support sensemaking with knowledge triples, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040875]
• 22: Frank M. Shipman, III , Catherine C. Marshall, Formality Considered Harmful: Experiences, EmergingThemes, and Directions on the Use of Formal Representations inInteractive Systems, Computer Supported Cooperative Work, v.8 n.4, p.333-352, Oct. 1999 [doi>10.1023/A:1008716330212]
• 23: Simon Buckingham Shum, R.S., Michael Daw, Ben Juby, Andrew Rowley, Michelle Bachler, Clara Mancini, Danius Michaelides, Rob Procter, David De Roure, Tim Chown, Terry Hewitt. Memetic: An Infrastructure for Meeting Memory, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

General Terms:
Human Factors

Keywords:
computational journalism, information quality, video analysis