Comparing presentation summaries: slides vs. reading vs. listening

ABSTRACT

As more audio and video technical presentations go online, it becomes imperative to give users effective summarization and skimming tools so that they can find the presentation they want and browse through it quickly. In a previous study, we reported three automated methods for generating audio-video summaries and a user evaluation of those methods. An open question remained about how well various text/image only techniques will compare to the audio-video summarizations. This study attempts to fill that gap.

This paper reports a user study that compares four possible ways of allowing a user to skim a presentation: 1) PowerPoint slides used by the speaker during the presentation, 2) the text transcript created by professional transcribers from the presentation, 3) the transcript with important points highlighted by the speaker, and 4) a audio-video summary created by the speaker. Results show that although some text-only conditions can match the audio-video summary, users have a marginal preference for audio-video (ANOVA f=3.067, p=0.087). Furthermore, different styles of slide-authoring (e.g., detailed vs. big-points only) can have a big impact on their effectiveness as summaries, raising a dilemma for some speakers in authoring for on-demand previewing versus that for live audiences.

REFERENCES

• 1: Hisashi Aoki , Shigeyoshi Shimotsuji , Osamu Hori, A shot classification method of selecting effective key-frames for video browsing, Proceedings of the fourth ACM international conference on Multimedia, p.1-10, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244135]
• 2: F. Arman , R. Depommier , A. Hsu , M.-Y. Chiu, Content-based browsing of video sequences, Proceedings of the second ACM international conference on Multimedia, p.97-103, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192630]
• 3: Barry Arons, SpeechSkimmer: a system for interactively skimming recorded speech, ACM Transactions on Computer-Human Interaction (TOCHI), v.4 n.1, p.3-38, March 1997 [doi>10.1145/244754.244758]
• 4: Michael G. Christel , Michael A. Smith , C. Roy Taylor , David B. Winkler, Evolving video skims into useful multimedia abstractions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.171-178, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274670]
• 5: Covell, M., Withgott, M., & Slaney, M. Machl: Nonuniform Time-Scale Modification of Speech. Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, Seattle WA, May 12-15 1998.
• 6: Jonathan Foote , John Boreczhy , Andreas Girgensohn , Lynn Wilcox, An intelligent media browser using automatic multimodal analysis, Proceedings of the sixth ACM international conference on Multimedia, p.375-380, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290804]
• 7: Liwei He , Anoop Gupta , Stephen A. White , Jonathan Grudin, Design lessons from deployment of on-demand video, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632886]
• 8: Liwei He , Elizabeth Sanocki , Anoop Gupta , Jonathan Grudin, Auto-summarization of audio-video presentations, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.489-498, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319691]
• 9: Francis C. Li , Anoop Gupta , Elizabeth Sanocki , Li-wei He , Yong Rui, Browsing digital video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.169-176, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332425]
• 10: Rainer Lienhart , Silvia Pfeiffer , Wolfgang Effelsberg, Video abstracting, Communications of the ACM, v.40 n.12, p.54-62, Dec. 1997 [doi>10.1145/265563.265572]
• 11: Andrew Merlino , Daryl Morey , Mark Maybury, Broadcast news navigation using story segmentation, Proceedings of the fifth ACM international conference on Multimedia, p.381-391, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266390]
• 12: Nosa Omoigui , Liwei He , Anoop Gupta , Jonathan Grudin , Elizabeth Sanocki, Time-compression: systems concerns, usage, and benefits, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.136-143, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303017]
• 13: Dulce Ponceleon , Savitha Srinivasan , Arnon Amir , Dragutin Petkovic , Dan Diklic, Key to effective video retrieval: effective cataloging and browsing, Proceedings of the sixth ACM international conference on Multimedia, p.99-107, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290760]
• 14: Stanford Online: Masters in Electrical Engineering, 1998. http ://scpd. stanford.edu/cee/telecom/onlinedegree.html
• 15: Michael A. Smith, Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.775, June 17-19, 1997
• 16: Lisa Joy Stifelman , Christopher M. Schmandt, The audio notebook: paper and pen interaction with structured speech, 1997
• 17: Lisa J. Stifelman , Barry Arons , Chris Schmandt , Eric A. Hulteen, VoiceNotes: a speech interface for a hand-held voice notetaker, Proceedings of the SIGCHI conference on Human factors in computing systems, p.179-186, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169150]
• 18: Tonomura, Y. & Abe, S., Content Oriented Visual Interface Using Video Icons for Visual Database Systems. In Journal of Visual Languages and Computing, vol. 1, 1990. pp 183- 198.
• 19: H. J. Zhang , C. Y. Low , S. W. Smoliar , J. H. Wu, Video parsing, retrieval and browsing: an integrated and content-based solution, Proceedings of the third ACM international conference on Multimedia, p.15-24, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215068]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design, Human Factors, Management, Measurement, Performance, Theory

Keywords:
digital video library, multimedia, video abstraction, video browsing, video skim, video summarization