Authoring, viewing, and generating hypervideo: An overview of Hyper-Hitchcock

ABSTRACT

Hyper-Hitchcock consists of three components for creating and viewing a form of interactive video called detail-on-demand video: a hypervideo editor, a hypervideo player, and algorithms for automatically generating hypervideo summaries. Detail-on-demand video is a form of hypervideo that supports one hyperlink at a time for navigating between video sequences. The Hyper-Hitchcock editor enables authoring of detail-on-demand video without programming and uses video processing to aid in the authoring process. The Hyper-Hitchcock player uses labels and keyframes to support navigation through and back hyperlinks. Hyper-Hitchcock includes techniques for automatically generating hypervideo summaries of one or more videos that take the form of multiple linear summaries of different lengths with links from the shorter to the longer summaries. User studies on authoring and viewing provided insight into the various roles of links in hypervideo and found that player interface design greatly affects people's understanding of hypervideo structure and the video they access.

REFERENCES

• 1: Guillaume Boissière, Automatic creation of hypervideo news libraries for the World Wide Web, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.279-280, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276658]
• 2: Chang, H. B., Hsu, H. H. Liao, Y. C., Shih, T. K., and Tang, C. T. 2004. An object-based hypervideo authoring system. In Proceedings of IEEE International Conference on Multimedia and Expo, IEEE, 2219--2222.
• 3: Michael G. Christel , Michael A. Smith , C. Roy Taylor , David B. Winkler, Evolving video skims into useful multimedia abstractions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.171-178, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274670]
• 4: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 5: Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354415]
• 6: Girgensohn, A., Bly, S., Shipman, F., Boreczky, J., and Wilcox, L. 2001. Home video editing made easy—balancing automation and user control. In Proceedings of the International Conference on Human-Computer Interaction (INTERACT '01), IOS Press, 464--471.
• 7: Andreas Girgensohn , Lynn Wilcox , Frank Shipman , Sara Bly, Designing affordances for the navigation of detail-on-demand hypervideo, Proceedings of the working conference on Advanced visual interfaces, May 25-28, 2004, Gallipoli, Italy [doi>10.1145/989863.989913]
• 8: Romulus Grigoras , Vincent Charvillat , Matthijs Douze, Optimizing hypervideo navigation using a Markov decision process approach, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641014]
• 9: Guimares, N., Chambel, T., and Bidarra, J. 2000. From cognitive maps to hypervideo: Supporting flexible and rich learner-centred environments. Interact. Multimed. J. Comput.-Enhanced Learning 2, 2.
• 10: Kyoji Hirata , Yoshinori Hara , Hajime Takano , Shigehito Kawasaki, Content-oriented integration in hypermedia systems, Proceedings of the the seventh ACM conference on Hypertext, p.11-21, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234830]
• 11: Francis C. Li , Anoop Gupta , Elizabeth Sanocki , Li-wei He , Yong Rui, Browsing digital video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.169-176, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332425]
• 12: Andrew Lippman, Movie-maps: An application of the optical videodisc to computer graphics, ACM SIGGRAPH Computer Graphics, v.14 n.3, p.32-42, July 1980
• 13: Brad A. Myers , Juan P. Casares , Scott Stevens , Laura Dabbish , Dan Yocum , Albert Corbett, A multi-view intelligent editor for digital video libraries, Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries, p.106-115, January 2001, Roanoke, Virginia, United States [doi>10.1145/379437.379461]
• 14: Yong Rui , Thomas S. Huang , Sharad Mehrotra, Exploring Video Structure Beyond The Shots, Proceedings of the IEEE International Conference on Multimedia Computing and Systems, p.237, June 28-July 01, 1998 [doi>10.1109/MMCS.1998.693648]
• 15: Rui, Y., Xiong, Z., Radhaskrishnan, R., Divakaran, A., and Huang, T. S. 2004. A unified framework for video summarization, browsing, and retrieval, Mitsubishi Electric Research Laboratories Tech. Rep.
• 16: Nitin Sawhney , David Balcom , Ian Smith, Authoring and Navigating Video in Space and Time, IEEE MultiMedia, v.4 n.4, p.30-39, October 1997 [doi>10.1109/93.641877]
• 17: Shipman, F., Girgensohn, A., and Wilcox, L. 2003a. Hyper-Hitchcock: Towards the easy authoring of interactive video. In Proceedings of the International Conference on Human-Computer Interaction (INTERACT '03), IOS Press, 33--40.
• 18: Frank Shipman , Andreas Girgensohn , Lynn Wilcox, Generation of interactive multi-level video summaries, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957096]
• 19: Frank Shipman , Andreas Girgensohn , Lynn Wilcox, Hypervideo expression: experiences with hyper-hitchcock, Proceedings of the sixteenth ACM conference on Hypertext and hypermedia, September 06-09, 2005, Salzburg, Austria [doi>10.1145/1083356.1083401]
• 20: Jason McC. Smith , David Stotts , Sang-Uok Kum, An orthogonal taxonomy for hyperlink anchor generation in video streams using OvalTine, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.11-18, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336306]
• 21: Tolva, J. 1998. MediaLoom: An Interactive Authoring Tool for Hypervideo, http://www.mindspring.com/~jntolva/medialoom/(last accessed Dec. 2, 2006).
• 22: Shingo Uchihashi , Jonathan Foote , Andreas Girgensohn , John Boreczky, Video Manga: generating semantically meaningful video summaries, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.383-392, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319654]
• 23: Barbara M. Wildemuth , Gary Marchionini , Meng Yang , Gary Geisler , Todd Wilkens , Anthony Hughes , Richard Gruss, How fast is too fast?: evaluating fast forward surrogates for digital video, Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries, May 27-31, 2003, Houston, Texas
• 24: HongJiang Zhang , Shuang Yeo Tan , Stephen W. Smoliar , Gong Yihong, Automatic parsing and indexing of news video, Multimedia Systems, v.2 n.6, p.256-266, Jan. 1995 [doi>10.1007/BF01225243]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation; User issues

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
Hypervideo, link generation, video editing, video summarization