Video mosaic: laying out time in a physical space

ABSTRACT

Paper video storyboards are still in use by even very experienced video producers with access to the most advanced video editing software. An analysis of the characteristics of paper and on-line editing provide an overlapping but distinct set of benefits (and problems). Paper provides the user with the ability to lay out various temporal sequences over a large spatial area and the ability to quickly sketch, annotate and rearrange the relevant video clips. On-line editing provides users with the ability to generate and store a variety of video arrangements. Video Mosaic provides users with the ability to combine the best of both worlds: elements of a paper video storyboard are used as input to an on-line video editing system to take advantage of the best aspects of each. We developed a Unix and a Macintosh version of Video Mosaic. This paper describes the design of Video Mosaic, compares alternative approaches to creating this type of application, and suggests directions for future work.

REFERENCES

• 1993: Carter, K. Computer-Aided Design: Back to the Drawing Board. In Proceedings of Creativity and Cognition, Loughborough, April.
• 1993: Elliott, E.L. Watch-Grab-Arrange-See: Thinking with motion images via streams and collages. M.S. dissertation, MIT, Cambridge, MA.
• 1992: William Gaver , Thomas Moran , Allan MacLean , Lennart Lövstrand , Paul Dourish , Kathleen Carter , William Buxton, Realizing a video environment: EuroPARC's RAVE system, Proceedings of the SIGCHI conference on Human factors in computing systems, p.27-35, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142754]
• 1993: Mathew E. Hodges , Russell M. Sasnett, Multimedia Computing: Case Studies from Mit Project Athena, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1993
• 1988: Mackay, W. EVA: Experimental Video Annotator. Video presentation at CHI '88 Conference on Human Factors in Computing Systems. (May, Washington, D.C.), ACM, NY.
• 1989: W. E. Mackay, EVA: an experimental video annotator for symbolic analysis of video data, ACM SIGCHI Bulletin, v.21 n.2, p.68-71, Oct. 1989 [doi>10.1145/70609.70617]
• 1989: Wendy E. Mackay , Glorianna Davenport, Virtual video editing in interactive multimedia applications, Communications of the ACM, v.32 n.7, p.802-810, July 1989 [doi>10.1145/65445.65447]
• 1993: Mackay, W., Faber, L., Launianen, P. and Pagani, D. Design of the High Road Demonstrator,D4.4, 30 September 1993, EuroCODE ESPRIT project 6155.
• 1993: Wendy Mackay , Gilles Velay , Kathy Carter , Chaoying Ma , Daniele Pagani, Augmenting reality: adding computational dimensions to paper, Communications of the ACM, v.36 n.7, p.96-97, July 1993 [doi>10.1145/159544.159638]
• 1993: James Matthews , Peter Gloor , Fillia Makedon, VideoScheme: a programmable video editing systems for automation and media recognition, Proceedings of the first ACM international conference on Multimedia, p.419-426, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.168442]
• 1992: William Newman , Pierre Wellner, A desk supporting computer-based interaction with paper documents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.587-592, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.143007]
• 1991: Howard Rheingold, Virtual reality, Simon & Schuster, Inc., New York, NY, 1991
• 1989: R. H. Trigg, Computer support for transcribing recorded activity, ACM SIGCHI Bulletin, v.21 n.2, p.72-74, Oct. 1989 [doi>10.1145/70609.70618]
• 1994: Karon Weher , Alex Poon, Marquee: a tool for real-time video logging, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.58-64, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191697]
• 1992: Pierre Wellner, The DigitalDesk calculator: tangible manipulation on a desk top display, Proceedings of the 4th annual ACM symposium on User interface software and technology, p.27-33, November 11-13, 1991, Hilton Head, South Carolina, United States [doi>10.1145/120782.120785]
• 1993: Pierre Wellner, Interacting with paper on the DigitalDesk, Communications of the ACM, v.36 n.7, p.87-96, July 1993 [doi>10.1145/159544.159630]
• 1993: Pierre Wellner , Wendy Mackay , Rich Gold, Back to the real world, Communications of the ACM, v.36 n.7, p.24-27, July 1993 [doi>10.1145/159544.159555]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Hypertext/hypermedia

General Terms:
Algorithms, Design, Documentation

Keywords:
augmented reality, paper user interfaces, storyboards, video editing