A multi-view intelligent editor for digital video libraries

ABSTRACT

Silver is an authoring tool that aims to allow novice users to edit di gital video. The goal is to make editing of digital video as easy as text editing. Silver provides multiple coordinated views, including project, source, outline, subject, storyboard, textual transcript and timeline views. Selections and edits in any view are synchronized with all other views. A variety of recognition algorithms are applied to the video and audio content and then are used to aid in the editing tasks. The Informedia Digital Library supplies the recognition algorithms and metadata used to support intelligent editing, and Informedia also provides search and a repository. The metadata includes shot boundaries and a time-synchronized transcript, which are used to support intelligent selection and intelligent cut/copy/paste.

REFERENCES

• 1: Apple Computer, iMac. 2000. http://www.apple.com/imac/.
• 2: John Boreczky , Andreas Girgensohn , Gene Golovchinsky , Shingo Uchihashi, An interactive comic book presentation for exploring video, Proceedings of the SIGCHI conference on Human factors in computing systems, p.185-192, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332428]
• 3: Cantine, J., Howard, S., and Lewis, B. Shot by Shot: A Practical Guide to Filmmaking, Second Edition. 1995, Pittsburgh Filmmakers.
• 4: Carroll, J.M. and Bever, T.G. "Segmentation in Cinema Perception." Science, 1976. 191: pp. 1053-1055.
• 5: Tzi-cker Chiueh , Tulika Mitra , Anindya Neogi , Chuan-Kai Yang, Zodiac: a history-based interactive video authoring system, Proceedings of the sixth ACM international conference on Multimedia, p.435-444, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.291138]
• 6: Christel, M., et al. "Techniques for the Creation and Exploration of Digital Video Libraries," Multimedia Tools and Applications, B. Furht, Editor 1996, Kluwer Academic Publishers. Boston, MA.
• 7: Michael G. Christel , David B. Winkler , C. Roy Taylor, Multimedia abstractions for a digital video library, Proceedings of the second ACM international conference on Digital libraries, p.21-29, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263776]
• 8: Tat-Seng Chua , Li-Qun Ruan, A video retrieval and sequencing system, ACM Transactions on Information Systems (TOIS), v.13 n.4, p.373-407, Oct. 1995 [doi>10.1145/211430.211431]
• 9: Dancyger, K. The Technique of Film and Video Editing: Theory and Practice. Second ed. 1997, Boston, MA: Focal Press.
• 10: Glorianna Davenport , Thomas Aguirre Smith , Natalio Pincever, Cinematic Primitives for Multimedia, IEEE Computer Graphics and Applications, v.11 n.4, p.67-74, July 1991 [doi>10.1109/38.126883]
• 11: Fischhoff, B., et al. What Could You Do? Carnegie Mellon University, 1998. http://www.cmu.edu/telab/telfair_program/Fischhoff.html. Interactive Video DVD.
• 12: Susan Gauch , Wei Li , John Gauch, The VISION digital video library, Information Processing and Management: an International Journal, v.33 n.4, p.413-426, July 1997 [doi>10.1016/S0306-4573(97)00010-1]
• 13: Gavriel, S. "Internalization of Filmic Schematic Operations in Interaction with Learners' Aptitudes." Journal of Educational Psychology, 1974. 66(4): pp. 499-511.
• 14: Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354415]
• 15: A. Hampapur , T. Weymouth , R. Jain, Digital video segmentation, Proceedings of the second ACM international conference on Multimedia, p.357-364, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192699]
• 16: Hauptmann, A. and Smith, M. "Text, Speech, and Vision for Video Segmentation: The Informedia Project," in AAAI Symposium on Computational Models for Integrating Language and Vision. 1995.
• 17: Hauptmann, A.G. and Smith, M. "Video Segmentation in the Informedia Project," in IJCAI-95: Workshop on Intelligent Multimedia Information Retrieval. Montreal, 1995. Montreal, Quebec, Canada.
• 18: Hyowon Lee , Alan F. Smeaton , Catherine Berrut , Noel Murphy , Seán Marlow , Noel E. O'Connor, Implementation and Analysis of Several Keyframe-Based Browsing Interfaces to Digital Video, Proceedings of the 4th European Conference on Research and Advanced Technology for Digital Libraries, p.206-218, September 18-20, 2000
• 19: Wendy E. Mackay , Glorianna Davenport, Virtual video editing in interactive multimedia applications, Communications of the ACM, v.32 n.7, p.802-810, July 1989 [doi>10.1145/65445.65447]
• 20: W. Mackay , D. Pagani, Video mosaic: laying out time in a physical space, Proceedings of the second ACM international conference on Multimedia, p.165-172, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192646]
• 21: Mascelli, J. The Five C's of Cinematography: Motion Picture Filming Techiques. 1965, Los Angeles, CA: Silman-James Press.
• 22: James Matthews , Peter Gloor , Fillia Makedon, VideoScheme: a programmable video editing systems for automation and media recognition, Proceedings of the first ACM international conference on Multimedia, p.419-426, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.168442]
• 23: Jianhao Meng , Shih-Fu Chang, CVEPS - a compressed video editing and parsing system, Proceedings of the fourth ACM international conference on Multimedia, p.43-53, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244145]
• 24: Michael Mills , Jonathan Cohen , Yin Yin Wong, A magnifier tool for video data, Proceedings of the SIGCHI conference on Human factors in computing systems, p.93-98, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142764]
• 25: Brad A. Myers, Demonstrational Interfaces: A Step Beyond Direct Manipulation, Computer, v.25 n.8, p.61-73, August 1992 [doi>10.1109/2.153286]
• 26: Myers, B.A. Natural Programming: Project Overview and Proposal. Technical Report, Carnegie Mellon University School of Computer Science, CMU-CS-98-101 and CMU- HCII-98-100, January, 1998. Pittsburgh.
• 27: Placeway, P., et al. "The 1996 Hub-4 Sphinx-3 System," in DARPA Spoken Systems Technology Workshop. 1997.
• 28: Toshio Sato , Takeo Kanade , Ellen K. Hughes , Michael A. Smith , Shin'ichi Satoh, Video OCR: indexing digital new libraries by recognition of superimposed captions, Multimedia Systems, v.7 n.5, p.385-395, September 1999 [doi>10.1007/s005300050140]
• 29: Scott Stevens , Michael Christen , Howard Wactlar, Informedia: improving access to digital video, interactions, v.1 n.4, p.67-71, Oct. 1994 [doi>10.1145/194283.194311]
• 30: Tannenbaum, P.H. and Fosdick, J.A. "The Effect of Lighting Angle on the Judgment of Photographed Subjects." AV Communication Review, 1960. pp. 253-262.
• 31: Yoshinobu Tonomura , Akihito Akutsu , Kiyotaka Otsuji , Toru Sadakata, VideoMAP and VideoSpaceIcon: tools for anatomizing video content, Proceedings of the SIGCHI conference on Human factors in computing systems, p.131-136, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169117]
• 32: Hirotada Ueda , Takafumi Miyatake, Automatic scene separation and tree structure GUI for video editing, Proceedings of the fourth ACM international conference on Multimedia, p.405-406, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244435]
• 33: Hirotada Ueda , Takafumi Miyatake , Satoshi Yoshizawa, IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.343-350, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108939]
• 34: Howard D. Wactlar , Michael G. Christel , Yihong Gong , Alexander G. Hauptmann, Lessons Learned from Building a Terabyte Digital Video Library, Computer, v.32 n.2, p.66-73, February 1999 [doi>10.1109/2.745722]
• 35: H. J. Zhang , C. Y. Low , S. W. Smoliar , J. H. Wu, Video parsing, retrieval and browsing: an integrated and content-based solution, Proceedings of the third ACM international conference on Multimedia, p.15-24, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215068]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

General Terms:
Design, Documentation, Human Factors, Management, Performance, Theory

Keywords:
digital video editing, informedia, multimedia authoring, silver, video library