Programmable transitions for video stream editing

ABSTRACT

Video editing applications provide a facility to transition from one video stream to another, or to filter a video stream in some way. New transitions are usually developed using a custom API for the particular package. In this article we present a shading language for specifying transitions and filters on video streams. Video editing is performed by constructing a tree based on the transitions. The shading language is compiled to a virtual machine, but can still be executed efficiently. We provide several examples of transitions which have been successfully applied using our video stream editing software.

REFERENCES

• 1: Ansari, M. Y., 2003. Video image processing using shaders. ATI ATI Sponsored Session. GDC 2003.
• 2: Jeff Bolz , Ian Farmer , Eitan Grinspun , Peter Schröoder, Sparse matrix solvers on the GPU: conjugate gradients and multigrid, ACM SIGGRAPH 2003 Papers, July 27-31, 2003, San Diego, California
• 3: Ian Buck , Tim Foley , Daniel Horn , Jeremy Sugerman , Kayvon Fatahalian , Mike Houston , Pat Hanrahan, Brook for GPUs: stream computing on graphics hardware, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 4: Juan Casares , A. Chris Long , Brad A. Myers , Rishi Bhatnagar , Scott M. Stevens , Laura Dabbish , Dan Yocum , Albert Corbett, Simplifying video editing using metadata, Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778737]
• 5: Robert L. Cook , Loren Carpenter , Edwin Catmull, The Reyes image rendering architecture, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.95-102, August 1987
• 6: Robert L. Cook, Shade trees, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.223-231, January 1984
• 7: Marc Davis, Editing out Video Editing, IEEE MultiMedia, v.10 n.2, p.54-64, March 2003 [doi>10.1109/MMUL.2003.1195161]
• 8: Andreas Girgensohn , John Boreczky , Patrick Chiu , John Doherty , Jonathan Foote , Gene Golovchinsky , Shingo Uchihashi , Lynn Wilcox, A semi-automatic approach to home video editing, Proceedings of the 13th annual ACM symposium on User interface software and technology, p.81-89, November 06-08, 2000, San Diego, California, United States [doi>10.1145/354401.354415]
• 9: Matthews, J. W., Makedon, F., and Gloor, P. 1994. VideoScheme: A research, authoring, and teaching tool for multimedia. In Educatinal Media and Hypermedia, 385--390.
• 10: Jianhao Meng , Shih-Fu Chang, CVEPS - a compressed video editing and parsing system, Proceedings of the fourth ACM international conference on Multimedia, p.43-53, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244145]
• 11: Marc Olano , Anselmo Lastra, A shading language on graphics hardware: the pixelflow shading system, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.159-168, July 1998 [doi>10.1145/280814.280857]
• 12: Hirotada Ueda , Takafumi Miyatake, Automatic scene separation and tree structure GUI for video editing, Proceedings of the fourth ACM international conference on Multimedia, p.405-406, November 18-22, 1996, Boston, Massachusetts, United States [doi>10.1145/244130.244435]

INDEX TERMS

Primary Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.0 General

Keywords:
stream processing, video editing, video shaders