Stylized video cubes

ABSTRACT

We present a new set of non-photorealistic rendering (NPR) tools for processing video. Our approach is to treat the video as a space-time volume of image data. Previous tools to process video for an impressionist effect have painted collections of two-dimensional strokes on each successive frame of video. In contrast, we create a set of "rendering solids." Each rendering solid is a function defined over an interval of time; when evaluated at a particular time within that interval, it provides parameters necessary for rendering an NPR primitive. Rendering solids can be rendered interactively, giving immediate feedback to an artist along with the ability to modify styles in real time.Benefits of our approach include: a more unified treatment of the video volume's spatial and temporal dimensions; interactive, aesthetic flexibility and control; and the extension of stylized rendering techniques for video beyond the impressionist styles previously explored. We show example styles inspired by impressionist, cubist, and abstract art of the past century.

REFERENCES

• 1: R. C. Bolles, H. H. Baker, and D. H. Marimont. Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision, 1(1):7-55, 1987.
• 2: Franklin C. Crow, Summed-area tables for texture mapping, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.207-212, January 1984
• 3: Cassidy J. Curtis , Sean E. Anderson , Joshua E. Seims , Kurt W. Fleischer , David H. Salesin, Computer-generated watercolor, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.421-430, August 1997 [doi>10.1145/258734.258896]
• 4: Olivier Faugeras, Three-dimensional computer vision: a geometric viewpoint, MIT Press, Cambridge, MA, 1993
• 5: Sidney Fels , Eric Lee , Kenji Mase, Techniques for interactive video cubism (poster session), Proceedings of the eighth ACM international conference on Multimedia, p.368-370, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354535]
• 6: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 7: Leonidas Guibas , Jorge Stolfi, Primitives for the manipulation of general subdivisions and the computation of Voronoi, ACM Transactions on Graphics (TOG), v.4 n.2, p.74-123, April 1985 [doi>10.1145/282918.282923]
• 8: Paul Haeberli, Paint by numbers: abstract image representations, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.207-214, Aug. 1990
• 9: Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 [doi>10.1145/280814.280951]
• 10: Aaron Hertzmann , Ken Perlin, Painterly rendering for video and interaction, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.7-12, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340917]
• 11: Kenneth E. Hoff, III , John Keyser , Ming Lin , Dinesh Manocha , Tim Culver, Fast computation of generalized Voronoi diagrams using graphics hardware, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.277-286, July 1999 [doi>10.1145/311535.311567]
• 12: B. Jobard and W. Lefer. Creating evenly-spaced streamlines of arbitrary density. Proceedings of Eighth Eurographics Workshop on Visualization in Scientific Computing, April 1997.
• 13: Marc Levoy , Pat Hanrahan, Light field rendering, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.31-42, August 1996 [doi>10.1145/237170.237199]
• 14: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• 15: Victor Ostromoukhov, Digital facial engraving, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.417-424, July 1999 [doi>10.1145/311535.311604]
• 16: Paul Rademacher , Gary Bishop, Multiple-center-of-projection images, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.199-206, July 1998 [doi>10.1145/280814.280871]
• 17: Michael P. Salisbury , Michael T. Wong , John F. Hughes , David H. Salesin, Orientable textures for image-based pen-and-ink illustration, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.401-406, August 1997 [doi>10.1145/258734.258890]
• 18: Daniel N. Wood , Adam Finkelstein , John F. Hughes , Craig E. Thayer , David H. Salesin, Multiperspective panoramas for cel animation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.243-250, August 1997 [doi>10.1145/258734.258859]