DAB: interactive haptic painting with 3D virtual brushes

ABSTRACT

We present a novel painting system with an intuitive haptic interface, which serves as an expressive vehicle for interactively creating painterly works. We introduce a deformable, 3D brush model, which gives the user natural control of complex brush strokes. The force feedback enhances the sense of realism and provides tactile cues that enable the user to better manipulate the paint brush. We have also developed a bidirectional, two-layer paint model that, combined with a palette interface, enables easy loading of complex blends onto our 3D virtual brushes to generate interesting paint effects on the canvas. The resulting system, DAB, provides the user with an artistic setting, which is conceptually equivalent to a real-world painting environment. Several users have tested DAB and were able to start creating original art work within minutes.

REFERENCES

• ABL95: Maneesh Agrawala , Andrew C. Beers , Marc Levoy, 3D painting on scanned surfaces, Proceedings of the 1995 symposium on Interactive 3D graphics, p.145-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199429]
• BW98: David Baraff , Andrew Witkin, Large steps in cloth simulation, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.43-54, July 1998 [doi>10.1145/280814.280821]
• CAS+97: Cassidy J. Curtis , Sean E. Anderson , Joshua E. Seims , Kurt W. Fleischer , David H. Salesin, Computer-generated watercolor, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.421-430, August 1997 [doi>10.1145/258734.258896]
• COR00: COREL. Painter. http://newgraphics.corel.com/products/painter6.html, 2000.
• CPE92: T. Cockshott, J. Patterson, and D. England. Modelling the texture of paint. Computer Graphics Forum (Eurographics'92 Proc.), 11(3):C217- C226, 1992.
• DSB99: Mathieu Desbrun , Peter Schröder , Alan Barr, Interactive animation of structured deformable objects, Proceedings of the 1999 conference on Graphics interface '99, p.1-8, September 1999, Kingston, Ontario, Canada
• GEL00: Arthur D. Gregory , Stephen A. Ehmann , Ming C. Lin, inTouch: Interactive Multiresolution Modeling and 3D Painting with a Haptic Interface, Proceedings of the IEEE Virtual Reality 2000 Conference, p.45, March 18-22, 2000
• HDD+94: Hugues Hoppe , Tony DeRose , Tom Duchamp , Mark Halstead , Hubert Jin , John McDonald , Jean Schweitzer , Werner Stuetzle, Piecewise smooth surface reconstruction, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.295-302, July 1994 [doi>10.1145/192161.192233]
• hem00: RIGHT hemisphere. Deep paint. http://www.us.deeppaint.com/, 2000.
• Her98: Aaron Hertzmann, Painterly rendering with curved brush strokes of multiple sizes, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.453-460, July 1998 [doi>10.1145/280814.280951]
• HH90: Pat Hanrahan , Paul Haeberli, Direct WYSIWYG painting and texturing on 3D shapes, ACM SIGGRAPH Computer Graphics, v.24 n.4, p.215-223, Aug. 1990
• JTK+99: David Johnson , Thomas V. Thompson Ii , Matthew Kaplan , Donald Nelson , Elaine Cohen, Painting Textures with a Haptic Interface, Proceedings of the IEEE Virtual Reality, p.282, March 13-17, 1999
• Lit97: Peter Litwinowicz, Processing images and video for an impressionist effect, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.407-414, August 1997 [doi>10.1145/258734.258893]
• May70: R. Mayer. The Artist's Handbook of Materials and Techniques. The Viking Press, 1970.
• Mei96: Barbara J. Meier, Painterly rendering for animation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.477-484, August 1996 [doi>10.1145/237170.237288]
• Pix00: Pixologic. Z-brush. http://pixologic.com, 2000.
• Smi78: Alvy Ray Smith. Paint. TM 7, NYIT Computer Graphics Lab, July 1978.
• SN99: Suguru Saito , Masayuki Nakajima, 3D physics-based brush model for painting, ACM SIGGRAPH 99 Conference abstracts and applications, p.226, August 08-13, 1999, Los Angeles, California, United States [doi>10.1145/311625.312110]
• Str86: Steve Strassmann, Hairy brushes, ACM SIGGRAPH Computer Graphics, v.20 n.4, p.225-232, Aug. 1986
• WB97: A. Witkin and D. Baraff. Physically Based Modeling: Principles and Practice. ACM Press, 1997.
• WI00: H. Wong and H. Ip. Virtual brush: A model-based synthesis of chinese calligraphy. Computers & Graphics, 24, 2000.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

General Terms:
Design, Performance, Theory

Keywords:
Human Computer Interaction, deformable brush model, haptics, painting systems