Photorealism or/and non-photorealism in augmented reality

ABSTRACT

Actual graphic hardware becomes more and more powerful. Consequently, virtual scenes can be rendered in a very good quality integrating dynamic behavior, real-time shadows, bump mapped surfaces and other photorealistic rendering techniques. On the other hand, non-photorealistic rendering became popular as well, because of its artistic merits. An integration in an AR environment is the logical consequence. In this paper we present an AR framework that uses photorealistic rendering as well as non-photorealistic rendering techniques. The prototypes based on these techniques show the advantages and disadvantages of both technologies in combination with Augmented Reality.

REFERENCES

• 1: Kusuma Agusanto , Li Li , Zhu Chuangui , Ng Wan Sing, Photorealistic rendering for augmented reality using environment illumination, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.208, October 07-10, 2003
• 2: Oliver Bimber , Anselm Grundhöfer , Gordon Wetzstein , Sebastian Knödel, Consistent Illumination within Optical See-Through Augmented Environments, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.198, October 07-10, 2003
• 3: Franklin C. Crow, Shadow algorithms for computer graphics, Proceedings of the 4th annual conference on Computer graphics and interactive techniques, p.242-248, July 20-22, 1977, San Jose, California
• 4: Cassidy J. Curtis , Sean E. Anderson , Joshua E. Seims , Kurt W. Fleischer , David H. Salesin, Computer-generated watercolor, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.421-430, August 1997 [doi>10.1145/258734.258896]
• 5: Dietrich, S. 2000. Cartoon rendering and advanced texture features of the geforce 256 texture matrix, projective textures, cube maps, texture coordinate generation and dotproduct3 texture blending. Tech. rep., nVIDIA.
• 6: Digiben, 2001. GameTutorials, URL: http://www.gametutorials.com/TermsOfUse.htm.
• 7: Drab, S. 2003. Echtzeitrendering von Schattenwurf in Augmented Reality Anwendungen. Master's thesis, Upper Austria University of Applied Sciences, Media Technology and Design.
• 8: Frédo Durand, An invitation to discuss computer depiction, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France [doi>10.1145/508530.508550]
• 9: Feng Dong , Gordon J. Clapworthy , Hai Lin , Meleagros A. Krokos, Nonphotorealistic Rendering of Medical Volume Data, IEEE Computer Graphics and Applications, v.23 n.4, p.44-52, July 2003 [doi>10.1109/MCG.2003.1210864]
• 10: Randima Fernando , Mark J. Kilgard, The Cg Tutorial: The Definitive Guide to Programmable Real-Time Graphics, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2003
• 11: Ferwerda, J. 2003. Three varieties of realism in computer graphics. In Proceedings SPIE Human Vision and Electronic Imaging '03.
• 12: Bert Freudenberg , Maic Masuch , Niklas Röber , Thomas Strothotte, The Computer-Visualistik-Raum: veritable and inexpensive presentation of a virtual reconstruction, Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage, November 28-30, 2001, Glyfada, Greece [doi>10.1145/584993.585010]
• 13: Andrew Glassner, Everyday Computer Graphics, IEEE Computer Graphics and Applications, v.23 n.6, p.76-82, November 2003 [doi>10.1109/MCG.2003.1242385]
• 14: Bruce Gooch , Greg Coombe , Peter Shirley, Artistic Vision: painterly rendering using computer vision techniques, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France [doi>10.1145/508530.508545]
• 15: Paul Haeberli, Paint by numbers: abstract image representations, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.207-214, September 1990, Dallas, TX, USA
• 16: Michael Haller , Daniel Sperl, Real-time painterly rendering for MR applications, Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia, June 15-18, 2004, Singapore [doi>10.1145/988834.988839]
• 17: Michael Haller , Stephan Drab , Werner Hartmann, A real-time shadow approach for an augmented reality application using shadow volumes, Proceedings of the ACM symposium on Virtual reality software and technology, October 01-03, 2003, Osaka, Japan [doi>10.1145/1008653.1008665]
• 18: Aaron Hertzmann , Ken Perlin, Painterly rendering for video and interaction, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.7-12, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340917]
• 19: Matthew Kaplan , Bruce Gooch , Elaine Cohen, Interactive artistic rendering, Proceedings of the 1st international symposium on Non-photorealistic animation and rendering, p.67-74, June 05-07, 2000, Annecy, France [doi>10.1145/340916.340925]
• 20: Kato, H., Billinghurst, M., Blanding, B., and May, R. 1999. ARToolKit.
• 21: Ken-ichi Anjyo , Katsuaki Hiramitsu, Stylized Highlights for Cartoon Rendering and Animation, IEEE Computer Graphics and Applications, v.23 n.4, p.54-61, July 2003 [doi>10.1109/MCG.2003.1210865]
• 22: Lander, J. 2000. Shades of disney: Opaquing a 3d world. Game Developers Magazine (March).
• 23: Madsen, C. B., Sørensen, M. K. D., and Vittrup, M. 2003. The importance of shadows in augmented reality. In Proceedings: 6th Annual International Workshop on Presence, Aalborg, Denmark, (4 pages). To appear.
• 24: Aditi Majumder , M. Gopi, Hardware accelerated real time charcoal rendering, Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, June 03-05, 2002, Annecy, France [doi>10.1145/508530.508541]
• 25: Lee Markosian , Michael A. Kowalski , Daniel Goldstein , Samuel J. Trychin , John F. Hughes , Lubomir D. Bourdev, Real-time nonphotorealistic rendering, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.415-420, August 1997 [doi>10.1145/258734.258894]
• 26: Michael D. McCool, Shadow volume reconstruction from depth maps, ACM Transactions on Graphics (TOG), v.19 n.1, p.1-26, Jan. 2000 [doi>10.1145/343002.343006]
• 27: Barbara J. Meier, Painterly rendering for animation, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.477-484, August 1996 [doi>10.1145/237170.237288]
• 28: T. Naemura , T. Nitta , A. Mimura , H. Harashima, Virtual Shadows - Enhanced Interaction in Mixed Reality Environment, Proceedings of the IEEE Virtual Reality Conference 2002, p.293, March 24-28, 2002
• 29: Naemura, T., Nitta, T., Mimura, A., and Harashima, H. 2002. Virtual shadows in mixed reality environment using flashlight-like devices. Trans. Virtual Reality Society of Japan 7, 2, 227--237.
• 30: Nassir Navab, Industrial Augmented Reality(IAR): Challenges in Design and Commercialization of Killer Apps, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.2, October 07-10, 2003
• 31: Emil Praun , Hugues Hoppe , Matthew Webb , Adam Finkelstein, Real-time hatching, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.581, August 2001 [doi>10.1145/383259.383328]
• 32: Roussou, M., and Drettakis, G. 2003. Photorealism and non-photorealism in virtual heritage representation. In VAST 2003 and First Eurographics Workshop on Graphics and Cultural Heritage, A. Chalmers, D. Arnold, and F. Niccolucci, Eds., Eurographics.
• 33: Michael P. Salisbury , Sean E. Anderson , Ronen Barzel , David H. Salesin, Interactive pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.101-108, July 1994 [doi>10.1145/192161.192185]
• 34: Sperl, D. 2003. Kuenstlerisches Rendering fr Echtzeit-Applikationen. Master's thesis, Upper Austria University of Applied Sciences, Media Technology and Design.
• 35: Natsuki Sugano , Hirokazu Kato , Keihachiro Tachibana, The Effects of Shadow Representation of Virtual Objects in Augmented Reality, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.76, October 07-10, 2003
• 36: Georges Winkenbach , David H. Salesin, Computer-generated pen-and-ink illustration, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.91-100, July 1994 [doi>10.1145/192161.192184]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Keywords:
augmented reality, non-photorealisic rendering, photorealistic rendering