Photorealistic rendering of rain streaks

ABSTRACT

Photorealistic rendering of rain streaks with lighting and viewpoint effects is a challenging problem. Raindrops undergo rapid shape distortions as they fall, a phenomenon referred to as oscillations. Due to these oscillations, the reflection of light by, and the refraction of light through, a falling raindrop produce complex brightness patterns within a single motion-blurred rain streak captured by a camera or observed by a human. The brightness pattern of a rain streak typically includes speckles, multiple smeared highlights and curved brightness contours. In this work, we propose a new model for rain streak appearance that captures the complex interactions between the lighting direction, the viewing direction and the oscillating shape of the drop. Our model builds upon a raindrop oscillation model that has been developed in atmospheric sciences. We have measured rain streak appearances under a wide range of lighting and viewing conditions and empirically determined the oscillation parameters that are dominant in raindrops. Using these parameters, we have rendered thousands of rain streaks to create a database that captures the variations in streak appearance with respect to lighting and viewing directions. We have developed an efficient image-based rendering algorithm that uses our streak database to add rain to a single image or a captured video with moving objects and sources. The rendering algorithm is very simple to use as it only requires a coarse depth map of the scene and the locations and properties of the light sources. We have rendered rain in a wide range of scenarios and the results show that our physically-based rain streak model greatly enhances the visual realism of rendered rain.

REFERENCES

• 1: Andsager, K., Beard, K. V., and Laird, N. F. 1999. Laboratory Measurements of Axis Ratios for Large Raindrops. Journal of the Atmospheric Sciences 56, 2673--2683.
• 2: Olivier Faugeras, Three-dimensional computer vision: a geometric viewpoint, MIT Press, Cambridge, MA, 1993
• 3: Frohn, A., and Roth, N. 2000. Dynamics of Droplets. Springer.
• 4: Kshitiz Garg , Shree K. Nayar, When Does a Camera See Rain?, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1067-1074, October 17-20, 2005 [doi>10.1109/ICCV.2005.253]
• 5: Kubesh, R. J., and Beard, K. V. 1993. Laboratory Measurements of Spontaneous Oscillations of Moderate-Size Raindrops. J. Atmos. Sci. 50, 1089--1098.
• 6: Langer, M. S., Zhang, L., Klein, A. W., Bhatia, A., Pereira, J., and Rekhi, D. 2004. A Spectral-particle Hybrid Method for Rendering Falling Snow. In Rendering Techniques, 217--226.
• 7: Lomas, A. 2005. The Matrix Revolutions. Personal Communication.
• 8: McAllister, D. K. 2000. The Design of an API for Particle System. UNC-CH TR 00--007.
• 9: Matt Pharr , Greg Humphreys, Physically Based Rendering: From Theory to Implementation, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2004
• 10: Reed, M. 2005. Blue Sky Studios. Personal Communication.
• 11: W. T. Reeves, Particle Systems—a Technique for Modeling a Class of Fuzzy Objects, ACM Transactions on Graphics (TOG), v.2 n.2, p.91-108, April 1983 [doi>10.1145/357318.357320]
• 12: Karl Sims, Particle animation and rendering using data parallel computation, Proceedings of the 17th annual conference on Computer graphics and interactive techniques, p.405-413, September 1990, Dallas, TX, USA
• 13: Starik, K., and Werman, M. 2003. Simulation of Rain in Videos. Texture Workshop, ICCV.
• 14: Tokay, A., and Beard, K. 1996. A Field Study of Raindrop Oscillations. Part I. Journal of Applied Meteorology 35.
• 15: Wang, N., and Wade, B. 2004. Rendering Falling Rain and Snow. SIGGRAPH (sketches 0186).

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture

Keywords:
oscillations, particle system, rain rendering, rain streak appearance, rain streak database, raindrops