Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources

ABSTRACT

Simulating sounds produced by realistic vibrating objects is challenging because sound radiation involves complex diffraction and interreflection effects that are very perceptible and important. These wave phenomena are well understood, but have been largely ignored in computer graphics due to the high cost and complexity of computing them at audio rates.We describe a new algorithm for real-time synthesis of realistic sound radiation from rigid objects. We start by precomputing the linear vibration modes of an object, and then relate each mode to its sound pressure field, or acoustic transfer function, using standard methods from numerical acoustics. Each transfer function is then approximated to a specified accuracy using low-order multi-pole sources placed near the object. We provide a low-memory, multilevel, randomized algorithm for optimized source placement that is suitable for complex geometries. At runtime, we can simulate new interaction sounds by quickly summing contributions from each mode's equivalent multipole sources. We can efficiently simulate global effects such as interreflection and changes in sound due to listener location. The simulation costs can be dynamically traded-off for sound quality. We present several examples of sound generation from physically based animations.

REFERENCES

• 1: Milton Abramowitz, Handbook of Mathematical Functions, With Formulas, Graphs, and Mathematical Tables,, Dover Publications, Incorporated, 1974
• 2: Jernej Barbič , Doug L. James, Real-Time subspace integration for St. Venant-Kirchhoff deformable models, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 3: M. Cardle , S. Brooks , Z. Bar-Joseph , P. Robinson, Sound-by-numbers: motion-driven sound synthesis, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 4: Ciscowski, R. D., and Brebbia, C. A. 1991. Boundary Element methods in acoustics. Computational Mechanics Publications and Elsevier Applied Science, Southampton.
• 5: Perry R. Cook, Real Sound Synthesis for Interactive Applications, A. K. Peters, Ltd., Natick, MA, 2002
• 6: Cremer, L., Heckl, M., and Ungar, E. 1990. Structure Borne Sound: Structural Vibrations and Sound Radiation at Audio Frequencies, 2nd ed. Springer, January.
• 7: Cunefare, K. A., and Currey, M. N. 1994. On the exterior acoustic radiation modes of structures. The Journal of the Acoustical Society of America 96, 4 (October), 2302--2312.
• 8: Desmet, W. 2002. Mid-frequency vibro-acoustic modelling: challenges and potential solutions. In Proceedings of ISMA 2002, vol. II.
• 9: Yoshinori Dobashi , Tsuyoshi Yamamoto , Tomoyuki Nishita, Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 10: Thomas Funkhouser , Ingrid Carlbom , Gary Elko , Gopal Pingali , Mohan Sondhi , Jim West, A beam tracing approach to acoustic modeling for interactive virtual environments, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.21-32, July 1998 [doi>10.1145/280814.280818]
• 11: Thomas Funkhouser , Patrick Min , Ingrid Carlbom, Real-time acoustic modeling for distributed virtual environments, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.365-374, July 1999 [doi>10.1145/311535.311590]
• 12: Gene H. Golub , Charles F. Van Loan, Matrix computations (3rd ed.), Johns Hopkins University Press, Baltimore, MD, 1996
• 13: Gounot, Y., Musafir, R. E., and Slama, J. G. 2005. A Comparative Study of Two Variants of the Equivalent Sources Method in Scattering Problems. Acta Acustica united with Acustica 91, 5, 860--872.
• 14: Gumerov, N., and Duraiswami, R. 2005. Fast Multipole Methods for the Helmholtz Equation in Three Dimensions. Elsevier Series in Electromagnetism. Elsevier Science, March.
• 15: Doug L. James , Kayvon Fatahalian, Precomputing interactive dynamic deformable scenes, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 16: Doug L. James , Dinesh K. Pai, DyRT: dynamic response textures for real time deformation simulation with graphics hardware, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 17: Johnson, M. E., Lalime, A. L., Grosveld, F. W., Rizzi, S. A., and Sullivan, B. M. 2003. Development of an efficient binaural simulation for the analysis of structural acoustic data. In 8th Intl. Conf. on Recent Advances in Structural Dynamics.
• 18: Kita, E., and Kamiya, N. 1995. Trefftz method: An overview. Advances in Engineering Software 24, 89--96.
• 19: Lewiner, T., Lopes, H., Vieira, A. W., and Tavares, G. 2003. Efficient implementation of Marching Cubes' cases with topological guarantees. Journal of Graphics Tools 8, 2, 1--15.
• 20: Tapio Lokki , Lauri Savioja , Riitta Väänänen , Jyri Huopaniemi , Tapio Takala, Creating Interactive Virtual Auditory Environments, IEEE Computer Graphics and Applications, v.22 n.4, p.49-57, July 2002 [doi>10.1109/MCG.2002.1016698]
• 21: Magalhães, M. B. S., and Tenenbaum, R. A. 2004. Sound Sources Reconstruction Techniques: A Review of Their Evolution and New Trends. Acta Acustica united with Acustica 90, 199--220.
• 22: James F. O'Brien , Perry R. Cook , Georg Essl, Synthesizing sounds from physically based motion, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.529-536, August 2001 [doi>10.1145/383259.383321]
• 23: James F. O'Brien , Chen Shen , Christine M. Gatchalian, Synthesizing sounds from rigid-body simulations, Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 21-22, 2002, San Antonio, Texas [doi>10.1145/545261.545290]
• 24: Ochmann, M. 1995. The Source Simulation Technique for Acoustic Radiation Problems. Acustica 81.
• 25: Ochmann, M. 1999. The full-field equations for acoustic radiation and scattering. Journal of the Acoustical Society of America 105, 5 (May).
• 26: Dinesh K. Pai , Kees van den Doel , Doug L. James , Jochen Lang , John E. Lloyd , Joshua L. Richmond , Som H. Yau, Scanning physical interaction behavior of 3D objects, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.87-96, August 2001 [doi>10.1145/383259.383268]
• 27: Pavić, G. 2005. An Engineering Technique for the Computation of Sound Radiation by Vibrating Bodies Using Substitute Sources. Acta Acustica united with Acustica 91, 1, 1--16.
• 28: Pavić, G. 2006. A Technique for the Computation of Sound Radiation by Vibrating Bodies Using Multipole Substitute Sources. Acta Acustica united with Acustica 92, 1, 112--126.
• 29: Nikunj Raghuvanshi , Ming C. Lin, Interactive sound synthesis for large scale environments, Proceedings of the 2006 symposium on Interactive 3D graphics and games, March 14-17, 2006, Redwood City, California [doi>10.1145/1111411.1111429]
• 30: Shabana, A. A. 1990. Theory of Vibration, Volume II: Discrete and Continuous Systems, first ed. Springer-Verlag, New York, NY.
• 31: Peter-Pike Sloan , Jan Kautz , John Snyder, Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 32: Peter-Pike Sloan , Jesse Hall , John Hart , John Snyder, Clustered principal components for precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.22 n.3, July 2003
• 33: Peter-Pike Sloan , Ben Luna , John Snyder, Local, deformable precomputed radiance transfer, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 34: Jos Stam, Diffraction shaders, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.101-110, July 1999 [doi>10.1145/311535.311546]
• 35: A. Stettner , D. P. Greenberg, Computer graphics visualization for acoustic simulation, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.195-206, July 1989
• 36: Tapio Takala , James Hahn, Sound rendering, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.211-220, July 1992
• 37: Nicolas Tsingos , Thomas Funkhouser , Addy Ngan , Ingrid Carlbom, Modeling acoustics in virtual environments using the uniform theory of diffraction, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.545-552, August 2001 [doi>10.1145/383259.383323]
• 38: Nicolas Tsingos , Ingrid Carlbom , Gary Elbo , Robert Kubli , Thomas Funkhouser, Validating Acoustical Simulations in Bell Labs Box, IEEE Computer Graphics and Applications, v.22 n.4, p.28-37, July 2002 [doi>10.1109/MCG.2002.1016696]
• 39: Nicolas Tsingos , Emmanuel Gallo , George Drettakis, Perceptual audio rendering of complex virtual environments, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 40: van den Doel, K., and Pai, D. K. 1996. Synthesis of shape dependent sounds with physical modeling. In Intl Conf. on Auditory Display.
• 41: Kees van den Doel , Paul G. Kry , Dinesh K. Pai, FoleyAutomatic: physically-based sound effects for interactive simulation and animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.537-544, August 2001 [doi>10.1145/383259.383322]
• 42: van den Doel, K., Pai, D. K., Adam, T., Kortchmar, L., and Pichora-Fuller, K. 2002. Measurements of Perceptual Quality of Contact Sound Models. In Intl. Conf. on Auditory Display, 345--349.
• 43: von Estorff, O., Ed. 2000. Boundary Elements in Acoustics: Advances and Applications. WIT Press, Southhampton, UK.
• 44: von Estorff, O. 2003. Efforts to Reduce Computation Time in Numerical Acoustics -- An Overview. Acta Acustica united with Acustica 89, 1--13.
• 45: Wand, M., and Strasser, W. 2004. Multi-resolution sound rendering. In 2004 Eurographics Symp. on Point-Based Graphics, Eurographics.
• 46: Wu, T. W., Ed. 2000. Boundary Element Acoustics: Fundamentals and Computer Codes. WIT Press, Southhampton, UK.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Physically based modeling

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Animation

Keywords:
Helmholtz, Trefftz, acoustic radiation, boundary element method, equivalent sources, modal vibration, multipole, sound synthesis, source simulation