Synthesizing sounds from rigid-body simulations

ABSTRACT

This paper describes a real-time technique for generating realistic and compelling sounds that correspond to the motions of rigid objects. By numerically precomputing the shape and frequencies of an object's deformation modes, audio can be synthesized interactively directly from the force data generated by a standard rigid-body simulation. Using sparse-matrix eigen-decomposition methods, the deformation modes can be computed efficiently even for large meshes. This approach allows us to accurately model the sounds generated by arbitrarily shaped objects based only on a geometric description of the objects and a handful of material parameters. We validate our method by comparing results from a simulated set of wind chimes to audio measurements taken from a real set.

REFERENCES

• 1: E. Anderson , Z. Bai , C. Bischof , L. S. Blackford , J. Demmel , Jack J. Dongarra , J. Du Croz , S. Hammarling , A. Greenbaum , A. McKenney , D. Sorensen, LAPACK Users' guide (third ed.), Society for Industrial and Applied Mathematics, Philadelphia, PA, 1999
• 2: Zhaojun Bai , James Demmel , Jack Dongarra , Axel Ruhe , Henk van der Vorst, Templates for the solution of algebraic eigenvalue problems: a practical guide, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2000
• 3: COOK, R. D., MALKUS, D. S., AND PLESHA, M. E. 1989. Concepts and Applications of Finite Element Analysis, third ed. John Wiley & Sons, New York.
• 4: Perry R. Cook, Real Sound Synthesis for Interactive Applications, A. K. Peters, Ltd., Natick, MA, 2002
• 5: Thomas Funkhouser , Ingrid Carlbom , Gary Elko , Gopal Pingali , Mohan Sondhi , Jim West, A beam tracing approach to acoustic modeling for interactive virtual environments, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.21-32, July 1998 [doi>10.1145/280814.280818]
• 6: Thomas Funkhouser , Patrick Min , Ingrid Carlbom, Real-time acoustic modeling for distributed virtual environments, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.365-374, July 1999 [doi>10.1145/311535.311590]
• 7: HAHN, J., GEIGEL, J., LEE, J., GRITZ, L., TAKALA, T., AND MISHRA, S. 1995. An integrated approach to sound and motion. Journal of Visualization and Computer Animation 6, 2, 109-123.
• 8: KINSLER, L. E., FREY, A. R., COPPENS, A. B., AND SANDERS, J. V. 2000. Fundamentals of Acoustics, fourth ed. John Wiley & Sons, New York.
• 9: MIN, P., AND FUNKHOUSER, T. 2000. Priority-driven acoustic modeling for virtual environments. Computer Graphics Forum 19, 3 (Aug.).
• 10: James F. O'Brien , Jessica K. Hodgins, Graphical modeling and animation of brittle fracture, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.137-146, July 1999 [doi>10.1145/311535.311550]
• 11: James F. O'Brien , Perry R. Cook , Georg Essl, Synthesizing sounds from physically based motion, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.529-536, August 2001 [doi>10.1145/383259.383321]
• 12: A. Pentland , J. Williams, Good vibrations: model dynamics for graphics and animation, Proceedings of the 16th annual conference on Computer graphics and interactive techniques, p.215-222, July 1989
• 13: SAVIOJA, L., HUOPANIEMI, J., LOKKI, T., AND VÄÄNÄNEN, R. 1997. Virtual environment simulation - advances in the DIVA project. In Proceedings of the International Conference on Auditory Display (ICAD), 43-46.
• 14: Tapio Takala , James Hahn, Sound rendering, Proceedings of the 19th annual conference on Computer graphics and interactive techniques, p.211-220, July 1992
• 15: TERZOPOULOS, D., AND FLEISCHER, K. 1988. Deformable models. The Visual Computer 4, 6, 306-331.
• 16: Nicolas Tsingos , Thomas Funkhouser , Addy Ngan , Ingrid Carlbom, Modeling acoustics in virtual environments using the uniform theory of diffraction, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.545-552, August 2001 [doi>10.1145/383259.383323]
• 17: VAN DEN DOEL, K., AND PAI, D. K. 1996. Synthesis of shape dependent sounds with physical modeling. In Proceedings of the International Conference on Auditory Display (ICAD).
• 18: VAN DEN DOEL, K., AND PAI, D. K. 1998. The sounds of physical shapes. Presence 7, 4, 382-395.
• 19: Kees van den Doel , Paul G. Kry , Dinesh K. Pai, FoleyAutomatic: physically-based sound effects for interactive simulation and animation, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.537-544, August 2001 [doi>10.1145/383259.383322]
• 20: WU, K., AND SIMON, H. 1999. TRLAN user guide. Tech. Rep. LBNL-42953, Lawrence Berkeley National Laboratory.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Physically based modeling

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.5 Sound and Music Computing
          Subjects: Signal analysis, synthesis, and processing

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation
  I.6 SIMULATION AND MODELING
      I.6.8 Types of Simulation
          Subjects: Animation

Keywords:
animation techniques, dynamics, element method, finite, modal analysis, modal synthesis, physically based modeling, simulation, sound modeling, surface vibrations