“Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources” by James, Barbic and Pai

Simulating sounds produced by realistic vibrating objects is challenging because sound radiation involves complex diffraction and interreflection effects that are very perceptible and important. These wave phenomena are well understood, but have been largely ignored in computer graphics due to the high cost and complexity of computing them at audio rates.We describe a new algorithm for real-time synthesis of realistic sound radiation from rigid objects. We start by precomputing the linear vibration modes of an object, and then relate each mode to its sound pressure field, or acoustic transfer function, using standard methods from numerical acoustics. Each transfer function is then approximated to a specified accuracy using low-order multi-pole sources placed near the object. We provide a low-memory, multilevel, randomized algorithm for optimized source placement that is suitable for complex geometries. At runtime, we can simulate new interaction sounds by quickly summing contributions from each mode’s equivalent multipole sources. We can efficiently simulate global effects such as interreflection and changes in sound due to listener location. The simulation costs can be dynamically traded-off for sound quality. We present several examples of sound generation from physically based animations.

1. Abramowitz, M., and Stegun, I. A. 1964. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. Dover, New York. Google ScholarDigital Library
2. Barbič, J., and James, D. 2005. Real-Time Subspace Integration for St. Venant-Kirchhoff Deformable Models. ACM Transactions on Graphics 24, 3 (Aug.), 982–990. Google ScholarDigital Library
3. Cardle, M., Brooks, S., Bar-Joseph, Z., and Robinson, P. 2003. Sound-by-Numbers: Motion-Driven Sound Synthesis. In 2003 ACM SIGGRAPH / Eurographics Symp. on Computer Animation, 349–356. Google ScholarDigital Library
4. Ciscowski, R. D., and Brebbia, C. A. 1991. Boundary Element methods in acoustics. Computational Mechanics Publications and Elsevier Applied Science, Southampton.Google Scholar
5. Cook, P. 2002. Real Sound Synthesis for Interactive Applications. A. K. Peters. Google ScholarDigital Library
6. Cremer, L., Heckl, M., and Ungar, E. 1990. Structure Borne Sound: Structural Vibrations and Sound Radiation at Audio Frequencies, 2nd ed. Springer, January.Google Scholar
7. Cunefare, K. A., and Currey, M. N. 1994. On the exterior acoustic radiation modes of structures. The Journal of the Acoustical Society of America 96, 4 (October), 2302–2312.Google ScholarCross Ref
8. Desmet, W. 2002. Mid-frequency vibro-acoustic modelling: challenges and potential solutions. In Proceedings of ISMA 2002, vol. II.Google Scholar
9. Dobashi, Y., Yamamoto, T., and Nishita, T. 2003. Real-Time Rendering of Aerodynamic Sound Using Sound Textures Based on Computational Fluid Dynamics. ACM Trans. on Graphics 22, 3 (July), 732–740. Google ScholarDigital Library
10. Funkhouser, T., Carlbom, I., Elko, G., Pingali, G., Sondhi, M., and West, J. 1998. A Beam Tracing Approach to Acoustic Modeling for Interactive Virtual Environments. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 21–32. Google ScholarDigital Library
11. Funkhouser, T. A., Min, P., and Carlbom, I. 1999. Real-Time Acoustic Modeling for Distributed Virtual Environments. In Proceedings of SIGGRAPH 99, 365–374. Google ScholarDigital Library
12. Golub, G., and Van Loan, C. 1996. Matrix Computations, third ed. The Johns Hopkins University Press, Baltimore. Google ScholarDigital Library
13. Gounot, Y., Musafir, R. E., and Slama, J. G. 2005. A Comparative Study of Two Variants of the Equivalent Sources Method in Scattering Problems. Acta Acustica united with Acustica 91, 5, 860–872.Google Scholar
14. Gumerov, N., and Duraiswami, R. 2005. Fast Multipole Methods for the Helmholtz Equation in Three Dimensions. Elsevier Series in Electromagnetism. Elsevier Science, March.Google Scholar
15. James, D. L., and Fatahalian, K. 2003. Precomputing Interactive Dynamic Deformable Scenes. ACM Trans. on Graphics 22, 3, 879–887. Google ScholarDigital Library
16. James, D. L., and Pai, D. K. 2002. DyRT: Dynamic Response Textures for Real Time Deformation Simulation With Graphics Hardware. ACM Transactions on Graphics 21, 3 (July), 582–585. Google ScholarDigital Library
17. Johnson, M. E., Lalime, A. L., Grosveld, F. W., Rizzi, S. A., and Sullivan, B. M. 2003. Development of an efficient binaural simulation for the analysis of structural acoustic data. In 8th Intl. Conf. on Recent Advances in Structural Dynamics.Google Scholar
18. Kita, E., and Kamiya, N. 1995. Trefftz method: An overview. Advances in Engineering Software 24, 89–96.Google ScholarCross Ref
19. Lewiner, T., Lopes, H., Vieira, A. W., and Tavares, G. 2003. Efficient implementation of Marching Cubes’ cases with topological guarantees. Journal of Graphics Tools 8, 2, 1–15.Google ScholarCross Ref
20. Lokki, T., Savioja, L., Väänänen, R., Huopaniemi, J., and Takala, T. 2002. Creating Interactive Virtual Auditory Environments. IEEE Computer Graphics & Applications 22, 4 (July-August), 49–57. Google ScholarDigital Library
21. Magalhães, M. B. S., and Tenenbaum, R. A. 2004. Sound Sources Reconstruction Techniques: A Review of Their Evolution and New Trends. Acta Acustica united with Acustica 90, 199–220.Google Scholar
22. O’Brien, J. F., Cook, P. R., and Essl, G. 2001. Synthesizing Sounds From Physically Based Motion. In Proceedings of ACM SIGGRAPH 2001, 529–536. Google ScholarDigital Library
23. O’Brien, J. F., Shen, C., and Gatchalian, C. M. 2002. Synthesizing Sounds from Rigid-Body Simulations. In ACM SIGGRAPH Symposium on Computer Animation, 175–181. Google ScholarDigital Library
24. Ochmann, M. 1995. The Source Simulation Technique for Acoustic Radiation Problems. Acustica 81.Google Scholar
25. Ochmann, M. 1999. The full-field equations for acoustic radiation and scattering. Journal of the Acoustical Society of America 105, 5 (May).Google ScholarCross Ref
26. Pai, D. K., van den Doel, K., James, D. L., Lang, J., Lloyd, J. E., Richmond, J. L., and Yau, S. H. 2001. Scanning Physical Interaction Behavior of 3D Objects. In Proc. of ACM SIGGRAPH 2001, 87–96. Google ScholarDigital Library
27. Pavić, G. 2005. An Engineering Technique for the Computation of Sound Radiation by Vibrating Bodies Using Substitute Sources. Acta Acustica united with Acustica 91, 1, 1–16.Google Scholar
28. Pavić, G. 2006. A Technique for the Computation of Sound Radiation by Vibrating Bodies Using Multipole Substitute Sources. Acta Acustica united with Acustica 92, 1, 112–126.Google Scholar
29. Raghuvanshi, N., and Lin, M. C. 2006. Interactive Sound Synthesis for Large Scale Environments. In SI3D ’06: Proceedings of the 2006 symposium on Interactive 3D graphics and games, ACM Press, New York, NY, USA, 101–108. Google ScholarDigital Library
30. Shabana, A. A. 1990. Theory of Vibration, Volume II: Discrete and Continuous Systems, first ed. Springer-Verlag, New York, NY.Google Scholar
31. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments. ACM Transactions on Graphics 21, 3 (July), 527–536. Google ScholarDigital Library
32. Sloan, P.-P., Hall, J., Hart, J., and Snyder, J. 2003. Clustered Principal Components for Precomputed Radiance Transfer. ACM Transactions on Graphics 22, 3 (July), 382–391. Google ScholarDigital Library
33. Sloan, P.-P., Luna, B., and Snyder, J. 2005. Local, Deformable Precomputed Radiance Transfer. ACM Transactions on Graphics 24, 3 (Aug.), 1216–1224. Google ScholarDigital Library
34. Stam, J. 1999. Diffraction Shaders. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, Annual Conference Series, 101–110. Google ScholarDigital Library
35. Stettner, A., and Greenberg, D. P. 1989. Computer Graphics Visualization For Acoustic Simulation. In Computer Graphics (Proceedings of SIGGRAPH 89), vol. 23, 195–206. Google ScholarDigital Library
36. Takala, T., and Hahn, J. 1992. Sound rendering. In Computer Graphics (Proceedings of SIGGRAPH 92), vol. 26, 211–220. Google ScholarDigital Library
37. Tsingos, N., Funkhouser, T., Ngan, A., and Carlbom, I. 2001. Modeling Acoustics in Virtual Environments Using the Uniform Theory of Diffraction. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 545–552. Google ScholarDigital Library
38. Tsingos, N., Carlbom, I., Elbo, G., Kubli, R., and Funkhouser, T. 2002. Validating Acoustical Simulations in Bell Labs Box. IEEE Computer Graphics & Applications 22, 4 (July-August), 28–37. Google ScholarDigital Library
39. Tsingos, N., Gallo, E., and Drettakis, G. 2004. Perceptual Audio Rendering of Complex Virtual Environments. ACM Transactions on Graphics 23, 3 (Aug.), 249–258. Google ScholarDigital Library
40. van den Doel, K., and Pai, D. K. 1996. Synthesis of shape dependent sounds with physical modeling. In Intl Conf. on Auditory Display.Google Scholar
41. van den Doel, K., Kry, P. G., and Pai, D. K. 2001. FoleyAutomatic: Physically-Based Sound Effects for Interactive Simulation and Animation. In Proceedings of ACM SIGGRAPH 2001, 537–544. Google ScholarDigital Library
42. van den Doel, K., Pai, D. K., Adam, T., Kortchmar, L., and Pichora-Fuller, K. 2002. Measurements of Perceptual Quality of Contact Sound Models. In Intl. Conf. on Auditory Display, 345–349.Google Scholar
43. von Estorff, O., Ed. 2000. Boundary Elements in Acoustics: Advances and Applications. WIT Press, Southhampton, UK.Google Scholar
44. von Estorff, O. 2003. Efforts to Reduce Computation Time in Numerical Acoustics — An Overview. Acta Acustica united with Acustica 89, 1–13.Google Scholar
45. Wand, M., and Strasser, W. 2004. Multi-resolution sound rendering. In 2004 Eurographics Symp. on Point-Based Graphics, Eurographics. Google ScholarDigital Library
46. Wu, T. W., Ed. 2000. Boundary Element Acoustics: Fundamentals and Computer Codes. WIT Press, Southhampton, UK.Google Scholar