“Synthesizing sounds from physically based motion” by O’Brien, Cook and Essi

This paper describes a technique for approximating sounds that are generated by the motions of solid objects. The technique builds on previous work in the field of physically based animation that uses deformable models to simulate the behavior of the solid objects. As the motions of the objects are computed, their surfaces are analyzed to determine how the motion will induce acoustic pressure waves in the surrounding medium. Our technique computes the propagation of those waves to the listener and then uses the results to generate sounds corresponding to the behavior of the simulated objects.

1. J. M. Adrien. The missing link: Modal synthesis. In De Poli, Piccialli, and Roads, editors, Representations of Musical Signals, chapter 8, pages 269–297. MIT Press, Cambridge,1991.
2. D. R. Begault. 3-D Sound for Virtual Reality and Multimedia. Academic Press, 1994.
3. I. Bork. Practical tuning of xylophone bars and resonators. Applied Acoustics, 46: 103–127, 1995.
4. I. Bork, A. Chaigne, L.-C. Trebuchet, M. Kosfelder, and D.Pillot. Comparison between modal analysis and finite element modeling of a marimba bar. Acoustica united with Acta Acustica, 85 (2): 258–266, March 1999.
5. J. Bretos, C. Santamar ́ıa, and J. A. Moral. Finite element analysis and experimental measurements of natural eigen modes and random responses of wooden bars used in musical instruments. Applied Acoustics, 56:141–156, 1999.
6. A. Chaigne and A.Askenfelt. Numerical simulations of piano strings: I. a physical model for a struck string using finite difference methods. Journal of the Acoustical Society of America, 95(2): 1112–1118, February 1994.
7. A.Chaigne and A.Askenfelt. Numerical simulations of piano strings: II. comparisons with measurements and systematic exploration of some hammerstring parameters. Journal of the Acoustical Society of America, 95(3):1631–1640, March 1994.
8. A.Chaigne and V. Doutaut. Numerical simulations of xylo-phones: I. time domain modeling of the vibrating bars. Journal of the Acoustical Society of America, 101(1):539–557, January 1997.
9. P. R. Cook. Physically informed sonic modeling (PhISM): Synthesis of percussive sounds. Computer Music Journal, 21(3):38–49, 1997.
10. V. Doutaut, D. Matignon, and A.Chaigne. Numerical simulations of xylophones: II. time-domain modeling of the resonator and of the radiated sound pressure. Journal of the Acoustical Society of America, 104(3): 1633–1647, September 1998.
11. G.Essland P. R. Cook. Measurements and efficient simulations of bowed bars. Journal of the Acoustical Society of America, 108(1):379–388, 2000.
12. N.H. Fletcher and T. D. Rossing.The Physics of Musical Instruments. Spreinger–Verlag, NewYork, second edition, 1997.
13. N. Foster and D.Metaxas. Realistic animation of liquids. In Proceeding Graphics Interface ’96, pages 204–212. Canadian Human-Computer Communications Society, May 1996.
14. T. Funkhouser, I. Carlbom, G. Elko, G. Pingali, M. Sondhi, and J. West. A beam tracing approach to acoustic modeling for interactive virtual environments. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, pages 21–32, July 1998.
15. T. Funkhouser, P. Min, and I. Carlbom. Real-time acoustic modeling for distributed virtual environments. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, Annual Conference Series, pages 365–374, August 1999.
16. W. G.GardnerandK.D.Martin.HRTFmeasurementsofaKEMARdummyheadmicrophone.TechnicalReport280,MITMediaLabPerceptualComputing,1994.
17. J. W. Goodman.Introductionto FourierOptics. McGraw-HillHigherEducation,New York,secondedition,1996.
18. J. Hahn,J. Geigel,J. Lee,L.Gritz,T. Takala,andS.Mishra.Anintegratedapproachtosoundandmotion.JournalofVi-sualizationandComputerAnimation, 6(2),1995.
19. L.E.Kinsler, A.R.Frey, A.B.Coppens,andJ. V. Sanders.FundamentalsofAcoustics. JohnWiley andSons,Inc.,NewYork,fourthedition,2000.
20. M.E.McIntyre,R.T. Schumacher, andJ. Woodhouse.Ontheoscillationofmusicalinstruments.JournaloftheAcousticalSocietyofAmerica, 74(5):1325–1344,November1983.
21. P. MinandT. Funkhouser. Priority-drivenacousticmodelingforvirtualenvironments.ComputerGraphicsForum, 19(3),August2000.
22. J. F. O’BrienandJ. K.Hodgins.Graphicalmodelingandan-imationofbrittlefracture.InProceedingsofSIGGRAPH99,ComputerGraphicsProceedings,AnnualConferenceSeries,pages137–146,August1999.
23. J. F. O’BrienandJ. K.Hodgins.Animatingfracture.Com-municationsoftheACM, 43(7):68–75,July2000.
24. F. Ordu ̃na-Bustamante.Nonuniformbeamswithharmon-icallyrelatedovertonesforuseinpercussioninstruments.JournaloftheAcousticalSocietyofAmerica, 90(6):2935–2941,December1991.Erratum:J.ofAcous.Soc.Am.91(6):3582–3583.
25. M.PalumbiandL.Seno.Physicalmodelingbydirectlysolv-ingwave PDE.InProceedingsoftheInternationalCom-puterMusicConference(ICMC), pages325–328,Beijing,China,October1999.InternationalComputerMusicAssoci-ation(ICMA).
26. J.L.RichmondandD.K.Pai.Roboticmeasurementandmodelingofcontactsounds.InProceedingsoftheInterna-tionalConferenceonAuditoryDisplay(ICAD), 2000.
27. L.Savioja,J. Huopaniemi,T. Lokki,andR.V ̈a ̈an ̈anen.Vir-tualenvironmentsimulation- advancesintheDIVAproject.InProceedingsoftheInternationalConferenceonAuditoryDisplay(ICAD), pages43–46,1997.
28. X.Serra.Acomputermodelforbarpercussioninstruments.InProc.InternationalComputerMusicConference(ICMC),pages257–262,TheHague,1986.InternationalComputerMusicAssociation(ICMA).
29. J. O.Smith.Efficientsimulationofthereed-boreandbow-stringmechanisms.InProceedingsoftheInternationalCom-puterMusicConference(ICMC), pages275–280,TheHague,1986.InternationalComputerMusicAssociation(ICMA).
30. T. TakalaandJ.Hahn.Soundrendering.InProceedingsofSIGGRAPH92, ComputerGraphicsProceedings,AnnualConferenceSeries,pages211–220,July1992.
31. D.TerzopoulosandK.Fleischer. Deformablemodels.TheVisualComputer, 4:306–331,1988.
32. B.Truax,editor.HandbookforAcousticEcology. CambridgeStreetPublishing,secondedition,1999.
33. K.vandenDoel,P. G.Kry, andD.K.Pai.Foley automatic:Physically-basedsoundeectsforinteractive simulationandanimation.InProceedingsof SIGGRAPH2001, August2001.
34. K.vandenDoelandD.K.Pai.Synthesisofshapedepen-dentsoundswithphysicalmodeling.InProceedingsoftheInternationalConferenceonAuditoryDisplay(ICAD), 1996.
35. K.vandenDoelandD.K.Pai.Thesoundsofphysicalshapes.Presence, 7(4):382–395,1998.
36. S.vanDuyneandJ. O.Smith.Physicalmodelingwiththe2Dwaveguidemesh.InProceedingsoftheInternationalCom-puterMusicConference(ICMC), pages40–47,TheHague,1993.InternationalComputerMusicAssociation(ICMA).
37. J. Wawrzynek.VLSImodelsforsoundsynthesis.InM.Math-ewsandJ.Pierce,editors,CurrentDirectionsinComputerMusicResearch, chapter10,pages113–148.MITPress,Cambridge,1989.