“Animating fire with sound” by Chadwick and James

We propose a practical method for synthesizing plausible fire sounds that are synchronized with physically based fire animations. To enable synthesis of combustion sounds without incurring the cost of time-stepping fluid simulations at audio rates, we decompose our synthesis procedure into two components. First, a low-frequency flame sound is synthesized using a physically based combustion sound model driven with data from a visual flame simulation run at a relatively low temporal sampling rate. Second, we propose two bandwidth extension methods for synthesizing additional high-frequency flame sound content: (1) spectral bandwidth extension which synthesizes higher-frequency noise matching combustion sound spectra from theory and experiment; and (2) data-driven texture synthesis to synthesize high-frequency content based on input flame sound recordings. Various examples and comparisons are presented demonstrating plausible flame sounds, from small candle flames to large flame jets.

1. Abugov, D. I., and Obrezkov, O. I. 1978. Acoustic noise in turbulent flames. Combustion, Explosion, and Shock Waves 14, 606–612.Google ScholarCross Ref
2. Annadana, R., EV, H., Sinha, D., and Ferreira, A. 2007. A Novel Audio Post-Processing Toolkit for the Enhancement of Audio Signals Coded at Low Bit Rates. In AES 123rd Convention, New York, NY, USA, 2007 October 58.Google Scholar
3. Bridson, R., Hourihim, J., and Nordenstam, M. 2007. Curl-noise for procedural fluid flow. ACM Transactions on Graphics 26, 3 (July). Google ScholarDigital Library
4. Burt, P. J., and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics 2, 4 (Oct.), 217–236. Google ScholarDigital Library
5. Cardle, M., Brooks, S., Bar-Joseph, Z., and Robinson, P. 2003. Sound-by-numbers: motion-driven sound synthesis. In 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 349–356. Google ScholarDigital Library
6. Chrighton, D. G., Dowling, A. P., Williams, J. E. F., Heckl, M., and Leppington, F. G. 1992. Modern Methods in Analytical Acoustics. Springer-Verlag.Google Scholar
7. Clavin, P., and Siggia, E. D. 1991. Turbulent premixed flames and sound generation. Combustion Science and Technology 78, 147–155.Google ScholarCross Ref
8. Cook, P. R. 2002. Sound Production and Modeling. IEEE Computer Graphics & Applications 22, 4 (July/Aug.), 23–27. Google ScholarDigital Library
9. Dobashi, Y., Yamamoto, T., and Nishita, T. 2003. Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics. ACM Transactions on Graphics 22, 3 (July), 539–545. Google ScholarDigital Library
10. Dobashi, Y., Yamamoto, T., and Nishita, T. 2004. Synthesizing sound from turbulent fields using sound textures for interactive fluid simulation. Computer Graphics Forum 23, 3 (Sept.), 736–744.Google ScholarCross Ref
11. Dubnov, S., Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2002. Synthesizing sound textures through wavelet tree learning. Computer Graphics and Applications, IEEE 22, 4, 38–48. Google Scholar
12. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 341–346. Google Scholar
13. Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, vol. 2, IEEE, 1033–1038. Google ScholarDigital Library
14. Fedkiw, R., Stam, J., and Jensen, H. W. 2001. Visual simulation of smoke. In Proceedings of SIGGRAPH 2001, ACM Press/ACM SIGGRAPH, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, ACM, 15–22. Google Scholar
15. Feldman, B. E., O’Brien, J. F., and Arikan, O. 2003. Animating suspended particle explosions. In Proceedings of SIGGRAPH 2003, 708–715. Google Scholar
16. Foster, N., and Metaxas, D. 1997. Modeling the motion of a hot, turbulent gas. In Proc. of SIGGRAPH 1997, 181–188. Google ScholarDigital Library
17. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proc. of SIGGRAPH 1995, 229–238. Google Scholar
18. Hong, J.-M., Shinar, T., and Fedkiw, R. 2007. Wrinkled flames and cellular patterns. ACM Transactions on Graphics 26, 3 (July), 47:1–47:6. Google ScholarDigital Library
19. Horvath, C., and Geiger, W. 2009. Directable, High-Resolution Simulation of Fire on the GPU. ACM Transactions on Graphics 28, 3 (July), 41:1–41:8. Google ScholarDigital Library
20. Howe, M. S. 2003. Theory of Vortex Sound. Cambridge University Press.Google Scholar
21. Ihme, M., Pitsch, H., and Bodony, D. 2009. Radiation of noise in turbulent non-premixed flames. In Proceedings of the Combustion Institute, vol. 32, 1545–1553.Google ScholarCross Ref
22. Kim, T., Thürey, N., James, D., and Gross, M. 2008. Wavelet turbulence for fluid simulation. ACM Transactions on Graphics 27, 3 (Aug.), 50:1–50:6. Google ScholarDigital Library
23. Larsen, E., and Aarts, R. 2004. Audio bandwidth extension: application of psychoacoustics, signal processing and loudspeaker design. Wiley. Google Scholar
24. Liu, C., Lee, W., and Hsu, H. 2003. High frequency reconstruction for band-limited audio signals. Proc. DAFX-03, Sept.Google Scholar
25. Lorenson, W. E., and Cline, H. E. 1987. Marching cubes: A high resolution 3d surface construction algorithm. In Proceedings of SIGGRAPH 1987, 163–169. Google Scholar
26. Marelli, D., Aramaki, M., Kronland-Martinet, R., and Verron, C. 2010. Time-frequency synthesis of noisy sounds with narrow spectral components. IEEE Transactions on Audio, Speech and Language Processing 18, 8 (Nov.), 399–414. Google ScholarCross Ref
27. McDermott, J., Oxenham, A., and Simoncelli, E. 2009. Sound texture synthesis via filter statistics. In Applications of Signal Processing to Audio and Acoustics, 2009. WASPAA’09. IEEE Workshop on, IEEE, 297–300.Google Scholar
28. Mitchell, D. P., and Netravali, A. N. 1988. Reconstruction filters in computer-graphics. In Proceedings of SIGGRAPH 1988, 221–228. Google Scholar
29. Moss, W., Yeh, H., mo Hong, J., Lin, M. C., and Manocha, D. 2010. Sounding liquids: Automatic sound synthesis from fluid simulation. ACM Transactions on Graphics 29, 3 (June), 21:1–21:13. Google ScholarDigital Library
30. Nguyen, D. Q., Fedkiw, R., and Jensen, H. W. 2002. Physically based modeling and animation of fire. ACM Transactions on Graphics 21, 3 (July), 721–728. Google ScholarDigital Library
31. O’Brien, J. F., Cook, P. R., and Essl, G. 2001. Synthesizing sounds from physically based motion. In Proceedings of SIGGRAPH 2001, 529–536. Google Scholar
32. O’Brien, J. F., Shen, C., and Gatchalian, C. M. 2002. Synthesizing sounds from rigid-body simulations. In ACM SIGGRAPH Symposium on Computer Animation (SCA), 175–181. Google Scholar
33. Rajaram, R., and Lieuwen, T. 2009. Acoustic radiation from turbulent premixed flames. Journal of Fluid Mechanics 637, 357–385.Google ScholarCross Ref
34. Roads, C. 2004. Microsound. The MIT Press. Google Scholar
35. Schwarz, A., and Janicka, J., Eds. 2009. Combustion Noise. Springer.Google Scholar
36. Serra, X., and Smith III, J. 1990. Spectral modeling synthesis: A sound analysis/synthesis system based on a deterministic plus stochastic decomposition. Comp. Music Journal 14, 4, 12–24.Google ScholarCross Ref
37. Strahle, W. C. 1972. Some results in combustion generated noise. Journal of Sound and Vibration 43, 1, 113–125.Google ScholarCross Ref
38. Strobl, G., Eckel, G., Rocchesso, D., and le Grazie, S. 2006. Sound texture modeling: A survey. In Proceedings of the 2006 Sound and Music Computing (SMC) International Conference, 61–5.Google Scholar
39. van den Doel, K., Kry, P. G., and Pai, D. K. 2001. Foleyautomatic: Physically based sound effects for interactive simulation and animation. In Proceedings of SIGGRAPH 2001, 537–544. Google Scholar
40. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000, 479–488. Google Scholar
41. Zheng, C., and James, D. L. 2009. Harmonic fluids. ACM Transactions on Graphics 28, 3 (Aug.). Google ScholarDigital Library
42. Zheng, C., and James, D. L. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM Transactions on Graphics 29, 3 (July). Google ScholarDigital Library
43. Zölzer, U., and Amatriain, X. 2002. DAFX: Digital Audio Effects. John Wiley & Sons Inc. Google ScholarDigital Library