“Example-based turbulence style transfer” by Sato, Dobashi, Kim and Nishita
Conference:
Type:
Entry Number: 84
Title:
- Example-based turbulence style transfer
Session/Category Title: Fluids 1: Raiders of the Lost Volume
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Generating realistic fluid simulations remains computationally expensive, and animators can expend enormous effort trying to achieve a desired motion. To reduce such costs, several methods have been developed in which high-resolution turbulence is synthesized as a post process. Since global motion can then be obtained using a fast, low-resolution simulation, less effort is needed to create a realistic animation with the desired behavior. While much research has focused on accelerating the low-resolution simulation, the problem controlling the behavior of the turbulent, high-resolution motion has received little attention. In this paper, we show that style transfer methods from image editing can be adapted to transfer the turbulent style of an existing fluid simulation onto a new one. We do this by extending example-based image synthesis methods to handle velocity fields using a combination of patch-based and optimization-based texture synthesis. This approach allows us to take into account the incompressibility condition, which we have found to be a important factor during synthesis. Using our method, a user can easily and intuitively create high-resolution fluid animations that have a desired turbulent motion.
References:
1. Adam Wade Bargteil. 2006. Tracking and texturing liquid surfaces. Ph.D. Dissertation. University of California, Berkeley.Google Scholar
2. Connelly Barnes and Fang-Lue Zhang. 2017. A survey of the state-of-the-art in patch-based synthesis. Computational Visual Media 3, 1 (2017), 3–20.Google ScholarCross Ref
3. Robert Bridson. 2015. Fluid simulation for computer graphics. CRC Press.Google ScholarDigital Library
4. Robert Bridson, Jim Hourihan, and Marcus Nordenstam. 2007. Curl-noise for procedural fluid flow. ACM Transactions on Graphics 26, 3 (2007), Article 46. Google ScholarDigital Library
5. M. Chu and N. Thuerey. 2017. Data-Driven Synthesis of Smoke Flows with CNN-based Feature Descriptors. ACM Transactions on Graphics 36, 4 (2017), Article 14. Google ScholarDigital Library
6. R. Fedkiw, J. Stam, and H. W. Jansen. 2001. Visual Simulation of Smoke. In Proceedings of ACM SIGGRAPH 2001. 15–22. Google ScholarDigital Library
7. James Gregson, Ivo Ihrke, Nils Thuerey, and Wolfgang Heidrich. 2014. From Capture to Simulation: Connecting Forward and Inverse Problems in Fluids. ACM Trans. Graph. 33, 4, Article 139 (July 2014), 11 pages. Google ScholarDigital Library
8. T. Inglis, M.-L. Eckert, J. Gregson, and N. Thuerey. 2017. Primal-Dual Optimization for Fluids. Computer Graphics Forum 36, 8 (2017), 354–368.Google ScholarCross Ref
9. Wenzel Jakob. 2010. Mitsuba renderer. (2010). http://www.mitsuba-renderer.org.Google Scholar
10. O. Jamriska, J. Fiser, P. Asente, J. Lu, E. Shechtman, and D. Sykora. 2015. LazyFluids: appearance transfer for fluid animations. ACM Transactions on Graphics 34, 4 (2015), Article 92. Google ScholarDigital Library
11. Doyub Kim. 2017. Fluid Engine Development. CRC Press.Google Scholar
12. Theodore Kim, Nils Thurey, Doug James, and Markus Gross. 2008. Wavelet turbulence for fluid simulation. ACM Transactions on Graphics 27, 3 (2008), Article 3. Google ScholarDigital Library
13. Vivek Kwatra, David Adalsteinsson, Theodore Kim, Nipun Kwatra, Mark Carlson, and Ming C. Lin. 2007. Texturing fluids. IEEE Transactions on Visualization and Computer Graphics 13, 5 (2007), 939–952. Google ScholarDigital Library
14. Vivek Kwatra, Irfan Essa, Aaron Bobick, and Nipun Kwatra. 2005. Texture optimization for example-based synthesis. ACM Transactions on Graphics 24, 3 (2005), 795–802. Google ScholarDigital Library
15. Ares Lagae, Sylvain Lefebvre, Rob Cook, Tony DeRose, George Drettakis, David S Ebert, John P Lewis, Ken Perlin, and Matthias Zwicker. 2010. A survey of procedural noise functions. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 2579–2600.Google Scholar
16. C. Ma, L. Wei, B. Guo, and K. Zhou. 2009. Motion field texture synthesis. ACM Transactions on Graphics 28, 5 (2009), Article 110. Google ScholarDigital Library
17. Rahul Narain, Vivek Kwatra, Huai-Ping Lee, Theodore Kim, Mark Carlson, and Ming C. Lin. 2007. Feature-guided dynamic texture synthesis on continuous flows. In Proceedings of the 18th Eurographics conference on Rendering Techniques. 361–370. Google ScholarDigital Library
18. R. Narain, J. Sewall, M. Carlson, and M. C. Lin. 2008. Fast animation of turbulence using energy transport and procedural synthesis. ACM Transactions on Graphics 27, 5 (2008), Article 166. Google ScholarDigital Library
19. Michael B. Nielsen and Brian B. Christensen. 2010. Improved Variational Guiding of Smoke Animations. Computer Graphics Forum 29, 2 (2010), 705–712.Google ScholarCross Ref
20. Michael B. Nielsen, Brian B. Christensen, Nafees Bin Zafar, Doug Roble, and Ken Museth. 2009. Guiding of smoke animations through variational coupling of simulations at different resolutions. In Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 217–226. Google ScholarDigital Library
21. T. Pfaff, N. Thuerey, A. Selle, and M. Gross. 2009. Synthetic turbulence using artificial boundary layers. ACM Transactions on Graphics 28, 5 (2009), Article 121. Google ScholarDigital Library
22. Michael Rabinovich, Roi Poranne, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Scalable Locally Injective Mappings. ACM Trans. Graph. 36, 2, Article 16 (April 2017), 16 pages. Google ScholarDigital Library
23. S. Sato, Y. Dobashi, and T. Nishita. 2016. A combining method of fluid animations by interpolating flow fields. In Proceedings of SIGGRAPH Asia 2016 Technical Briefs. Article 4. Google ScholarDigital Library
24. S. Sato, T. Morita, Y. Dobashi, , and T. Yamamoto. 2012. A data-driven approach for synthesizing high-resolution animation of fire. In Proceedings of the Digital Production Symposium 2012. 37–42. Google ScholarDigital Library
25. H. Schechter and R. Bridson. 2008. Evolving sub-grid turbulence for smoke animation. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 1–7. Google ScholarDigital Library
26. Arno Schödl, Richard Szeliski, David H. Salesin, and Irfan Essa. 2000. Video Textures. In Proceedings of ACM SIGGRAPH 2000. 489–498. Google ScholarDigital Library
27. Jos Stam. 1999. Stable Fluids. In Proceedings of ACM SIGGRAPH 1999, Annual Conference Series. 121–128. Google ScholarDigital Library
28. Nils Thuerey, Theodore Kim, and Tobias Pfaff. 2013. Turbulent Fluids. In Proceedings of SIGGRAPH ’13 ACM SIGGRAPH 2013 Courses. Article No. 6. Google ScholarDigital Library
29. Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the Art in Example-based Texture Synthesis. In Eurographics 2009, State of the Art Report, EG-STAR. Eurographics Association. http://www-sop.inria.fr/reves/Basilic/2009/WLKT09Google Scholar
