“An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs” by Dobashi, Iwasaki, Ono, Yamamoto, Yue, et al. …
Conference:
Type(s):
Title:
- An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs
Session/Category Title: Materials and Images
Presenter(s)/Author(s):
Abstract:
Clouds play an important role in creating realistic images of outdoor scenes. Many methods have therefore been proposed for displaying realistic clouds. However, the realism of the resulting images depends on many parameters used to render them and it is often difficult to adjust those parameters manually. This paper proposes a method for addressing this problem by solving an inverse rendering problem: given a non-uniform synthetic cloud density distribution, the parameters for rendering the synthetic clouds are estimated using photographs of real clouds. The objective function is defined as the difference between the color histograms of the photograph and the synthetic image. Our method searches for the optimal parameters using genetic algorithms. During the search process, we take into account the multiple scattering of light inside the clouds. The search process is accelerated by precomputing a set of intermediate images. After ten to twenty minutes of precomputation, our method estimates the optimal parameters within a minute.
References:
1. Bonneel, N., Paris, S., Panne, M. V. D., Durand, F., and Drettakis, G. 2009. Single photo estimation of hair appearance. Computer Graphics Forum 28, 4, 1171–1180.
2. Bouthors, A., Neyret, F., Max, N., Bruneton, E., and Crassin, C. 2008. Interactive multiple anisotropic scattering in clouds. In Proceedings of ACM Symposium on Interactive 3D Graphics and Games, 173–182.
3. Cerezo, E., Perez, F., Pueyo, X., Seron, F. J., and Sillion, F. X. 2005. A survey on participating media rendering techniques. The Visual Computer 21, 5, 303–328.
4. Davis, A. B., and Marshak, A. 2010. Solar radiation transport in cloudy atmosphere: a 3D perspective on observations and climate impacts. Reports on Progress in Physics 73, 2.
5. Dobashi, Y., Kusumoto, K., Nishita, T., and Yamamoto, T. 2008. Feedback control of cumuliform cloud formation based on computational fluid dynamics. ACM Transactions on Graphics 27, 3, Article 94.
6. Dobashi, Y., Shinzo, Y., and Yamamoto, T. 2010. Modeling of clouds from a single photograph. Computer Graphics Forum 29, 7, 2083–2090.
7. Ebert, D. S., Musgrave, F. K., Peachey, D., and Perlin, K. 2009. Texturing and Modeling: A Procedural Approach Third Edition. Morgan Kaufmann.
8. Fattal, R. 2008. Single image dehazing. ACM Transactions on Graphics 27, 3, Article 72.
9. Goldberg, D. E. 1989. Genetic Algorithms in Search, Optimization and Machine Lerning. Addison-Wesley Professional.
10. Harris, M. J., and Lastra, A. 2001. Real-time cloud rendering. Computer Graphics Forum 20, 3, 76–84.
11. Hubball, D., Chen, M., and Grant, P. 2008. Image-based aging using evolutionary computing. Computer Graphics Forum 27, 2, 607–616.
12. Jensen, H. W., and Christensen, P. H. 1998. Efficient simulation of light transport in scenes with participating media using photon maps. In Proceedings of ACM SIGGRAPH 1998, 311–320.
13. Katz, A., and Thrift, P. 1994. Generating image filters for target recognition by genetic learning. PAMI 16, 9, 906–910.
14. Kawai, J. K., Painter, J. S., and Cohen, M. F. 1993. Radioptimization — goal based rendering. In Proc. ACM SIGGRAPH 1993, 147–154.
15. Kienle, A., Lilge, L., Patterson, M. S., Hibst, R., Steiner, R., and Wilson, B. C. 1996. Spatially resolved absolute diffuse reflectance measurements for noninvasive determination of the optical scattering and absorption coefficients of biological tissue. Applied Optics 35, 13.
16. Lalonde, J.-F., Efros, A. A., and Narasimhan, S. G. 2012. Estimating natural illumination from a single outdoor image. International Journal on Computer Vision 98, 2, 123–145.
17. Li, H., and Yang, C. Y. 1997. A genetic algorithm for inverse radiation problems. International Journal of Heat and Mass Transfer 40, 7, 1545–1549.
18. Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., and Shieber, S. 1997. Design galleries: A general approach to setting parametes for computer graphics and animation. In Proc. ACM SIGGRAPH 1997, 380–400.
19. Miyazaki, R., Dobashi, Y., and Nishita, T. 2002. Simulation of cumuliform clouds based on computational fluid dynamics. In Proceedings of EUROGRAPHICS 2002 Short Presentations, 405–410.
20. Munoz, A., Masia, B., Tolosa, A., and Gutierrez, D. 2009. Single-image appearance acquisition using genetic algorithms. In Proceedings of Computer Graphics, Visualization, Computer Vision and Image Processing 2009, 24–32.
21. Munoz, A., Echevarria, J. I., Lopez-Moreno, J., Seron, F., Glencross, M., and Gutierrez, D. 2011. BSSRDF estimation from single images. Computer Graphics Forum 30, 2, 455–464.
22. Nishita, T., Dobashi, Y., and Nakamae, E. 1996. Display of clouds taking into account multiple anisotropic scattering and sky light. In Proceedings of ACM SIGGRAPH 1996, 379–386.
23. Otsu, N. 1979. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man and Cybemetics 9, 1, 62–66.
24. Pellacini, F., Battaglia, F., Morley, R. K., and Finkelstein, A. 2007. Lighting with paint. ACM Transactions on Graphics 26, 2, Article 9.
25. Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3, 313–318.
26. Premoze, S., Ashikhmin, M., Tessendorf, J., Ramamoorthi, R., and Nayar, S. 2004. Practical rendering of multiple scattering effects in participating media. In Proc. Eurographics Symposium on Rendering, 52–63.
27. Reinhard, E., Ashikhimin, M., Gooch, B., and Shirley, P. 2001. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34–41.
28. Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In Proc. ACM SIGGRAPH 1993, 143–146.
29. Schpok, J., Simons, J., Ebert, D. S., and Hansen, C. 2003. A real-time cloud modeling, rendering, and animation system. In Proceedings of Symposium on Computer Animation 2005, 160–166.
30. Sims, K. 1991. Artificial evolution for computer graphics. In Proc. ACM SIGGRAPH 1991, 319–328.
31. Sitthi-Amorn, P., Modly, N., Weimer, W., and Lawrence, J. 2011. Genetic programming for shader simplification. ACM Transactions on Graphics 30, 6, Article 152.
32. Snyman, J. 2005. Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms (Applied Optimization). Springer.
33. Stam, J. 1995. Multiple scattering as a diffusion process. In Proc. Eurographics Workshop on Rendering, 41–50.
34. Tao, L., Yuan, L., and Sun, J. 2009. Skyfinder: Attribute-based sky image search. ACM Transactions on Graphics 28, 3, Article 68.
35. Wang, J., Zhao, S., Tong, X., Lin, S., Lin, Z., Dong, Y., Guo, B., and Shum, H.-Y. 2008. Modeling and rendering of heterogeneous translucent materials using the diffusion equation. ACM Transactions on Graphics 27, 1, Article 9.
36. Yue, Y., Iwasaki, K., Chen, B.-Y., Dobashi, Y., and Nishita, T. 2010. Unbiased, adaptive stochastic sampling for rendering inhomogeneous participating media. ACM Transactions on Graphics 29, 6, Article 177.
37. Zhang, R., Verkruysse, W., Choi, B., Viator, J., Jung, B., Svaasand, L., Aguilar, G., and Nelson, J. 2005. Determination of human skin optical properties from spectrophotometric measurements based on optimization by genetic algorithms. Journal of Biomedical Optics 10, 2.
38. Zhou, K., Ren, Z., Lin, S., Bao, H., Guo, B., and Shum, H.-Y. 2008. Real-time smoke rendering using compensated ray marching. ACM Transactions on Graphics 27, 3, Article 36.
