“Temporal gradient-domain path tracing”
Conference:
Type(s):
Title:
- Temporal gradient-domain path tracing
Session/Category Title: All About Sampling
Presenter(s)/Author(s):
Abstract:
We present a novel approach to improve temporal coherence in Monte Carlo renderings of animation sequences. Unlike other approaches that exploit temporal coherence in a post-process, our technique does so already during sampling. Building on previous gradient-domain rendering techniques that sample finite differences over the image plane, we introduce temporal finite differences and formulate a corresponding 3D spatio-temporal screened Poisson reconstruction problem that is solved over windowed batches of several frames simultaneously. We further extend our approach to include second order, mixed spatio-temporal differences, an improved technique to compute temporal differences exploiting motion vectors, and adaptive sampling. Our algorithm can be built on a gradient-domain path tracer without large modifications. In particular, we do not require the ability to evaluate animation paths over multiple frames. We demonstrate that our approach effectively reduces temporal flickering in animation sequences, significantly improving the visual quality compared to both path tracing and gradient-domain rendering of individual frames.
References:
1. Bonneel, N., Sunkavalli, K., Tompkin, J., Sun, D., Paris, S., and Pfister, H. 2014. Interactive intrinsic video editing. ACM Trans. Graph. 33, 6 (Nov.), 197:1–197:10.
2. Bonneel, N., Tompkin, J., Sunkavalli, K., Sun, D., Paris, S., and Pfister, H. 2015. Blind video temporal consistency. ACM Trans. Graph. 34, 6 (Oct.), 196:1–196:9.
3. Chen, S. E. 1990. Incremental radiosity: An extension of progressive radiosity to an interactive image synthesis system. SIGGRAPH Comput. Graph. 24, 4 (Sept.), 135–144.
4. Goral, C. M., Torrance, K. E., Greenberg, D. P., and Battaile, B. 1984. Modeling the interaction of light between diffuse surfaces. SIGGRAPH Comput. Graph. 18, 3 (Jan.), 213–222.
5. Havran, V., Damez, C., Myszkowski, K., and Seidel, H.-P. 2003. An efficient spatio-temporal architecture for animation rendering. In Proceedings of the 14th Eurographics Workshop on Rendering, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, EGRW ’03, 106–117.
6. Kelemen, C., Szirmay-Kalos, L., Antal, G., and Csonka, F. 2002. A simple and robust mutation strategy for the metropolis light transport algorithm. Computer Graphics Forum 21, 3, 531–540. Cross Ref
7. Keller, A., Fascione, L., Fajardo, M., Georgiev, I., Christensen, P., Hanika, J., Eisenacher, C., and Nichols, G. 2015. The path tracing revolution in the movie industry. In ACM SIGGRAPH 2015 Courses, ACM, New York, NY, USA, SIGGRAPH ’15, 24:1–24:7.
8. Kettunen, M., Manzi, M., Aittala, M., Lehtinen, J., Durand, F., and Zwicker, M. 2015. Gradient-domain path tracing. ACM Trans. Graph. 34, 4 (July), 123:1–123:13.
9. Lehtinen, J., Karras, T., Laine, S., Aittala, M., Durand, F., and Aila, T. 2013. Gradient-domain metropolis light transport. ACM Trans. Graph. 32, 4 (July), 95:1–95:12.
10. Li, T.-M., Wu, Y.-T., and Chuang, Y.-Y. 2012. Sure-based optimization for adaptive sampling and reconstruction. ACM Trans. Graph. 31, 6 (Nov.), 194:1–194:9.
11. Manzi, M., Rousselle, F., Kettunen, M., Lehtinen, J., and Zwicker, M. 2014. Improved sampling for gradient-domain metropolis light transport. ACM Trans. Graph. 33, 6 (Nov.), 178:1–178:12.
12. Manzi, M., Kettunen, M., Aittala, M., Lehtinen, J., Durand, F., and Zwicker, M. 2015. Gradient-domain bidirectional path tracing. In Proc. Eurographics Symposium on Rendering.
13. McCool, M. D. 1999. Anisotropic diffusion for monte carlo noise reduction. ACM Trans. Graph. 18, 2 (Apr.), 171–194.
14. Meyer, M., and Anderson, J. 2006. Statistical acceleration for animated global illumination. ACM Trans. Graph. 25, 3 (July), 1075–1080.
15. Moon, B., Carr, N., and Yoon, S.-E. 2014. Adaptive rendering based on weighted local regression. ACM Trans. Graph. 33, 5 (Sept.), 170:1–170:14.
16. Nimeroff, J., Dorsey, J., and Rushmeier, H. 1996. Implementation and analysis of an image-based global illumination framework for animated environments. IEEE Transactions on Visualization and Computer Graphics 2, 4 (Dec.), 283–298.
17. Olshausen, B., and Field, D. 1996. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607–609. Cross Ref
18. Rousselle, F., Manzi, M., and Zwicker, M. 2013. Robust denoising using feature and color information. Computer Graphics Forum 32, 7, 121–130. Cross Ref
19. Rushmeier, H. E., and Ward, G. J. 1994. Energy preserving non-linear filters. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’94, 131–138.
20. Scherzer, D., Yang, L., Mattausch, O., Nehab, D., Sander, P. V., Wimmer, M., and Eisemann, E. 2012. Temporal coherence methods in real-time rendering. Computer Graphics Forum 31, 8, 2378–2408.
21. Sen, P., and Darabi, S. 2012. On filtering the noise from the random parameters in monte carlo rendering. ACM Trans. Graph. 31, 3 (June), 18:1–18:15.
22. Smyk, M., Kinuwaki, S.-i., Durikovic, R., and Myszkowski, K. 2005. Temporally coherent irradiance caching for high quality animation rendering. Computer Graphics Forum 24, 3, 401–412. Cross Ref
23. Tawara, T., Myszkowski, K., and Seidel, H.-P. 2004. Exploiting temporal coherence in final gathering for dynamic scenes. In Proc. Computer Graphics International, 2004, 110–119.
24. Veach, E., and Guibas, L. J. 1997. Metropolis light transport. In Proc. of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH ’97, 65–76.
25. Ward, G. J., Rubinstein, F. M., and Clear, R. D. 1988. A ray tracing solution for diffuse interreflection. SIGGRAPH Comput. Graph. 22, 4 (June), 85–92.
26. Zimmer, H., Rousselle, F., Jakob, W., Wang, O., Adler, D., Jarosz, W., Sorkine-Hornung, O., and Sorkine-Hornung, A. 2015. Path-space motion estimation and decomposition for robust animation filtering. Computer Graphics Forum 34, 4, 131–142.
27. Zwicker, M., Jarosz, W., Lehtinen, J., Moon, B., Ramamoorthi, R., Rousselle, F., Sen, P., Soler, C., and Yoon, S.-E. 2015. Recent advances in adaptive sampling and reconstruction for monte carlo rendering. Computer Graphics Forum 34, 2, 667–681.
