“Path graphs: iterative path space filtering” by Deng, Hašan, Carr, Xu and Marschner
Conference:
Type(s):
Title:
- Path graphs: iterative path space filtering
Session/Category Title: Samping and Denoising
Presenter(s)/Author(s):
Abstract:
To render higher quality images from the samples generated by path tracing with a low sample count, we propose a novel path reuse approach that processes a fixed collection of paths to iteratively refine and improve radiance estimates throughout the scene. Our method operates on a path graph consisting of the union of the traced paths with additional neighbor edges inserted among clustered nearby vertices. Our approach refines the initial noisy radiance estimates via an aggregation operator, treating vertices within clusters as independent sampling techniques that can be combined using MIS. In a novel step, we also introduce a propagation operator to forward the refined estimates along the paths to successive bounces. We apply the aggregation and propagation operations to the graph iteratively, progressively refining the radiance values, converging to fixed-point radiance estimates with lower variance than the original ones. We also introduce a decorrelation (final gather) step, which uses information already in the graph and is cheap to compute, allowing us to combine the method with standard denoisers. Our approach is lightweight, in the sense that it can be easily plugged into any standard path tracer and neural final image denoiser. Furthermore, it is independent of scene complexity, as the graph size only depends on image resolution and average path depth. We demonstrate that our technique leads to realistic rendering results starting from as low as 1 path per pixel, even in complex indoor scenes dominated by multi-bounce indirect illumination.
References:
1. Steve Bako, Thijs Vogels, Brian McWilliams, Mark Meyer, Jan Novák, Alex Harvill, Pradeep Sen, Tony Derose, and Fabrice Rousselle. 2017. Kernel-predicting convolutional networks for denoising Monte Carlo renderings. ACM Transactions on Graphics (TOG) 36, 4 (2017), 97.
2. Pablo Bauszat, Victor Petitjean, and Elmar Eisemann. 2017. Gradient-Domain Path Reusing. ACM Trans. Graph. 36, 6, Article 229 (Nov. 2017), 9 pages.
3. Philippe Bekaert, Mateu Sbert, and John Halton. 2002. Accelerating Path Tracing by Re-Using Paths. In Proceedings of the 13th Eurographics Workshop on Rendering (Pisa, Italy) (EGRW ’02). Eurographics Association, Goslar, DEU, 125–134.
4. Benedikt Bitterli, Jan Novák, and Wojciech Jarosz. 2015. Portal-Masked Environment Map Sampling. Computer Graphics Forum (Proceedings of EGSR) 34, 4 (June 2015).
5. Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 39, 4 (July 2020). https://doi.org/10/gg8xc7
6. Chakravarty R. Alla Chaitanya, Laurent Belcour, Toshiya Hachisuka, Simon Premoze, Jacopo Pantaleoni, and Derek Nowrouzezahrai. 2018. Matrix Bidirectional Path Tracing. In Proceedings of the Eurographics Symposium on Rendering: Experimental Ideas & Implementations (Karlsruhe, Germany) (SR ’18). Eurographics Association, Goslar, DEU, 23–32.
7. Chakravarty R Alla Chaitanya, Anton S Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder. ACM Transactions on Graphics (TOG) 36, 4 (2017), 98.
8. David Cline, Justin Talbot, and Parris Egbert. 2005. Energy redistribution path tracing. In ACM Transactions on Graphics (TOG), Vol. 24. ACM, 1186–1195.
9. Tomáš Davidovič, Jaroslav Křivánek, Miloš Hašan, Philipp Slusallek, and Kavita Bala. 2010. Combining global and local virtual lights for detailed glossy illumination. ACM Transactions on Graphics (TOG) 29, 6 (2010), 1–8.
10. Xi Deng, Shaojie Jiao, Benedikt Bitterli, and Wojciech Jarosz. 2019. Photon Surfaces for Robust, Unbiased Volumetric Density Estimation. ACM Trans. Graph. 38, 4, Article 46 (July 2019), 12 pages.
11. Luca Fascione, Johannes Hanika, Daniel Heckenberg, Christopher Kulla, Marc Droske, and Jorge Schwarzhaupt. 2019. Path Tracing in Production: Part 1: Modern Path Tracing. In ACM SIGGRAPH 2019 Courses (Los Angeles, California) (SIGGRAPH ’19). Association for Computing Machinery, New York, NY, USA, Article 19, 113 pages.
12. Iliyan Georgiev, Jaroslav Křivánek, Tomáš Davidovič, and Philipp Slusallek. 2012. Light Transport Simulation with Vertex Connection and Merging. ACM Trans. Graph. 31, 6, Article 192 (Nov. 2012), 10 pages.
13. Michaël Gharbi, Tzu-Mao Li, Miika Aittala, Jaakko Lehtinen, and Frédo Durand. 2019. Sample-based Monte Carlo denoising using a kernel-splatting network. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1–12.
14. Cindy M. Goral, Kenneth E. Torrance, Donald P. Greenberg, and Bennett Battaile. 1984. Modeling the Interaction of Light between Diffuse Surfaces. SIGGRAPH Comput. Graph. 18, 3 (Jan. 1984), 213–222.
15. Pascal Grittmann, Iliyan Georgiev, Philipp Slusallek, and Jaroslav Křivánek. 2019. Variance-Aware Multiple Importance Sampling. ACM Trans. Graph. 38, 6, Article 152 (Nov. 2019), 9 pages.
16. Toshiya Hachisuka, Shinji Ogaki, and Henrik Wann Jensen. 2008. Progressive photon mapping. In ACM Transactions on Graphics (TOG), Vol. 27. ACM, 130.
17. Toshiya Hachisuka, Jacopo Pantaleoni, and Henrik Wann Jensen. 2012. A Path Space Extension for Robust Light Transport Simulation. ACM Trans. Graph. 31, 6, Article 191 (Nov. 2012), 10 pages.
18. Pat Hanrahan and David Salzman. 1991. A rapid hierarchical radiosity algorithm. In Computer Graphics. 197–206.
19. Miloš Hašan, Jaroslav Křivánek, Bruce Walter, and Kavita Bala. 2009. Virtual spherical lights for many-light rendering of glossy scenes. In ACM SIGGRAPH Asia 2009 papers. 1–6.
20. Miloš Hašan, Fabio Pellacini, and Kavita Bala. 2007. Matrix row-column sampling for the many-light problem. In ACM SIGGRAPH 2007 papers. 26–es.
21. Heinrich Hey and Werner Purgathofer. 2002. Importance Sampling with Hemispherical Particle Footprints. In Proceedings of the 18th Spring Conference on Computer Graphics (Budmerice, Slovakia) (SCCG ’02). Association for Computing Machinery, New York, NY, USA, 107–114.
22. Intel. 2020. Intel Open Image Denoise. https://www.openimagedenoise.org.
23. Wenzel Jakob. 2010. Mitsuba renderer. http://www.mitsuba-renderer.org.
24. Wenzel Jakob, Christian Regg, and Wojciech Jarosz. 2011. Progressive expectation-maximization for hierarchical volumetric photon mapping. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 1287–1297.
25. H. Jensen. 1995. Importance Driven Path Tracing using the Photon Map. In Rendering Techniques.
26. Henrik Wann Jensen. 1996. Global illumination using photon maps. In Rendering Techniques’ 96. Springer, 21–30.
27. James T. Kajiya. 1986. The Rendering Equation. SIGGRAPH Comput. Graph. 20, 4 (Aug. 1986), 143–150.
28. Anton S Kaplanyan and Carsten Dachsbacher. 2013. Adaptive progressive photon mapping. ACM Transactions on Graphics (TOG) 32, 2 (2013), 16.
29. Ondřej Karlík, Martin Šik, Petr Vévoda, Tomáš Skřivan, and Jaroslav Křivánek. 2019. MIS Compensation: Optimizing Sampling Techniques in Multiple Importance Sampling. ACM Trans. Graph. 38, 6, Article 151 (Nov. 2019), 12 pages.
30. Alexander Keller. 1997. Instant radiosity. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques. 49–56.
31. Alexander Keller, Ken Dahm, and Nikolaus Binder. 2014. Path Space Filtering. In ACM SIGGRAPH 2014 Talks (Vancouver, Canada) (SIGGRAPH ’14). Association for Computing Machinery, New York, NY, USA, Article 68, 1 pages.
32. Alexander Keller, Ken Dahm, and Nikolaus Binder. 2016. Path Space Filtering. In Monte Carlo and Quasi-Monte Carlo Methods, Ronald Cools and Dirk Nuyens (Eds.). Springer International Publishing, Cham, 423–436.
33. Claude Knaus and Matthias Zwicker. 2011. Progressive photon mapping: A probabilistic approach. ACM Transactions on Graphics (TOG) 30, 3 (2011), 25.
34. Ivo Kondapaneni, Petr Vevoda, Pascal Grittmann, Tomáš Skřivan, Philipp Slusallek, and Jaroslav Křivánek. 2019. Optimal Multiple Importance Sampling. ACM Trans. Graph. 38, 4, Article 37 (July 2019), 14 pages.
35. Jaroslav Křivánek, Pascal Gautron, Sumanta Pattanaik, and Kadi Bouatouch. 2008. Radiance Caching for Efficient Global Illumination Computation. InACM SIGGRAPH 2008 Classes (Los Angeles, California) (SIGGRAPH ’08). Association for Computing Machinery, New York, NY, USA, Article 75, 19 pages.
36. Jaroslav Křivánek, Iliyan Georgiev, Toshiya Hachisuka, Petr Vévoda, Martin Šik, Derek Nowrouzezahrai, and Wojciech Jarosz. 2014. Unifying Points, Beams, and Paths in Volumetric Light Transport Simulation. ACM Trans. Graph. 33, 4, Article 103 (July 2014), 13 pages.
37. Eric P Lafortune and Yves Willems. 1993. Bi-directional path tracing. In Compugraphics’ 93. 145–153.
38. Thomas Müller, Markus Gross, and Jan Novák. 2017. Practical Path Guiding for Efficient Light-Transport Simulation. Computer Graphics Forum (Proceedings of EGSR) 36, 4 (June 2017), 91–100.
39. Jiawei Ou and Fabio Pellacini. 2011. LightSlice: Matrix Slice Sampling for the Many-Lights Problem. ACM Trans. Graph. 30, 6 (Dec. 2011), 1–8.
40. Mark Pauly, Thomas Kollig, and Alexander Keller. 2000. Metropolis light transport for participating media. In Rendering Techniques 2000. Springer, 11–22.
41. Hao Qin, Xin Sun, Qiming Hou, Baining Guo, and Kun Zhou. 2015. Unbiased Photon Gathering for Light Transport Simulation. ACM Trans. Graph. 34, 6, Article 208 (Oct. 2015), 14 pages.
42. Lars Schjøth, Jon Sporring, and O Fogh Olsen. 2008. Diffusion based photon mapping. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 2114–2127.
43. Benjamin Segovia, Jean Claude Iehl, Richard Mitanchey, and Bernard Péroche. 2006. Bidirectional Instant Radiosity.. In Rendering Techniques. 389–397.
44. Eric Veach. 1997. Robust Monte Carlo Methods for Light Transport Simulation. Ph.D. Dissertation. Stanford University.
45. Eric Veach and Leonidas Guibas. 1995a. Bidirectional Estimators for Light Transport. In Photorealistic Rendering Techniques (Proceedings of the Fifth EUROGRAPHICS Workshop on Rendering), Georgios Sakas, Stefan Müller, and Peter Shirley (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 145–167.
46. Eric Veach and Leonidas J Guibas. 1995b. Optimally combining sampling techniques for Monte Carlo rendering. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. ACM, 419–428.
47. Jiří Vorba, Ondřej Karlík, Martin Šik, Tobias Ritschel, and Jaroslav Křivánek. 2014. On-line Learning of Parametric Mixture Models for Light Transport Simulation. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2014) 33, 4 (aug 2014).
48. Bruce Walter, Adam Arbree, Kavita Bala, and Donald P Greenberg. 2006. Multidimensional lightcuts. In ACM SIGGRAPH 2006 Papers. 1081–1088.
49. Bruce Walter, Pramook Khungurn, and Kavita Bala. 2012. Bidirectional Lightcuts. ACM Trans. Graph. 31, 4, Article 59 (July 2012), 11 pages.
50. Bruce Walter, Stephen R Marschner, Hongsong Li, and Kenneth E Torrance. 2007. Microfacet Models for Refraction through Rough Surfaces. In Proceedings of EGSR 2007.
51. Beibei Wang, Jing Huang, Bert Buchholz, Xiangxu Meng, and Tamy Boubekeur. 2013. Factorized Point-Based Global Illumination. Computer Graphics Forum (Special Issue on EGSR 2013) 32, 4 (2013), 117–123.
52. Gregory J. Ward, Francis M. Rubinstein, and Robert D. Clear. 1988. A Ray Tracing Solution for Diffuse Interreflection. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’88). Association for Computing Machinery, New York, NY, USA, 85–92.
53. Rex West, Iliyan Georgiev, Adrien Gruson, and Toshiya Hachisuka. 2020. Continuous Multiple Importance Sampling. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 39, 4 (July 2020).
54. Shilin Zhu, Zexiang Xu, Henrik Wann Jensen, Hao Su, and Ravi Ramamoorthi. 2020. Deep Kernel Density Estimation for Photon Mapping. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 35–45.
55. Matthias Zwicker, Wojciech Jarosz, Jaakko Lehtinen, Bochang Moon, Ravi Ramamoorthi, Fabrice Rousselle, Pradeep Sen, Cyril Soler, and S-E Yoon. 2015. Recent advances in adaptive sampling and reconstruction for Monte Carlo rendering. In Computer Graphics Forum, Vol. 34. Wiley Online Library, 667–681.
