“Decorrelating ReSTIR Samplers via MCMC Mutations”
Conference:
Type(s):
Title:
- Decorrelating ReSTIR Samplers via MCMC Mutations
Presenter(s)/Author(s):
Abstract:
We demonstrate how interleaving Markov Chain Monte Carlo mutations with reservoir resampling helps alleviate correlation issues in ReSTIR, especially in scenes with glossy materials and difficult lighting. Our approach is free from bias, and can provide considerable improvement in image quality with just a single mutation per reservoir sample.
References:
[1]
Pontus Andersson, Jim Nilsson, Tomas Akenine-M?ller, Magnus Oskarsson, Kalle ?str?m, and Mark D. Fairchild. 2020. FLIP: A difference evaluator for alternating images. Proc. ACM Comput. Graph. Interact. Tech. 3, 2 (2020), 23 pages. DOI:
[2]
Thomas Bashford-Rogers, Lu?s Paulo Santos, Demetris Marnerides, and Kurt Debattista. 2021. Ensemble metropolis light transport. ACM Transactions on Graphics 41, 1 (2021), 1?15.
[3]
Benedikt Bitterli. 2022. Correlations and Reuse for Fast and Accurate Physically Based Light Transport. Dartmouth College Ph.D Dissertations. Retrieved from https://digitalcommons.dartmouth.edu/dissertations/77
[4]
Benedikt Bitterli, Wenzel Jakob, Jan Nov?k, and Wojciech Jarosz. 2017. Reversible jump Metropolis light transport using inverse mappings. ACM Transactions on Graphics 37, 1 (2017), 1?12.
[5]
Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal reservoir resampling for real-time ray tracing with dynamic direct lighting. ACM Transactions on Graphics 39, 4 (2020), 148?1.
[6]
Olivier Capp?, Arnaud Guillin, Jean-Michel Marin, and Christian P. Robert. 2004. Population Monte Carlo. Journal of Computational and Graphical Statistics 13, 4 (2004), 907?929.
[7]
Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder. ACM Transactions on Graphics 36, 4 (2017), 1?12.
[8]
Min-Te Chao. 1982. A general purpose unequal probability sampling plan. Biometrika 69, 3 (1982), 653?656.
[9]
David Cline, Justin Talbot, and Parris Egbert. 2005. Energy redistribution path tracing. ACM Transactions on Graphics 24, 3 (2005), 1186?1195.
[10]
Carsten Dachsbacher, Jaroslav K?iv?nek, Milo? Ha?an, Adam Arbree, Bruce Walter, and Jan Nov?k. 2014. Scalable realistic rendering with many-light methods. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 88?104.
[11]
Pierre Del Moral, Arnaud Doucet, and Ajay Jasra. 2006. Sequential Monte Carlo samplers. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68, 3 (2006), 411?436.
[12]
Arnaud Doucet, Nando De Freitas, Neil James Gordon, et al. 2001. Sequential Monte Carlo Methods in Practice. Springer.
[13]
ShaoHua Fan, Yu-Chi Lai, Stephen Chenney, and Charles Dyer. 2007. Population Monte Carlo Samplers for Rendering. Technical Report. University of Wisconsin-Madison Department of Computer Sciences.
[14]
Iliyan Georgiev and Marcos Fajardo. 2016. Blue-noise dithered sampling. In Proceedings of the ACM SIGGRAPH 2016 Talks. 1?1.
[15]
Abhijeet Ghosh, Arnaud Doucet, and Wolfgang Heidrich. 2006. Sequential sampling for dynamic environment map illumination. In Proceedings of the Rendering Techniques. 115?126.
[16]
Adrien Gruson, Rex West, and Toshiya Hachisuka. 2020. Stratified Markov Chain Monte Carlo light transport. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 351?362.
[17]
Toshiya Hachisuka and Henrik Wann Jensen. 2009. Stochastic progressive photon mapping. In ACM SIGGRAPH Asia 2009 papers. 1?8.
[18]
Toshiya Hachisuka, Anton S. Kaplanyan, and Carsten Dachsbacher. 2014. Multiplexed Metropolis light transport. ACM Transactions on Graphics 33, 4 (2014), 1?10.
[19]
W. K. Hastings. 1970. Monte carlo sampling methods using markov chains and their applications. Biometrika 57, 1 (1970), 97?109.
[20]
Peter Hedman, Tero Karras, and Jaakko Lehtinen. 2016. Sequential Monte Carlo instant radiosity. In Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. 121?128.
[21]
Eric Heitz and Laurent Belcour. 2019. Distributing Monte Carlo errors as a blue noise in screen space by permuting pixel seeds between frames. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 149?158.
[22]
Binh-Son Hua, Adrien Gruson, Victor Petitjean, Matthias Zwicker, Derek Nowrouzezahrai, Elmar Eisemann, and Toshiya Hachisuka. 2019. A survey on gradient-domain rendering. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 455?472.
[23]
Wenzel Jakob and Steve Marschner. 2012. Manifold exploration: A Markov chain Monte Carlo technique for rendering scenes with difficult specular transport. ACM Transactions on Graphics 31, 4 (2012), 1?13.
[24]
Henrik Wann Jensen. 1996. Global illumination using photon maps. In Proceedings of the Eurographics Workshop on Rendering Techniques. Springer, 21?30.
[25]
James T. Kajiya. 1986. The rendering equation. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques. 143?150.
[26]
Simon Kallweit, Petrik Clarberg, Craig Kolb, Tom?a? Davidovi?, Kai-Hwa Yao, Theresa Foley, Yong He, Lifan Wu, Lucy Chen, Tomas Akenine-M?ller, Chris Wyman, Cyril Crassin, and Nir Benty. 2022. The Falcor Rendering Framework. Retrieved from https://github.com/NVIDIAGameWorks/Falcor#citation
[27]
Anton S. Kaplanyan, Johannes Hanika, and Carsten Dachsbacher. 2014. The natural-constraint representation of the path space for efficient light transport simulation. ACM Transactions on Graphics 33, 4 (2014), 1?13.
[28]
Csaba Kelemen, L?szl? Szirmay-Kalos, Gy?rgy Antal, and Ferenc Csonka. 2002. A simple and robust mutation strategy for the Metropolis light transport algorithm. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 531?540.
[29]
Alexander Keller. 1997. Instant Radiosity. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques.ACM Press/Addison-Wesley Publishing Co., 49?56. DOI:
[30]
Emmett Kilgariff, Henry Moreton, Nick Stam, and Brandon Bell. 2018. NVIDIA turing architecture in-depth. Retrieved from https://developer.nvidia.com/blog/nvidia-turing-architecture-in-depth/ (visited on 2020-05-11) (2018).
[31]
Pawel Kozlowski and Tim Cheblokov. 2021. ReLAX: A denoiser tailored to work with the ReSTIR algorithm. GPU Technology Conference (2021). https://www.nvidia.com/en-us/on-demand/session/gtcspring21-s32759/#:~:text=ReLAX%20originates%20from%20SVGF%20but,special%20treatment%20of%20disoccluded%20areas
[32]
Eric P. Lafortune and Yves D. Willems. 1993. Bi-directional path tracing. In Proceedings of 3rd International Conference on Computational Graphics and Visualization Techniques. 145?153.
[33]
Yu-Chi Lai, Hsuan-Ting Chou, Kuo-Wei Chen, and Shaohua Fan. 2015. Robust and efficient adaptive direct lighting estimation. The Visual Computer 31, 1 (2015), 83?91.
[34]
Yu-Chi Lai and Charles Dyer. 2007. Population Monte Carlo Path Tracing. Technical Report. University of Wisconsin-Madison Department of Computer Sciences.
[35]
Yu-Chi Lai, Shao Hua Fan, Stephen Chenney, and Charcle Dyer. 2007. Photorealistic image rendering with population Monte Carlo energy redistribution. In Proceedings of the 18th Eurographics Conference on Rendering Techniques. 287?295.
[36]
Yu-Chi Lai, Feng Liu, and Charles Dyer. 2009. Physically-based Animation Rendering with Markov Chain Monte Carlo. Technical Report. University of Wisconsin-Madison Department of Computer Sciences.
[37]
Jaakko Lehtinen, Tero Karras, Samuli Laine, Miika Aittala, Fr?do Durand, and Timo Aila. 2013. Gradient-domain Metropolis light transport. ACM Transactions on Graphics 32, 4 (2013), 1?12.
[38]
Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuskel, and Chris Wyman. 2022. Generalized resampled importance sampling: Foundations of ReSTIR. ACM Transactions on Graphics 41 (2022), 75.
[39]
Daqi Lin, Chris Wyman, and Cem Yuksel. 2021. Fast volume rendering with spatiotemporal reservoir resampling. ACM Transactions on Graphics Daqi Lin, Chris Wyman, and Cem Yuksel. 2021. Fast Volume Rendering with Spatiotemporal Reservoir Resampling. 40, 6 (December 2021), 1?18. DOI:
[40]
Fujun Luan, Shuang Zhao, Kavita Bala, and Ioannis Gkioulekas. 2020. Langevin Monte Carlo rendering with gradient-based adaptation. ACM Trans. Graph. 39, 4 (2020), 140.
[41]
Nicholas Metropolis, Arianna W. Rosenbluth, Marshall N. Rosenbluth, Augusta H. Teller, and Edward Teller. 1953. Equation of state calculations by fast computing machines. The Journal of Chemical Physics 21, 6 (1953), 1087?1092.
[42]
Don P. Mitchell. 1987. Generating antialiased images at low sampling densities. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques.Association for Computing Machinery, New York, NY, 65?72. DOI:
[43]
Thomas M?ller, Markus Gross, and Jan Nov?k. 2017. Practical path guiding for efficient light-transport simulation. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 91?100.
[44]
Thomas M?ller, Brian McWilliams, Fabrice Rousselle, Markus Gross, and Jan Nov?k. 2019. Neural importance sampling. ACM Trans. Graph. 38, 5 (2019), 19 pages. DOI:
[45]
Radford M. Neal. 2001. Annealed importance sampling. Statistics and Computing 11, 2 (2001), 125?139.
[46]
NVIDIA. 2017. NVIDIA OptiX AI-Accelerated Denoiser. Retrieved from https://developer.nvidia.com/optix-denoiser
[47]
NVIDIA. 2022. NVIDIA Real-time Denoisers (NRD). Retrieved from https://developer.nvidia.com/rtx/ray-tracing/rt-denoisers
[48]
Hisanari Otsu, Johannes Hanika, Toshiya Hachisuka, and Carsten Dachsbacher. 2018. Geometry-aware metropolis light transport. ACM Transactions on Graphics 37, 6 (2018), 1?11.
[49]
Yaobin Ouyang, Shiqiu Liu, Markus Kettunen, Matt Pharr, and Jacopo Pantaleoni. 2021. ReSTIR GI: Path resampling for real-time path tracing. In Proceedings of the Computer Graphics Forum. Wiley Online Library, 17?29.
[50]
Mark Pauly, Thomas Kollig, and Alexander Keller. 2000. Metropolis light transport for participating media. In Proceedings of the Rendering Techniques 2000: Proceedings of the Eurographics Workshop in Brno. Springer, 11?22.
[51]
Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, and Marco Salvi. 2017. Spatiotemporal variance-guided filtering: Real-time reconstruction for path-traced global illumination. In Proceedings of the High Performance Graphics. 1?12.
[52]
Christoph Schied, Christoph Peters, and Carsten Dachsbacher. 2018. Gradient estimation for real-time adaptive temporal filtering. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 2 (2018), 1?16.
[53]
Justin Talbot, David Cline, and Parris Egbert. 2005. Importance resampling for global illumination. In Proceedings of the Eurographics Symposium on Rendering (2005). Kavita Bala and Philip Dutre (Eds.), The Eurographics Association. DOI:
[54]
Justin F. Talbot. 2005. Importance Resampling for Global Illumination. Brigham Young University.
[55]
Joran Van de Woestijne, Roald Frederickx, Niels Billen, and Philip Dutr?. 2017. Temporal coherence for Metropolis light transport. In Proceedings of the Eurographics Symposium on Rendering-Experimental Ideas & Implementations. Eurographics Association, 55?63.
[56]
Eric Veach. 1998. Robust Monte Carlo Methods for Light Transport Simulation. Stanford University.
[57]
Eric Veach and Leonidas Guibas. 1995a. Bidirectional estimators for light transport. In Proceedings of the Photorealistic Rendering Techniques. Springer, 145?167.
[58]
Eric Veach and Leonidas J. Guibas. 1995b. Optimally combining sampling techniques for Monte Carlo rendering. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques. 419?428.
[59]
Eric Veach and Leonidas J. Guibas. 1997. Metropolis light transport. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. 65?76.
[60]
Gregory J. Ward, Francis M. Rubinstein, and Robert D. Clear. 1988. A ray tracing solution for diffuse interreflection. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques. 85?92.
[61]
Chris Wyman. 2021. Weighted reservoir sampling: Randomly sampling streams. In Proceedings of the Ray Tracing Gems II. Springer, 345?349.
[62]
Chris Wyman and Alexey Panteleev. 2021. Rearchitecting spatiotemporal resampling for production. High-Performance Graphics – Symposium Papers, Nikolaus Binder and Tobias Ritschel (Eds.). The Eurographics Association. DOI:
