“Path-space Differentiable Rendering of Implicit Surfaces”
Conference:
Type(s):
Title:
- Path-space Differentiable Rendering of Implicit Surfaces
Presenter(s)/Author(s):
Abstract:
We extend the theory of path-space differentiable rendering to include implicit surfaces and propose Monte
Carlo estimators for the boundary integrals. This widens the application of physics-based differentiable
rendering and opens up new possibilities for inverse rendering applications.
References:
[1]
Sai Bangaru, Michael Gharbi, Tzu-Mao Li, Fujun Luan, Kalyan Sunkavalli, Milos Hasan, Sai Bi, Zexiang Xu, Gilbert Bernstein, and Fredo Durand. 2022. Differentiable Rendering of Neural SDFs through Reparameterization. In ACM SIGGRAPH Asia 2022 Conference Proceedings (Daegu, Republic of Korea) (SIGGRAPH Asia ?22). Association for Computing Machinery, New York, NY, USA, Article 22, 9 pages. https://doi.org/10.1145/3550469.3555397
[2]
Sai Praveen Bangaru, Tzu-Mao Li, and Fr?do Durand. 2020. Unbiased Warped-Area Sampling for Differentiable Rendering. ACM Trans. Graph. 39, 6 (2020), 245:1?245:18.
[3]
Alan H Barr. 1986. Ray tracing deformed surfaces. ACM SIGGRAPH Computer Graphics 20, 4 (1986), 287?296.
[4]
Robert A Drebin, Loren Carpenter, and Pat Hanrahan. 1988. Volume rendering. ACM Siggraph Computer Graphics 22, 4 (1988), 65?74.
[5]
Jorge Fl?rez, Mateu Sbert, Miguel A Sainz, and Josep Veh?. 2008. Efficient ray tracing using interval analysis. In Parallel Processing and Applied Mathematics: 7th International Conference, PPAM 2007, Gdansk, Poland, September 9-12, 2007 Revised Selected Papers 7. Springer, 1351?1360.
[6]
John C Hart. 1996. Sphere tracing: A geometric method for the antialiased ray tracing of implicit surfaces. The Visual Computer 12, 10 (1996), 527?545.
[7]
Wenzel Jakob, S?bastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Tizian Zeltner, Baptiste Nicolet, Miguel Crespo, Vincent Leroy, and Ziyi Zhang. 2022. Mitsuba 3 renderer. https://mitsuba-renderer.org.
[8]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[9]
Marc Levoy. 1988. Display of surfaces from volume data. IEEE Computer graphics and Applications 8, 3 (1988), 29?37.
[10]
Tzu-Mao Li, Miika Aittala, Fr?do Durand, and Jaakko Lehtinen. 2018. Differentiable Monte Carlo ray tracing through edge sampling. ACM Trans. Graph. 37, 6 (2018), 222:1?222:11.
[11]
William E Lorensen and Harvey E Cline. 1998. Marching cubes: A high resolution 3D surface construction algorithm. In Seminal graphics: pioneering efforts that shaped the field. 347?353.
[12]
Guillaume Loubet, Nicolas Holzschuch, and Wenzel Jakob. 2019. Reparameterizing discontinuous integrands for differentiable rendering. ACM Trans. Graph. 38, 6 (2019), 228:1?228:14.
[13]
Merlin Nimier-David, S?bastien Speierer, Beno?t Ruiz, and Wenzel Jakob. 2020. Radiative backpropagation: an adjoint method for lightning-fast differentiable rendering. ACM Trans. Graph. 39, 4 (2020), 146:1?146:15.
[14]
Jos Stam and Ryan Schmidt. 2011. On the Velocity of an Implicit Surface. ACM Trans. Graph. 30, 3, Article 21 (may 2011), 7 pages. https://doi.org/10.1145/1966394.1966400
[15]
Jorge Stolfi and Luiz Henrique De Figueiredo. 1997. Self-validated numerical methods and applications. In Brazilian mathematics colloquium monograph. IMPA 2303 eRio de Janeiro Rio de Janeiro, 1?116.
[16]
Eric Veach. 1997. Robust Monte Carlo methods for light transport simulation. Vol. 1610. Stanford University PhD thesis.
[17]
Delio Vicini, S?bastien Speierer, and Wenzel Jakob. 2021. Path Replay Backpropagation: Differentiating Light Paths Using Constant Memory and Linear Time. ACM Trans. Graph. 40, 4, Article 108 (2021), 108:1?108:14 pages.
[18]
Delio Vicini, S?bastien Speierer, and Wenzel Jakob. 2022. Differentiable Signed Distance Function Rendering. ACM Trans. Graph. 41, 4 (2022), 125:1?125:18.
[19]
Andrew P Witkin and Paul S Heckbert. 1994. Using particles to sample and control implicit surfaces. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques. 269?277.
[20]
Peiyu Xu, Sai Bangaru, Tzu-Mao Li, and Shuang Zhao. 2023. Warped-Area Reparameterization of Differential Path Integrals. ACM Trans. Graph. 42, 6 (2023), 213:1?213:18.
[21]
Kai Yan, Christoph Lassner, Brian Budge, Zhao Dong, and Shuang Zhao. 2022. Efficient estimation of boundary integrals for path-space differentiable rendering. ACM Trans. Graph. 41, 4 (2022), 123:1?123:13.
[22]
Lior Yariv, Yoni Kasten, Dror Moran, Meirav Galun, Matan Atzmon, Basri Ronen, and Yaron Lipman. 2020. Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance. Advances in Neural Information Processing Systems 33 (2020).
[23]
Z. Yu, C. Zhang, O. Maury, C. Hery, Z. Dong, and S. Zhao. 2023. Efficient Path-Space Differentiable Volume Rendering With Respect To Shapes. Computer Graphics Forum 42, 4 (2023).
[24]
Zihan Yu, Cheng Zhang, Derek Nowrouzezahrai, Zhao Dong, and Shuang Zhao. 2022. Efficient Differentiation of Pixel Reconstruction Filters for Path-Space Differentiable Rendering. ACM Trans. Graph. 41, 6 (2022), 191:1?191:16.
[25]
Cheng Zhang, Bailey Miller, Kai Yan, Ioannis Gkioulekas, and Shuang Zhao. 2020. Path-space differentiable rendering. ACM Trans. Graph. 39, 4 (2020), 143:1?143:19.
[26]
Cheng Zhang, Lifan Wu, Changxi Zheng, Ioannis Gkioulekas, Ravi Ramamoorthi, and Shuang Zhao. 2019. A differential theory of radiative transfer. ACM Trans. Graph. 38, 6 (2019), 227:1?227:16.
[27]
Cheng Zhang, Zihan Yu, and Shuang Zhao. 2021. Path-space differentiable rendering of participating media. ACM Trans. Graph. 40, 4 (2021), 76:1?76:15.
[28]
Ziyi Zhang, Nicolas Roussel, and Wenzel Jakob. 2023. Projective Sampling for Differentiable Rendering of Geometry. Transactions on Graphics (Proceedings of SIGGRAPH Asia) 42, 6 (Dec. 2023). https://doi.org/10.1145/3618385
