“View-Independent Adjoint Light Tracing for Lighting Design Optimization”
Conference:
Type(s):
Title:
- View-Independent Adjoint Light Tracing for Lighting Design Optimization
Presenter(s)/Author(s):
Abstract:
We introduce a method that enables continuous optimization of the configuration of luminaires in a 3d scene via differentiable adjoint light tracing. Users paint illumination targets directly onto the 3d scene, which enables interactive gradient-based optimization in a camera-free way.
References:
[1]
ANSI/IES. 2020. IES Standard File Format for Photometric Data, ANSI/IES LM-63-19. Retrieved from https://webstore.ansi.org/Standards/IESNA/ANSIIESLM6319
[2]
Sai Praveen Bangaru, Tzu-Mao Li, and Fr?do Durand. 2020. Unbiased warped-area sampling for differentiable rendering. ACM Trans. Graph. 39, 6 (2020), 1?18. DOI:
[3]
Andrew M. Bradley. 2019. PDE-constrained Optimization and the Adjoint Method. Retrieved from https://cs.stanford.edu/ambrad/adjoint_tutorial.pdf
[4]
DIAL GmbH. 2022. DIALux evo 10.1. Retrieved from https://www.dialux.com/en-GB/dialux
[5]
EasternGraphics GmbH. 2023. pCon.Planner. Retrieved from https://pcon-planner.com
[6]
Pascal Gautron, Jaroslav Krivanek, Sumanta Pattanaik, and Kadi Bouatouch. 2004. A novel hemispherical basis for accurate and efficient rendering. In Eurographics Workshop on Rendering. DOI:
[7]
Moritz Geilinger, David Hahn, Jonas Zehnder, Moritz B?cher, Bernhard Thomaszewski, and Stelian Coros. 2020. ADD: Analytically differentiable dynamics for multi-body systems with frictional contact. ACM Trans. Graph. 39, 6 (Nov. 2020), 1?15. DOI:
[8]
Anastasios Gkaravelis. 2016. Inverse lighting design using a coverage optimization strategy. Visual Comput. 32, 6 (2016), 10.
[9]
Ioannis Gkioulekas, Anat Levin, and Todd Zickler. 2016. An evaluation of computational imaging techniques for heterogeneous inverse scattering. In Computer Vision ? ECCV 2016. Springer International, 685?701. DOI:
[10]
Ioannis Gkioulekas, Shuang Zhao, Kavita Bala, Todd Zickler, and Anat Levin. 2013. Inverse volume rendering with material dictionaries. ACM Trans. Graph. 32, 6 (Nov. 2013), 1?13. DOI:
[11]
Cindy M. Goral, Kenneth E. Torrance, Donald P. Greenberg, and Bennett Battaile. 1984. Modeling the interaction of light between diffuse surfaces. ACM SIGGRAPH Comput. Graph. 18, 3 (Jul. 1984), 213?222. DOI:
[12]
Robin Green. 2003. Spherical harmonic lighting: The gritty details. In Archives of the Game Developers Conference, Vol. 56.
[13]
Donald P. Greenberg, Michael F. Cohen, and Kenneth E. Torrance. 1986. Radiosity: A method for computing global illumination. Visual Comput. 2, 5 (Sep. 1986), 291?297. DOI:
[14]
Nikolaus Hansen. 2021. c-cmaes. (2021). https://github.com/CMA-ES/c-cmaes
[15]
Nikolaus Hansen, Sibylle D. M?ller, and Petros Koumoutsakos. 2003. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol. Comput. 11, 1 (Mar. 2003), 1?18. DOI:
[16]
Milo? Ha?an, Jaroslav K?iv?nek, Bruce Walter, and Kavita Bala. 2009. Virtual spherical lights for many-light rendering of glossy scenes. ACM Trans. Graph. 28, 5 (Dec. 2009), 1?6. DOI:
[17]
Wenzel Jakob, S?bastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Tizian Zeltner, Baptiste Nicolet, Miguel Crespo, Vincent Leroy, and Ziyi Zhang. 2022. Mitsuba 3 Renderer. Retrieved from https://mitsuba-renderer.org
[18]
Henrik Wann Jensen. 1995. Importance driven path tracing using the photon map. In Eurographics. Springer Vienna, 326?335. DOI:
[19]
Sam Jin and Sung-Hee Lee. 2019. Lighting layout optimization for 3D Indoor scenes. Comput. Graph. Forum 38, 7 (2019), 733?743. DOI:
[20]
James T. Kajiya. 1986. The rendering equation. ACM SIGGRAPH Comput. Graph. 20, 4 (Aug. 1986), 143?150. DOI:
[21]
Pramook Khungurn, Daniel Schroeder, Shuang Zhao, Kavita Bala, and Steve Marschner. 2015. Matching real fabrics with micro-appearance models. ACM Trans. Graph. 35, 1 (Dec. 2015), 1?26. DOI:
[22]
Diederik P. Kingma and Jimmy Ba. 2014. ADAM: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR?14). arXiv:1412.6980 [cs.LG].
[23]
J. Krivanek, P. Gautron, S. Pattanaik, and K. Bouatouch. 2005. Radiance caching for efficient global illumination computation. IEEE Trans. Vis. Comput. Graph. 11, 5 (Sep. 2005), 550?561. DOI:
[24]
Mats Larson and Fredrik Bengzon. 2013. The Finite Element Method: Theory, Implementation, and Applications. Springer-Verlag GmbH.
[25]
Jaakko Lehtinen, Matthias Zwicker, Emmanuel Turquin, Janne Kontkanen, Fr?do Durand, Fran?ois X. Sillion, and Timo Aila. 2008. A meshless hierarchical representation for light transport. ACM Trans. Graph. 27, 3 (Aug. 2008), 1?9. DOI:
[26]
Tzu-Mao Li, Miika Aittala, Fr?do Durand, and Jaakko Lehtinen. 2018. Differentiable Monte Carlo ray tracing through edge sampling. ACM Trans. Graph. 37, 6 (Dec. 2018), 1?11. DOI:
[27]
Wen-Chieh Lin, Tsung-Shian Huang, Tan-Chi Ho, Yueh-Tse Chen, and Jung-Hong Chuang. 2013. Interactive lighting design with hierarchical light representation. Comput. Graph. Forum 32, 4 (2013), 133?142. DOI:
[28]
Hsueh-Ti Derek Liu, Michael Tao, and Alec Jacobson. 2018. Paparazzi: Surface editing by way of multi-view image processing. ACM Trans. Graph. 37, 6 (Dec. 2018), 1?11. DOI:
[29]
Guillaume Loubet, Nicolas Holzschuch, and Wenzel Jakob. 2019. Reparameterizing discontinuous integrands for differentiable rendering. ACM Trans. Graph. 38, 6 (2019). DOI:
[30]
Christan Luksch, Michael Wimmer, and Michael Schw?rzler. 2019. Incrementally baked global illumination. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM. DOI:
[31]
Merlin Nimier-David, Zhao Dong, Wenzel Jakob, and Anton Kaplanyan. 2021. Material and lighting reconstruction for complex indoor scenes with texture-space differentiable rendering. In Eurographics Symposium on Rendering?DL-only Track (2021). DOI:
[32]
Merlin Nimier-David, S?bastien Speierer, Beno?t Ruiz, and Wenzel Jakob. 2020. Radiative backpropagation. ACM Trans. Graph. 39, 4 (Jul. 2020). DOI:
[33]
Merlin Nimier-David, Delio Vicini, Tizian Zeltner, and Wenzel Jakob. 2019. Mitsuba 2: A retargetable forward and inverse renderer. ACM Trans. Graph. 38, 6 (2019). DOI:
[34]
Jorge Nocedal. 1980. Updating quasi-Newton matrices with limited storage. Math. Comp. 35, 151 (1980), 773?782. DOI:
[35]
Mahmoud Omidvar, Micka?l Ribardi?re, Samuel Carr?, Daniel M?neveaux, and Kadi Bouatouch. 2015. A radiance cache method for highly glossy surfaces. Visual Comput. 32, 10 (Oct. 2015), 1239?1250. DOI:
[36]
OpenArena Team, a FANDOM Games Community. 2008. OpenArena 0.8.1. Retrieved from https://openarena.ws/
[37]
Fabio Pellacini, Frank Battaglia, R. Keith Morley, and Adam Finkelstein. 2007. Lighting with paint. ACM Trans. Graph. 26, 2 (Jun. 2007), 9. DOI:
[38]
P. Poulin, K. Ratib, and M. Jacques. 1997. Sketching shadows and highlights to position lights. In Proceedings Computer Graphics International. IEEE, Los Alamitos, CA, 56?63. DOI:
[39]
Yixuan Qiu. 2021. LBFGS++. Retrieved from https://github.com/yixuan/LBFGSpp
[40]
Relux Informatik AG. 2022. ReluxDesktop. Retrieved from https://reluxnet.relux.com/en
[41]
Michael Schwarz and Peter Wonka. 2014. Procedural design of exterior lighting for buildings with complex constraints. ACM Trans. Graph. 33, 5 (Sep. 2014), 1?16. DOI:
[42]
Amit Shesh and Baoquan Chen. 2007. Crayon lighting: Sketch-guided illumination of models. In Proceedings of the 5th International Conference on Computer Graphics and Interactive Techniques in Australia and Southeast Asia (GRAPHITE?07). ACM Press, New York, NY, 95. DOI:
[43]
Fran?is X. Sillion, James R. Arvo, Stephen H. Westin, and Donald P. Greenberg. 1991. A global illumination solution for general reflectance distributions. In Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’91). ACM Press. DOI:
[44]
Peter-Pike Sloan, Jan Kautz, and John Snyder. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Trans. Graph. 21, 3 (Jul. 2002), 527?536. DOI:
[45]
Johannes Sorger, Thomas Ortner, Christian Luksch, Michael Schwarzler, Eduard Groller, and Harald Piringer. 2016. LiteVis: Integrated visualization for simulation-based decision support in lighting design. IEEE Trans. Vis. Comput. Graph. 22, 1 (Jan. 2016), 290?299. DOI:
[46]
Jos Stam. 2020. Computing light transport gradients using the adjoint method. arxiv:cs.GR/2006.15059. Retrieved from https://arxiv.org/abs/2006.15059
[47]
Eric Veach. 1998. Robust Monte Carlo Methods for Light Transport Simulation. Ph.D. Dissertation, Stanford, CA. AAI9837162
[48]
Delio Vicini, S?bastien Speierer, and Wenzel Jakob. 2021. Path replay backpropagation. ACM Trans. Graph. 40, 4 (aug 2021), 1?14. DOI:
[49]
Andreas Walch, Michael Schw?rzler, Christian Luksch, Elmar Eisemann, and Theresia Gschwandtner. 2019. LightGuider: Guiding interactive lighting design using suggestions, provenance, and quality visualization. IEEE Trans. Vis. Comput. Graph. (2019), 1?1. DOI:
[50]
Mark A. Wieczorek and Matthias Meschede. 2018. SHTools: Tools for working with spherical harmonics. Geochem. Geophys. Geosyst. 19, 8 (Aug. 2018), 2574?2592. DOI:
[51]
Kai Yan, Christoph Lassner, Brian Budge, Zhao Dong, and Shuang Zhao. 2022. Efficient estimation of boundary integrals for path-space differentiable rendering. ACM Trans. Graph. 41, 4 (Jul. 2022), 1?13. DOI:
[52]
Sara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. 2022. Plenoxels: Radiance fields without neural networks. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR?22).
[53]
Tizian Zeltner, S?bastien Speierer, Iliyan Georgiev, and Wenzel Jakob. 2021. Monte Carlo estimators for differential light transport. ACM Trans. Graph. 40, 4 (Aug. 2021), 1?16. DOI:
[54]
Cheng Zhang, Bailey Miller, Kai Yan, Ioannis Gkioulekas, and Shuang Zhao. 2020. Path-space differentiable rendering. ACM Trans. Graph. 39, 4 (2020). DOI:
[55]
Cheng Zhang, Lifan Wu, Changxi Zheng, Ioannis Gkioulekas, Ravi Ramamoorthi, and Shuang Zhao. 2019. A differential theory of radiative transfer. ACM Trans. Graph. 38, 6 (2019). DOI:
