“Learning Optimal Lighting Patterns for Efficient SVBRDF Acquisition” by Kang, Chen, Wang, Zhou and Wu
Conference:
Type(s):
Entry Number: 47
Title:
- Learning Optimal Lighting Patterns for Efficient SVBRDF Acquisition
Presenter(s)/Author(s):
Abstract:
INTRODUCTION
Digitally acquiring high-quality material appearance from the real world is challenging, with applications in visual effects, e-commerce and entertainment. One popular class of existing work is based on hand-derived illumination multiplexing [Ghosh et al. 2009], using hundreds of patterns in the most general case [Chen et al. 2014].
We propose a novel framework [Kang et al. 2018] that automatically learns the lighting patterns for efficient reflectance acquisition, as well as how to faithfully reconstruct spatially varying anisotropic BRDFs and local frames from measurements under such patterns. Our core is an asymmetric deep autoencoder, consisting of a nonnegative, linear encoder which corresponds to the lighting patterns used in physical acquisition, and a stacked, nonlinear decoder which computationally recovers the BRDF information from photographs. We capture high-quality SVBRDFs with only 16 ∼ 32 lighting patterns, in 12 ∼ 25 seconds. Our framework is useful for increasing the efficiency in both novel and existing acquisition setups.
References:
- Guojun Chen, Yue Dong, Pieter Peers, Jiawan Zhang, and Xin Tong. 2014. Reflectance Scanning: Estimating Shading Frame and BRDF with Generalized Linear Light Sources. ACM Trans. Graph. 33, 4, Article 117 (July 2014), 11 pages.
- Abhijeet Ghosh, Tongbo Chen, Pieter Peers, Cyrus A. Wilson, and Paul Debevec. 2009. Estimating Specular Roughness and Anisotropy from Second Order Spherical Gradient Illumination. Computer Graphics Forum 28, 4 (2009), 1161–1170.
- Kaizhang Kang, Zimin Chen, Jiaping Wang, Kun Zhou, and Hongzhi Wu. 2018. Efficient Reflectance Capture Using an Autoencoder. ACM Trans. Graph. 37, 4, Article 127 (Aug. 2018), 10 pages.
- Hendrik P. A. Lensch, Jan Kautz, Michael Goesele, Wolfgang Heidrich, and Hans-Peter Seidel. 2003. Image-based Reconstruction of Spatial Appearance and Geometric Detail. ACM Trans. Graph. 22, 2 (April 2003), 234–257.
Keyword(s):
Additional Images:
