“Practical multispectral lighting reproduction” by LeGendre, Yu, Liu, Busch, Jones, et al. …
Conference:
Type(s):
Title:
- Practical multispectral lighting reproduction
Session/Category Title: COMPUTATIONAL CAMERAS
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We present a practical framework for reproducing omnidirectional incident illumination conditions with complex spectra using a light stage with multispectral LED lights. For lighting acquisition, we augment standard RGB panoramic photography with one or more observations of a color chart with numerous reflectance spectra. We then solve for how to drive the multispectral light sources so that they best reproduce the appearance of the color charts in the original lighting. Even when solving for non-negative intensities, we show that accurate lighting reproduction is achievable using just four or six distinct LED spectra for a wide range of incident illumination spectra. A significant benefit of our approach is that it does not require the use of specialized equipment (other than the light stage) such as monochromators, spectroradiometers, or explicit knowledge of the LED power spectra, camera spectral response functions, or color chart reflectance spectra. We describe two simple devices for multispectral lighting capture, one for slow measurements of detailed angular spectral detail, and one for fast measurements with coarse angular detail. We validate the approach by realistically compositing real subjects into acquired lighting environments, showing accurate matches to how the subject would actually look within the environments, even for those including complex multispectral illumination. We also demonstrate dynamic lighting capture and playback using the technique.
References:
1. Ajdin, B., Finckh, M., Fuchs, C., Hanika, J., and Lensch, H. 2012. Compressive higher-order sparse and low-rank acquisition with a hyperspectral light stage. Tech. rep., Univ. of Tuebingen.Google Scholar
2. Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., and Hawkins, T. 2002. A lighting reproduction approach to live-action compositing. In Proc. 29th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’02, 547–556. Google ScholarDigital Library
3. Debevec, P., Graham, P., Busch, J., and Bolas, M. 2012. A single-shot light probe. In ACM SIGGRAPH 2012 Talks, ACM, New York, NY, USA, SIGGRAPH ’12, 10:1–10:1. Google ScholarDigital Library
4. Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proc. of the 25th Annual Conf. on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’98, 189–198. Google ScholarDigital Library
5. Gu, J., and Liu, C. 2012. Discriminative illumination: Perpixel classification of raw materials based on optimal projections of spectral brdf. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, 797–804. Google ScholarDigital Library
6. Hamon, P.-L., Harmer, J., Penn, S., and Scapel, N. 2014. Gravity: Motion control and face integration. In ACM SIGGRAPH 2014 Talks, ACM, New York, NY, USA, SIGGRAPH ’14, 35:1–35:1. Google ScholarDigital Library
7. Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2003. High dynamic range video. ACM Trans. Graph. 22, 3 (July), 319–325. Google ScholarDigital Library
8. Kawakami, R., Zhao, H., Tan, R. T., and Ikeuchi, K. 2013. Camera spectral sensitivity and white balance estimation from sky images. Int. J. Comput. Vision 105, 3 (Dec.), 187–204. Google ScholarDigital Library
9. Kider, Jr., J. T., Knowlton, D., Newlin, J., Li, Y. K., and Greenberg, D. P. 2014. A framework for the experimental comparison of solar and skydome illumination. ACM Trans. Graph. 33, 6 (Nov.), 180:1–180:12. Google ScholarDigital Library
10. Kitahara, M., Okabe, T., Fuchs, C., and Lensch, H. 2015. Simultaneous estimation of spectral reflectance and normal from a small number of images. In Proceedings of the 10th International Conference on Computer Vision Theory and Applications, VISAPP 2015, 303–313.Google Scholar
11. McCamy, C., Marcus, H., and Davidson, J. 1976. A color-rendition chart. Journal of Applied Photographic Engineering 2, 3 (June), 95–99.Google ScholarCross Ref
12. Park, J., Lee, M., Grossberg, M. D., and Nayar, S. K. 2007. Multispectral Imaging Using Multiplexed Illumination. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
13. Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2005. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. Google ScholarDigital Library
14. Rump, M., Zinke, A., and Klein, R. 2011. Practical spectral characterization of trichromatic cameras. ACM Trans. Graph. 30, 6 (Dec.), 170:1–170:10. Google ScholarDigital Library
15. Shi, J., Yu, H., Huang, X., Chen, Z., and Tai, Y. 2014. Illuminant spectrum estimation using a digital color camera and a color chart. In Proc. SPIE, 927307-927307-9.Google Scholar
16. Stumpfel, J., Tchou, C., Jones, A., Hawkins, T., Wenger, A., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In Proceedings of the 3rd Intl. Conf. on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, ACM, New York, NY, USA, AFRIGRAPH ’04, 145–149. Google ScholarDigital Library
17. Tominaga, S., and Fukuda, T. 2007. Omnidirectional scene illuminant estimation using a multispectral imaging system. In Proc. SPIE, 649313-649313-8.Google Scholar
18. Tominaga, S., and Tanaka, N. 2001. Measurement of omnidirectional light distribution by a mirrored ball. In The 9th Color Imaging Conference: Color Science and Engineering: Systems, Technologies, Applications, CIC 2001, Scottsdale, Arizona, USA, November 6–9, 2001, 22–26.Google Scholar
19. Tominaga, S., and Tanaka, N. 2006. Omnidirectional scene illuminant estimation using a mirrored ball. Journal of Imaging Science and Technology 50, 3 (May), 217–227.Google ScholarCross Ref
20. Unger, J., and Gustavson, S. 2007. High-dynamic-range video for photometric measurement of illumination. In Proc. SPIE, 65010E–65010E-10.Google Scholar
21. Wenger, A., Hawkins, T., and Debevec, P. 2003. Optimizing color matching in a lighting reproduction system for complex subject and illuminant spectra. In Proceedings of the 14th Eurographics Workshop on Rendering, Eurographics Association, Aire-la-Ville, Switzerland, EGRW ’03, 249–259. Google ScholarDigital Library
