“envyLight: an interface for editing natural illumination” by Pellacini

Scenes lit with high dynamic range environment maps of real-world environments exhibit all the complex nuances of natural illumination. For applications that need lighting adjustments to the rendered images, editing environment maps directly is still cumbersome. First, designers have to determine which region in the environment map is responsible for the specific lighting feature (e.g. diffuse gradients, highlights and shadows) they desire to edit. Second, determining the parameters of image-editing operations needed to achieve specific changes to the selected lighting feature requires extensive trial-and-error.This paper presents envyLight, an interactive interface for editing natural illumination that combines an algorithm to select environment map regions, by sketching strokes on lighting features in the rendered image, with a small set of editing operations to quickly adjust the selected feature. The envyLight selection algorithm works well for indoor and outdoor lighting corresponding to rendered images where lighting features vary widely in number, size, contrast and edge blur. Furthermore, envyLight selection is general with respect to material type, from matte to sharp glossy, and the complexity of scenes’ shapes. envyLight editing operations allow designers to quickly alter the position, contrast and edge blur of the selected lighting feature and can be keyframed to support animation.

1. Adobe Systems Inc., 2009. Photoshop CS 4.Google Scholar
2. Anrys, F., and Dutré, P. 2004. Image based lighting design. In 4th IASTED International Conference on Visualization, Imaging, and Image Processing.Google Scholar
3. Autodesk Inc., 2009. Maya 2009.Google Scholar
4. Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of SIGGRAPH 98, 189–198. Google ScholarDigital Library
5. Deussen, O., Hanrahan, P. M., Lintermann, B., Mech, R., Pharr, M., and Prusinkiewicz, P. 1998. Realistic modeling and rendering of plant ecosystems. In Proceedings of SIGGRAPH 98, 275–286. Google ScholarDigital Library
6. Gleicher, M., and Witkin, A. 1992. Through-the-lens camera control. In Proceedings of SIGGRAPH ’92, 331–340. Google ScholarDigital Library
7. Kerr, W. B., and Pellacini, F. 2009. Toward evaluating lighting design interface paradigms for novice users. ACM Transactions on Graphics 28, 3 (July), 26:1–26:9. Google ScholarDigital Library
8. Lafortune, E. P., and Willems, Y. D. 1994. Using the modified phong reflectance model for physically based rendering. Tech. rep., Katholieke Universiteit Leuven.Google Scholar
9. Mohan, A., Tumblin, J., Bodenheimer, B., Grimm, C., and Bailey, R. 2005. Table-top computed lighting for practical digital photography. In Rendering Techniques 2005: 16th Eurographics Workshop on Rendering, 165–172. Google ScholarDigital Library
10. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. ACM Transactions on Graphics 22, 3 (July), 376–381. Google ScholarDigital Library
11. Okabe, M., Matsushita, Y., Shen, L., and Igarashi, T. 2007. Illumination brush: Interactive design of all-frequency lighting. In Proc. of Pacific Graphics, 171–180. Google ScholarDigital Library
12. Pellacini, F., and Lawrence, J. 2007. Appwand: Editing measured materials using appearance-driven optimization. ACM Transactions on Graphics 26, 3, 54:1–54:9. Google ScholarDigital Library
13. Pellacini, F., Tole, P., and Greenberg, D. P. 2002. A user interface for interactive cinematic shadow design. ACM Transactions on Graphics 21, 3, 563–566. Google ScholarDigital Library
14. Pellacini, F., Battaglia, F., Morley, R. K., and Finkelstein, A. 2007. Lighting with paint. ACM Transactions on Graphics 26, 2, 9:1–9:14. Google ScholarDigital Library
15. Poulin, P., and Fournier, A. 1992. Lights from highlights and shadows. In SI3D ’92: Proceedings of the 1992 symposium on Interactive 3D graphics, 31–38. Google ScholarDigital Library
16. Poulin, P., Ratib, K., and Jacques, M. 1997. Sketching shadows and highlights to position lights. In Proceedings of Computer Graphics International 97, 56–63. Google ScholarDigital Library
17. Ramamoorthi, R., and Hanrahan, P. 2002. Frequency space environment map rendering. ACM Transactions on Graphics 21, 3 (July), 517–526. Google ScholarDigital Library
18. Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In Proceedings of SIGGRAPH ’93, 143–146. Google ScholarDigital Library
19. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics 21, 3 (July), 527–536. Google ScholarDigital Library
20. Stumpfel, J., Tchou, C., Jones, A., Hawkins, T., Wenger, A., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In Proc. of AFRIGRAPH ’04, 145–149. Google ScholarDigital Library
21. Tsai, Y.-T., and Shih, Z.-C. 2006. All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. ACM Transactions on Graphics 25, 3 (July), 967–976. Google ScholarDigital Library
22. Vlasic, D., Baran, I., Matusik, W., and Popović, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27, 3 (Aug.), 97:1–97:9. Google ScholarDigital Library
23. Wang, J., Ren, P., Gong, M., Snyder, J., and Guo, B. 2009. All-frequency rendering of dynamic, spatially-varying reflectance. ACM Transactions on Graphics 28, 5 (Dec.). Google ScholarDigital Library