“Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography” by Pellacini, Vidimče, Lefohn, Mohr, Leone, et al. …

In computer cinematography, the process of lighting design involves placing and configuring lights to define the visual appearance of environments and to enhance story elements. This process is labor intensive and time consuming, primarily because lighting artists receive poor feedback from existing tools: interactive previews have very poor quality, while final-quality images often take hours to render.This paper presents an interactive cinematic lighting system used in the production of computer-animated feature films containing environments of very high complexity, in which surface and light appearances are described using procedural RenderMan shaders. Our system provides lighting artists with high-quality previews at interactive framerates with only small approximations compared to the final rendered images. This is accomplished by combining numerical estimation of surface response, image-space caching, deferred shading, and the computational power of modern graphics hardware.Our system has been successfully used in the production of two feature-length animated films, dramatically accelerating lighting tasks. In our experience interactivity fundamentally changes an artist’s workflow, improving both productivity and artistic expressiveness.

1. Barzel, R. 1997. Lighting controls for computer cinematography. Journal of Graphics Tools 2, 1, 1–20. Google ScholarDigital Library
2. Briere, N., and Poulin, P. 1996. Hierarchical view-dependent structures for interactive scene manipulation,. In Computer Graphics Annual Conference Series 1996, 89–90. Google ScholarDigital Library
3. Cook, R. L., Carpenter, L., and Catmull, E. 1987. The Reyes image rendering architecture. In Computer Graphics (Proceedings of SIGGRAPH 87), vol. 21, 95–102. Google ScholarDigital Library
4. Everitt, C., 2001. Interactive order-independent transparency. NVIDIA White Paper.Google Scholar
5. Gershbein, R., and Hanrahan, P. M. 2000. A fast relighting engine for interactive cinematic lighting design. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 353–358. Google ScholarDigital Library
6. Gleicher, M., and Witkin, A. 1992. Through-the-lens camera control. In Computer Graphics (Proceedings of SIGGRAPH 92), vol. 26, 331–340. Google ScholarDigital Library
7. Guenter, B., Knoblock, T. B., and Ruf, E. 1995. Specializing shaders. In Proceedings of ACM SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 343–349. Google ScholarDigital Library
8. Horwitz, S., Reps, T., and Binkley, D. 1990. Interprocedural slicing using dependence graphs. ACM Transactions on Programming Languages and Systems (TOPLAS) 12, 1 (January), 26–60. Google ScholarDigital Library
9. Jones, N. D., Gomard, C. K., and Sestoft, P. 1993. Partial Evaluation and Automatic Program Generation. Google ScholarDigital Library
10. Lastra, A., Molnar, S., Olano, M., and Wang, Y. 1995. Real-time programmable shading. In 1995 Symposium on Interactive 3D Graphics, 59–66. Google ScholarDigital Library
11. Lokovic, T., and Veach, E. 2000. Deep shadow maps. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 385–392. Google ScholarDigital Library
12. Mark, W. R., Glanville, R. S., Akeley, K., and Kilgard, M. J. 2003. Cg: A system for programming graphics hardware in a C-like language. ACM Transactions on Graphics 22, 3 (July), 896–907. Google ScholarDigital Library
13. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2003. All-frequency shadows using non-linear wavelet lighting approximation. ACM Transactions on Graphics 22, 3 (July), 376–381. Google ScholarDigital Library
14. Ng, R., Ramamoorthi, R., and Hanrahan, P. 2004. Triple product wavelet integrals for all-frequency relighting. ACM Transactions on Graphics 23, 3 (Aug.), 477–487. Google ScholarDigital Library
15. Peercy, M. S., Olano, M., Airey, J., and Ungar, P. J. 2000. Interactive multi-pass programmable shading. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 425-432. Google ScholarDigital Library
16. Pellacini, F., Tole, P., and Greenberg, D. P. 2002. A user interface for interactive cinematic shadow design. ACM Transactions on Graphics 21, 3 (July), 563–566. Google ScholarDigital Library
17. PIXAR. 2000. The Renderman Interface.Google Scholar
18. PIXAR. 2004.Irma Documentation.Google Scholar
19. Proudfoot, K., Mark, W. R., Tzvetkov, S., and Hanrahan, P. 2001. A real-time procedural shading system for programmable graphics hardware. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 159–170. Google ScholarDigital Library
20. Ragan-Kelley, J. M., 2004. Practical interactive lighting design for RenderMan scenes. Undergraduate thesis, Stanford University.Google Scholar
21. Reeves, W. T., Salesin, D. H., and Cook, R. L. 1987. Rendering antialiased shadows with depth maps. In Computer Graphics (Proceedings of SIGGRAPH 87), vol. 21, 283–291. Google ScholarDigital Library
22. Riffel, A. T., Lefohn, A. E., Vidimce, K., Leone, M., and Owens, J. D. 2004. Mio: Fast multipass partitioning via priority-based instruction scheduling. In Graphics Hardware, 35–44. Google ScholarDigital Library
23. Saito, T., and Takahashi, T. 1990. Comprehensible rendering of 3-D shapes. In ACM SIGGRAPH Computer Graphics, 197–206. Google ScholarDigital Library
24. Sequin, C. H., and Smyrl, E. K. 1989. Parameterized ray tracing. In Computer Graphics Annual Conference Series 1989, 307–314. Google ScholarDigital Library
25. Sloan, P.-P. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting, environments. ACM Transactions on Graphics 21, 3 (July), 477–487. Google ScholarDigital Library
26. Tabellion, E., and Lamorlette, A. 2004. An approximate global illumination system for computer generated films. ACM Transactions on Graphics 23, 3 (Aug.), 469–476. Google ScholarDigital Library
27. Tole, P., Pellacini, F., Walter, B., and Greenberg, D. P. 2002. Interactive global illumination in dynamic scenes. ACM Transactions on Graphics 21, 3 (July), 537–546. Google ScholarDigital Library