“Prelit Materials: Light Transport for Live-Action Elements in Production Rendering”

  • ©Steve Agland, Matthew Reid, and Daniel Heckenberg

  • ©Steve Agland, Matthew Reid, and Daniel Heckenberg



Entry Number: 18


    Prelit Materials: Light Transport for Live-Action Elements in Production Rendering



    We introduce a new conceptual model for including live-action footage in the light transport simulation of production renderers. By explicitly declaring which elements of the scene were present during photography, our pathtracer can generate realistic bidirectional lighting and shadowing between live-action and synthetic elements in a single pass. Using the film Peter Rabbit as a case study, we show how this can be used for automatic integration of synthetic elements into plates throughout the visual effects review process, from layout to interactive lighting. Auxiliary channels allow a compositor to perform several post-render adjustments, including rebalancing lighting on live-action elements.


    Paul Debevec. 1998. Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’98). ACM, New York, NY, USA, 189–198.
    Daniel Heckenberg, Steve Agland, Jean Pascal leBlanc, and Raphael Barth. 2017. Automated Light Probes from Capture to Render for Peter Rabbit. In ACM SIGGRAPH 2017 Talks (SIGGRAPH ’17). ACM, New York, NY, USA, Article 17, 2 pages.



    Thanks to Narendra Kumar Vadapalli for the pipeline implementation; and Francesco Sansoni, the lighting crew, and the supervision team on Peter Rabbit for their patience and valuable feedback.


ACM Digital Library Publication:

Overview Page: