“Freezing Fire – Automated Light-Passes for Stop-Motion VFX” by Scatena

  • ©Paulo Scatena

  • ©Paulo Scatena

Conference:


Entry Number: 14

Title:

    Freezing Fire – Automated Light-Passes for Stop-Motion VFX

Presenter(s):



Abstract:


    This work proposes and evaluates a method of image-based rendering for integrating light-emitting CG assets with digital photography. The framework consists of a capture stage, in which footage of the scene under varied lighting is acquired, and a reconstruction stage, which outputs the calculated light contribution of the CG element upon the scene. This form of relighting is novel as it embraces scenarios where the light source is intended to be in the frame. The freedom to introduce emissive objects in post opens creative room for light animation and was assessed here as employed in the production of a stop-motion short-film.

References:


    Mojtaba Bemana, Karol Myszkowski, Hans-Peter Seidel, and Tobias Ritschel. 2020. X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation. ACM Trans. Graph. 39, 6, Article 257 (Nov. 2020), 15 pages. https://doi.org/10.1145/3414685. 3417827

    Yaozhun Huang, Sze-Chun Tsang, Hei-Ting Tamar Wong, and Miu-Ling Lam. 2018. Computational Light Painting and Kinetic Photography. In Proceedings of the Joint  Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (Victoria, British Columbia,  Canada) (Expressive ’18). Association for Computing Machinery, New York, NY, USA, Article 14, 9 pages. https://doi.org/10.1145/3229147.3229167

    Bitbanger Labs. 2017. The Pixelstick. Retrieved January 17, 2021 from http://www. thepixelstick.com

    Tiancheng Sun, Zexiang Xu, Xiuming Zhang, Sean Fanello, Christoph Rhemann, Paul Debevec, Yun-Ta Tsai, Jonathan T. Barron, and Ravi Ramamoorthi. 2020. Light Stage Super-Resolution: Continuous High-Frequency Relighting. ACM Trans. Graph. 39, 6, Article 260 (Nov. 2020), 12 pages. https://doi.org/10.1145/3414685.3417821

    Tiancheng Sun, Zexiang Xu, Xiuming Zhang, Sean Fanello, Christoph Rhemann, Paul Debevec, Yun-Ta Tsai, Jonathan T. Barron, and Ravi Ramamoorthi. 2020. Light Stage Super-Resolution: Continuous High-Frequency Relighting. ACM Trans. Graph. 39, 6, Article 260 (Nov. 2020), 12 pages. https://doi.org/10.1145/3414685.3417821

    Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, and Paul Debevec. 2005. Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination. ACM Trans. Graph. 24, 3 (July 2005), 756–764. https://doi.org/10.1145/1073204.1073258

Keyword(s):



Additional Images:

©Paulo Scatena

Acknowledgements:


    This research was part of the studies of Technical Direction at the Animationsinstitut of the Filmakademie Baden-Württemberg. I would like to thank its R&D department for the extended support, as well as Denis Krez and David Maas for the trust and motivation


PDF:



ACM Digital Library Publication:



Type: