“Boosting VFX Production with Deep Learning”

  • ©Yanir Kleiman, Simon Pabst, and Patrick Nagle

  • ©Yanir Kleiman, Simon Pabst, and Patrick Nagle

  • ©Yanir Kleiman, Simon Pabst, and Patrick Nagle

  • ©Yanir Kleiman, Simon Pabst, and Patrick Nagle

Conference:


Type:


Entry Number: 24

Title:

    Boosting VFX Production with Deep Learning

Presenter(s)/Author(s):



Abstract:


    Machine learning techniques are not often associated with artistic work such as visual effects production. Nevertheless, these techniques can save a lot of time for artists when used in the right context. In recent years, deep learning techniques have become a widely used tool with powerful frameworks that can be employed in a production environment. We present two deep learning solutions that were integrated into our production pipeline and used in current productions. One method generates high quality images from a compressed video file that contains various compression artifacts. The other quickly locates slates and color charts used for grading in a large set of images. We discuss these particular solutions in the context of previous work, as well as the challenges of integrating a deep learning solution within a VFX production pipeline, from concept to implementation.

References:


    Ryan Baumann. 2015. Automatic ColorChecker Detection, a Survey. (2015). https://ryanfb.github.io/etc/2015/07/08/automatic_colorchecker_detection.html


PDF:



ACM Digital Library Publication:



Overview Page: