“Reflectance Estimation for Free-viewpoint Video” by Ash, Tomori, Pelton and Dupont

  • ©George Ash, Juraj Tomori, Mike Pelton, and Charles Dupont

  • ©George Ash, Juraj Tomori, Mike Pelton, and Charles Dupont

  • ©George Ash, Juraj Tomori, Mike Pelton, and Charles Dupont

  • ©George Ash, Juraj Tomori, Mike Pelton, and Charles Dupont

  • ©George Ash, Juraj Tomori, Mike Pelton, and Charles Dupont

Conference:


Type:


Entry Number: 13

Title:

    Reflectance Estimation for Free-viewpoint Video

Presenter(s)/Author(s):



Abstract:


    We present a method to infer physically-based material properties for free-viewpoint video. Given a multi-camera image feed and reconstructed geometry, our method infers material properties, such as albedo, surface normal, metallic and roughness maps. We use a physically based, differentiable renderer to generate candidate images which are compared against the image feed. Our method searches for material textures which minimise an image-space loss metric between candidate renders and the ground truth image feed. Our method produces results that approximate state of the art reflectance capture, and produces texture maps that are compatible with common real-time and offline shading models.


PDF:



ACM Digital Library Publication:



Overview Page: