“Image-Based Material Editing” by University of Central Florida
Conference:
- SIGGRAPH 2005 More animation videos from SIGGRAPH 2005:
SIGGRAPH Video Review:
Track:
- 12
Title:
- Image-Based Material Editing
Length:
- 2:09
Director(s):
Company / Institution / Agency:
- University of Central Florida
Description:
This work showcases a feasibility study on editing the appearance of objects in images. For each frame, the input is a single high-dynamic-range photograph. An alpha matte is created by hand to differentiate the object from its background. In separate automated processes, the object is removed from the background, and the 3D shape of the object is recovered. The background is then blurred, color enhanced, and texture mapped onto the 3D shape, resulting in an object which appears to be made of a different material. The nov-elty of this work lies in the fact that extensive material changes are possible without manually reconstructing a 3D scene. The success of this approach is assured by carefully exploiting idiosyncracies of the human visual system. For instance, the refracted pattern of light needs to be consistent with the shape of the object, and its overall tone needs to be consistent with the environment. Otherwise, signifi-cant deviations from physical accuracy are tolerated by the human visual system, which relaxes the demands on our material editing algorithms. This, in combination with the recent development of sev-eral image-processing techniques, allows objects to be turned into transparent, translucent, and arbitrarily reflective materials.
Hardware:
All images were acquired with a Nikon D2H photocamera. Camera motion was obtained using a custom-built motion rig.
Software:
The final edit-ing and titles were generated with Adobe Premiere. All software to create high-dynamic-range images, perform material edits, and tone-map the results is home-grown.
Additional Contributors:
Director and Producer: Erik Reinhard
CONTRIBUTORS
Erum Arif Khan – University of Central Florida
Oguz Akyuz – University of Central Florida
Roland Fleming – Max Planck Institute for Biological Cybernetics
Heinrich Buelthoff – Max Planck Institute for Biological Cybernetics
