“Environment matting extensions: towards higher accuracy and real-time capture” by Chuang, Zongker, Hindorff, Curless, Salesin, et al. …

Environment matting is a generalization of traditional bluescreen matting. By photographing an object in front of a sequence of structured light backdrops, a set of approximate light-transport paths through the object can be computed. The original environment matting research chose a middle ground—using a moderate number of photographs to produce results that were reasonably accurate for many objects. In this work, we extend the technique in two opposite directions: recovering a more accurate model at the expense of using additional structured light backdrops, and obtaining a simplified matte using just a single backdrop. The first extension allows for the capture of complex and subtle interactions of light with objects, while the second allows for video capture of colorless objects in motion.

1. Paul Besl. Active optical range imaging sensors. In Jorge L.C. Sanz, editor, Advances in Machine Vision, chapter 1, pages 1-63. Springer-Verlag, 1989.
2. J. F. Blinn and M. E. Newell. Texture and reflection in computer generated images. Communications of the ACM, 19:542-546, 1976.
3. G. Chazan and N. Kiryati. Pyramidal intensity ratio depth sensor. Technical Report 121, Center for Communication and Information Technologies, Department of Electrical Engineering, Technion, Haifa, Israel, October 1995.
4. B. Curless and M. Levoy. Better optical triangulation through spacetime analysis. In Proceedings of IEEE International Conference on Computer Vision, pages 987-994, June 1995.
5. Paul E. Debevec and Jitendra Malik. Recovering high dynamic range radiance maps from photographs. In P1vceedings of SIGGRAPH 97, pages 369-378, August 1997.
6. Gerd Hfiusler and Dieter Ritter. Parallel three-dimensional sensing by colorcoded triangulation. Applied Optics, 32(35):7164-7169, December 1993.
7. David J. Heeger and James R. Bergen. Pyramid-based texture analysis/synthesis. P1vceedings of SIGGRAPH 95, pages 229-238, August 1995.
8. Eli Horn and Nahum Kiryati. Toward optimal structured light patterns. In P1vceedings of the International Conference on Recent Advances in Three- Dimensional Digital Imaging and Modeling, pages 28-35, 1997.
9. T. Kanade, A. Gruss, and L. Carley. A very fast VLSI rangefinder. In 1991 IEEE International Conference on Robotics and Automation, volume 39, pages 1322-1329, April 1991.
10. R Perona and J. Malik. Scale space and edge detection using anisotropic diffusion. IEEE Trans. on Pattern Analysis and Machine Intelligence, 12(7):629-639, July 1990.
11. Thomas Porter and Tom Duff. Compositing digital images. In P~vceedings of SIGGRAPH 84, volume 18, pages 253-259, July 1984.
12. William H. Press, Saul A. Teukolsky, William T. Vetterling, and Brian R Flannery. Numerical Recipes in C: The Art of Scientific Computing (2nd ed.). Cambridge University Press, 1992.
13. K. Sato and S. Inokuchi. Three-dimensional surface measurement by space encoding range imaging. Journal of Robotic Systems, 2:27-39, 1985.
14. Erhard Schubert. Fast 3d object recognition using multiple color coded illumination. In P1vc. IEEE Conference on Acoustics, Speech, and Signal P1vcessing, pages 3057-3060, 1997.
15. Alvy Ray Smith and James F. Blinn. Blue screen matting. In P~vceedings of SIGGRAPH 96, pages 259-268, August 1996.
16. Gregory J. Ward. Measuring and modeling anisotropic reflection. In Edwin E. Catmull, editor, Computer Graphics (SIGGRAPH ’92 P~vceedings), volume 26, pages 265-272, July 1992.
17. G. Wolberg. Digital Image Warping. IEEE Computer Society Press, 1990.
18. Yung Yu Chuang, Douglas E. Zongker, Joel Hindorff, Brian Curless, David H. Salesin, and Richard Szeliski. Environment matting extensions: Towards higher accuracy and real-time capture. Technical Report 2000-05-01, University of Washington, 2000.
19. Douglas E. Zongker, Dawn M. Werner, Brian Curless, and David H. Salesin. Environment matting and compositing. In P~vceedings of SIGGRAPH 99, pages 205-214, August 1999.