“Surface light fields for 3D photography” by Wood, Azuma, Aldinger, Curless, Duchamp, et al. …

A surface light field is a function that assigns a color to each ray originating on a surface. Surface light fields are well suited to constructing virtual images of shiny objects under complex lighting conditions. This paper presents a framework for construction, compression, interactive rendering, and rudimentary editing of surface light fields of real objects. Generalization of vector quantization and principal component analysis are used to construct a compressed representation of an object’s surface light field from photographs and range scans. A new rendering algorithm achieves interactive rendering of images from the compressed representation, incorporating view-dependent geometric level-of-detail control. The surface light field representation can also be directly edited to yield plausible surface light fields for small changes in surface geometry and reflectance properties.

1. D.I. Azuma. Interactive Rendering of Surface Light Fields. Technical Report UW-CSE-2000-04-01, Department of Computer Science and Engineering, University of Washington, April 2000.
2. P.J. Besl and N. D. McKay. A Method for Registration of 3-D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239-256, February 1992.
3. B. Cabral, M. Olano, and P. Nemec. Reflection Space Image Based Rendering. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 165-170, August 1999.
4. A. Certain, J. Popovi6, T. DeRose, T. Duchamp, D. Salesin, and W. Stuetzle. Interactive Multiresolution Surface Viewing. In SIGGRAPH 96 Conference Proceedings, Computer Graphics Annual Conference Series, pages 91-98, August 1996.
5. J. Cohen, M. Olano, and D. Manocha. Appearance-Preserving Simplification. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 115-122. ACM SIGGRAPH, July 1998.
6. B. Curless and M. Levoy. A Volumetric Method for Building Complex Models from Range Images. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 303-312, August 1996.
7. P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image- Based Approach. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 11-20, August 1996.
8. P. E. Debevec, Y. Yu, and G. D. Borshukov. Efficient View- Dependent Image-Based Rendering with Projective Texture-Mapping. Eurographics Rendering Workshop 1998, pages 105-116, June 1998.
9. M. Eck, T. DeRose, T. Duchamp, H. Hoppe, M. Lounsbery, and W. Stuetzle. Multiresolution Analysis of Arbitrary Meshes. In SIGGRAPH 95 Conference Proceedings, Annual Conference Series, pages 173-182, August 1995.
10. H. Gagnon, M. Soucy, R. Bergevin, and D. Laurendeau. Registration of Multiple Range Views for Automatic 3-D Model Building. In IEEE Conf. Computer Vision and Pattern Recognition, pages 581-586, June 1994.
11. A. Gersho and R. M. Gray. Vector Quantization and Signal Compression. Kluwer Academic Publishers, 1991.
12. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. E Cohen. The Lumigraph. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 43-54, August 1996.
13. W. Heidrich and H.-P. Seidel. Realistic, Hardware-Accelerated Shading and Lighting. Proceedings of SIGGRAPH 99, pages 171- 178, August 1999.
14. H. Hoppe. Progressive Meshes. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 99-108, August 1996.
15. H. Hoppe. View-Dependent Refinement of Progressive Meshes. In SIGGRAPH 97 Conference Proceedings, Annual Conference Series, pages 189-198, August 1997.
16. A.W. E Lee, W. Sweldens, P. Schroeder, L. Cowsar, and D. Dobkin. MAPS: Multiresolution Adaptive Parameterization of Surfaces. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 95-104, July 1998.
17. M. Levoy and P. Hanrahan. Light Field Rendering. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 31-42, August 1996.
18. M. Lounsbery, T. D. DeRose, and J. Warren. Multiresolution Analysis for Surfaces of Arbitrary Topological Type. ACM Transactions on Graphics, 16(1):34-73, January 1997.
19. D. Luebke and C. Erikson. View-Dependent Simplification of Arbitrary Polygonal Environments. In SIGGRAPH 97 Conference Proceedings, Annual Conference Series, pages 199-208, August 1997.
20. M. Magnor and B. Girod. Adaptive Block-Based Light Field Coding. Proc. 3rd International Workshop on Synthetic and Natural Hybrid Coding and Three-Dimensional Imaging, pages 140-143, September 1999.
21. M. Magnor and B. Girod. Hierarchical Coding of Light Fields with Disparity Maps. Proc. IEEE International Conference on Image Processing, pages 334-338, October 1999.
22. G. S. P. Miller, S. Rubin, and D. Ponceleon. Lazy Decompression of Surface Light Fields for Precomputed Global Illumination. Eurographics Rendering Workshop 1998, pages 281-292, June 1998.
23. K. Nishino, Y. Sato, and K. Ikeuchi. Appearance compression and synthesis based on 3D model for mixed reality. In Proceedings of IEEE ICCV’99, pages 38 – 45, September 1999.
24. K. Nishino, Y. Sato, and K. Ikeuchi. Eigen-Texture Method: Appearance Compression based on 3D Model. Proc. of Computer Vision and Pattern Recognition, 1:618-624, June 1999.
25. K. Perlin and E. M. Hoffert. Hypertexture. Computer Graphics (Proceedings of SIGGRAPH 89), 23(3):253-262, July 1989.
26. K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle. View-based Rendering: Visualizing Real Objects from Scanned Range and Color Data. Eurographics Rendering Workshop 1997, pages 23-34, June 1997.
27. S.M. Rusinkiewicz. A New Change of Variables for Efficient BRDF Representation. In Eurographics Rendering Workshop 1998, pages 11-22. Eurographics, June 1998.
28. Y. Sato, M. D. Wheeler, and K. Ikeuchi. Object Shape and Reflectance Modeling from Observation. In SIGGRAPH 97 Conference Proceedings, Annual Conference Series, pages 379-388, August 1997.
29. G. Taubin. A Signal Processing Approach to Fair Surface Design. In SIGGRAPH 95 Conference Proceedings, Annual Conference Series, pages 351-358. ACM SIGGRAPH, August 1995.
30. R.Y. Tsai. An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 364-374, 1986.
31. B. Walter, G. Alppay, E. P. E Lafortune, S. Fernandez, and D. P. Greenberg. Fitting Virtual Lights For Non-Diffuse Walkthroughs. In SIGGRAPH 97 Conference Proceedings, Annual Conference Series, pages 45-48, August 1997.
32. J. C. Xia and A. Varshney. Dynamic View-Dependent Simplification for Polygonal Models. In IEEE Visualization ’96. IEEE, October 1996.
33. Y. Yu, P. Debevec, J. Malik, and T. Hawkins. Inverse Global Illumination: Recovering Reflectance Models of Real Scenes From Photographs. In SIGGRAPH 98 Conference Proceedings, Annual Conference Series, pages 215-224, August 1999.