“A data-driven reflectance model” by Matusik, Pfister, Brand and McMillan

We present a generative model for isotropic bidirectional reflectance distribution functions (BRDFs) based on acquired reflectance data. Instead of using analytical reflectance models, we represent each BRDF as a dense set of measurements. This allows us to interpolate and extrapolate in the space of acquired BRDFs to create new BRDFs. We treat each acquired BRDF as a single high-dimensional vector taken from a space of all possible BRDFs. We apply both linear (subspace) and non-linear (manifold) dimensionality reduction tools in an effort to discover a lower-dimensional representation that characterizes our measurements. We let users define perceptually meaningful parametrization directions to navigate in the reduced-dimension BRDF space. On the low-dimensional manifold, movement along these directions produces novel but valid BRDFs.

1. BISHOP, C. M. 1995. Neural Networks for Pattern Recognition. Clarendon Press. Google Scholar
2. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3D faces. Computer Graphics 33, Annual Conference Series, 187–194. Google Scholar
3. BLINN, J. 1977. Models of light reflection for computer synthesized pictures. Computer Graphics 11, Annual Conference Series, 192–198. Google Scholar
4. BRAND, M. 2003. Charting a manifold. In To appear, Proc. NIPS-15.Google Scholar
5. CHEN, W.-C., BOUGUET, J.-Y., CHU, M. H., AND GRZESZCZUK, R. 2002. Light Field Mapping: Efficient Representation and Hardware Rendering of Surface Light Fields. ACM Transactions on Graphics 21, 3 (July), 447–456. ISSN 0730-0301 (Proceedings of ACM SIGGRAPH 2002). Google ScholarDigital Library
6. COOK, R., AND TORRANCE, K. 1982. A reflection model for computer graphics. ACM Transactions On Graphics 1, 1 (January), 7–24. Google ScholarDigital Library
7. CORNELL. Light Measurement Laboratory. Web page. http://www.graphics.cornell.edu/ research/measure/.Google Scholar
8. CULA, O. G., AND DANA, K. 2001. Compact representation of bidirectional texture functions. In Proc. of Computer Vision and Pattern Recognition, in press.Google Scholar
9. CURET. Columbia-Utrech Reflectance and Texture. Web page. http://www.cs.columbia.edu/ CAVE/curet/.Google Scholar
10. DANA, K. J., VAN GINNEKEN, B., NAYAR, S. K., AND KOENDERINK, J. J. 1999. Reflectance and texture of real world surfaces. ACM Transactions on Graphics 1, 18, 1–34. Google ScholarDigital Library
11. DANA, K. 2001. BRDF/BTF measurement device. ICCV, 460–466.Google Scholar
12. DUDA, R. O., AND HART, P. E. 1973. Pattern Classification and Scene Analysis. Wiley-Interscience Publication, New York.Google Scholar
13. HE, X., TORRANCE, K., SILLON, F., AND GREENBERG, D. 1991. A comprehensive physical model for light reflection. Computer Graphics 25, Annual Conference Series, 175–186. Google Scholar
14. HE, X., HEYNEN, P., PHILLIPS, R., TORRANCE, K., SALESIN, D., AND GREENBERG, D. 1992. A fast and accurate light reflection model. Computer Graphics 26, Annual Conference Series, 253–254. Google Scholar
15. KAUTZ, J., AND MCCOOL, M. 1999. Interactive rendering with arbitrary BRDFs using separable approximations. In Rendering Techniques ’99 (Proceedings of the Tenth Eurographics Workshop on Rendering), Springer Wien, New York, NY, 281–292. Google Scholar
16. KOENDERINK, J., VAN DOORN, A., AND STAVRIDI, M. 1996. Bidirectional Reflection Distribution Function expressed in terms of surface scattering modes. European Conference on Computer Vision. Google Scholar
17. KRUSKAL, J. B., AND WISH, M. 1978. Multidimensional Scaling. Sage Publications, Beverly Hills, CA.Google Scholar
18. LAFORTUNE, E., FOO, S.-C., TORRANCE, K., AND GREENBERG, D. 1997. Non-linear approximation of reflectance functions. Computer Graphics 31, Annual Conference Series, 117–126. Google Scholar
19. LALONDE, P., AND FOURNIER, A. 1997. A wavelet representation of reflectance functions. IEEE Transactions on Visualization and Computer Graphics 3, 4, 329–336. Google ScholarDigital Library
20. LENSCH, H., KAUTZ, J., GOESELE, M., HEIDRICH, W., AND SEIDEL, H.-P. 2001. Image-based reconstruction of spatially varying materials. In Proceedings of the 12th Eurographics Workshop on Rendering, 104–115. Google Scholar
21. MARSCHNER, S., WESTIN, S., LAFORTUNE, E., AND TORRANCE, K. 2000. Image-based measurement of the Bidirectional Reflection Distribution Function. Applied Optics 39, 16.Google ScholarCross Ref
22. MCCOOL, M., ANG, J., AND AHMAD, A. 2001. Homomorphic factorization of BRDFs for high-performance rendering. Computer Graphics 35, Annual Conference Series, 171–178. Google Scholar
23. PELLACINI, F., FERWERDA, J., AND GREENBERG, D. 2000. Toward a psychophysically-based light reflection model for image synthesis. Computer Graphics 34, Annual Conference Series, 55–64. Google Scholar
24. ROWEIS, S. T., AND SAUL, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290 (December 22), 2323–2326.Google Scholar
25. RUSINKIEWICZ, S. 1998. A new change of variables for efficient BRDF representation. In Rendering Techniques ’98 (Proceedings of Eurographics Rendering Workshop ’98), Springer Wien, New York, NY, G. Drettakis and N. Max, Eds., 11–22.Google Scholar
26. SCHRÖDER, P., AND SWELDENS, W. 1995. Spherical wavelets: Efficiently representing functions on the sphere. Computer Graphics 29, Annual Conference Series, 161–172. Google Scholar
27. STARR. NIST reference reflectometer: STARR facility. Web page. http://physics.nist.gov/Divisions/Div844/facilities/brdf/starr.htm.Google Scholar
28. TEH, Y. W., AND ROWEIS, S. T. 2003. Automatic alignment of hidden representations. In To appear, Proc. NIPS-15.Google Scholar
29. TENENBAUM, J. B., DE SILVA, V., AND LANGFORD, J. C. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290 (December 22), 2319–2323.Google Scholar
30. TORRANCE, K., SPARROW, E., AND BIRKEBAK, R. 1966. Polarization, directional distribution, and off-specular peak phenomena in light reflected from roughened surfaces. Journal of the Optical Society of America 56, 7 (July), 916–925.Google ScholarCross Ref
31. TROWBRIDGE, T., AND REITZ, K. 1975. Average irregularity representation of roughened surfaces. Journal of the Optical Society of America 65, 5, 531–536.Google ScholarCross Ref
32. VAPNIK, V. 1995. The Nature of Statistical Learning Theory. Springer, N.Y. Google Scholar
33. WARD, G. 1992. Measuring and modeling anisotropic reflection. Computer Graphics 26, Annual Conference Series, 265–273. Google Scholar
34. WESTIN, S., ARVO, J., AND TORRANCE, K. 1992. Predicting reflectance functions from complex surfaces. Computer Graphics 26, Annual Conference Series, 255–264. Google Scholar
35. YU, Y., DEBEVEC, P., MALIK, J., AND HAWKINS, T. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Computer Graphics, SIGGRAPH 99 Proceedings, 215–224. Google Scholar
36. ZHANG, Z. 1998. A flexible new technique for camera calibration. Tr98-71, MSR Redmond.Google Scholar