“Time-varying surface appearance: acquisition, modeling and rendering” by Gu, Tu, Ramamoorthi, Belhumeur, Matusik, et al. …

For computer graphics rendering, we generally assume that the appearance of surfaces remains static over time. Yet, there are a number of natural processes that cause surface appearance to vary dramatically, such as burning of wood, wetting and drying of rock and fabric, decay of fruit skins, and corrosion and rusting of steel and copper. In this paper, we take a significant step towards measuring, modeling, and rendering time-varying surface appearance. We describe the acquisition of the first time-varying database of 26 samples, encompassing a variety of natural processes including burning, drying, decay, and corrosion. Our main technical contribution is a Space-Time Appearance Factorization (STAF). This model factors space and time-varying effects. We derive an overall temporal appearance variation characteristic curve of the specific process, as well as space-dependent textures, rates, and offsets. This overall temporal curve controls different spatial locations evolve at the different rates, causing spatial patterns on the surface over time. We show that the model accurately represents a variety of phenomena. Moreover, it enables a number of novel rendering applications, such as transfer of the time-varying effect to a new static surface, control to accelerate time evolution in certain areas, extrapolation beyond the acquired sequence, and texture synthesis of time-varying appearance.

1. Chen, Y., Xia, L., Wong, T., Tong, X., Bao, H., Guo, B., and Shum, H. 2005. Visual simulation of weathering by gammaton tracing. ACM Transactions on Graphics, SIGGRAPH 2005, 1127–1133. Google ScholarDigital Library
2. Cross, M., and Hohenberg, P. 1993. Pattern formation out of equilibrium. Reviews of Modern Physics 65, 851–1112.Google ScholarCross Ref
3. Dana, K., Van Ginneken, B., Nayar, S., and Koenderink, J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1 (January), 1–34. Google ScholarDigital Library
4. Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., and Hawkins, T. 2002. A lighting reproduction approach to live-action compositing. ACM TOG (SIGGRAPH 02) 21, 3, 547–556. Google ScholarDigital Library
5. Dorsey, J., and Hanrahan, P. 1996. Modeling and rendering of metallic patinas. In SIGGRAPH, 387–396. Google ScholarDigital Library
6. Dorsey, J., Pederson, H., and Hanrahan, P. 1996. Flow and changes in appearance. In SIGGRAPH, 411–420. Google ScholarDigital Library
7. Dorsey, J., Edelman, A., Wann Jensen, H., Legakis, J., and Pederson, H. 1999. Modeling and rendering of weathered stone. In SIGGRAPH, 225–234. Google ScholarDigital Library
8. Efros, A., and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341–346. Google ScholarDigital Library
9. Gasser, T., Muller, H. G., and Mammitzsch, V. 1985. Kernels for nonparametric curve estimation. Journal of the Royal Statistical Society. Seriers B (Methodological) 47, 2, 238–252.Google ScholarCross Ref
10. Hsu, S., and Wong, T. 1995. Simulating dust accumulation. IEEE Computer Graphics & Applications 15, 1 (January), 18–22. Google ScholarDigital Library
11. Hughes, R., and Rowe, M. 1991. The colouring, bronzing and patination of metals. Watson-Guptill Publications, New York.Google Scholar
12. Jankowsky, I., and Santos, G. 2004. Drying behavior and permeability of eucalyptus grandis lumber. In International Drying Symposium, 1385–1389.Google Scholar
13. Jensen, H., Legakis, J., and Dorsey, J. 1999. Rendering of wet materials. In Rendering Techniques’99, Springer-Verlag, D. Lischinski and G. Larson, Eds., 273–282. Google ScholarDigital Library
14. Kneip, A., and Engel, J. 1995. Model estimation in nonlinear regression under shape invariance. The Annals of Statistics 23, 2 (April), 551–570.Google ScholarCross Ref
15. Koudelka, M. 2004. Capture, Analysis and Synthesis of Textured Surfaces With Variation in Illumination, Viewpoint and Time. PhD thesis, Yale University. Google ScholarDigital Library
16. Lu, J., Georghiades, A., Rushmeier, H., Dorsey, J., and Xu, C. 2005. Synthesis of material drying history: Phenomenon modeling, transferring and rendering. In Eurographics Workshop on Natural Phenomena, 7–16. Google ScholarDigital Library
17. Matusik, W., Pfister, H., Brand, M., and Mcmillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics, SIGGRAPH 2003 (July), 759–769. Google ScholarDigital Library
18. Meinhardt, H. 1992. Pattern formation in biology: a comparison of models and experiments. Reports on Progress in Physics 55, 797–849.Google ScholarCross Ref
19. Merillou, S., Dischler, J.-M., and Ghazanfarpour, D. 2001. Corrosion: simulating and rendering. In Graphics Interface 01, 167–174. Google ScholarDigital Library
20. Miller, G. 1994. Efficient algorithms for local and global accessibility shading. In SIGGRAPH, 319–326. Google ScholarDigital Library
21. Pharr, M., and Humphreys, G. 2004. Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann. Google ScholarDigital Library
22. Sakoe, H., and Chiba, S. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoustic Speech and Signal Processing 26, 43–49.Google ScholarCross Ref
23. Vasilescu, M., and Terzopoulos, D. 2004. Tensortextures: Multilinear image-based rendering. In SIGGRAPH, 336–342. Google ScholarDigital Library
24. Vlasic, D., Pfister, H., Molinov, S., Grzeszczuk, R., and Matusik, W. 2003. Opacity light fields: Interactive rendering of surface light fields with view-dependent opacity. In Symposium on Interactive 3D graphics, 65–74. Google ScholarDigital Library
25. Wang, K., and Gasser, T. 1999. Synchronizing sample curves non-parametrically. The Annals of Statistics 27, 2, 439–460.Google ScholarCross Ref