“Structure-aware synthesis for predictive woven fabric appearance” by Zhao, Bala, Marschner and Jakob

Woven fabrics have a wide range of appearance determined by their small-scale 3D structure. Accurately modeling this structural detail can produce highly realistic renderings of fabrics and is critical for predictive rendering of fabric appearance. But building these yarn-level volumetric models is challenging. Procedural techniques are manually intensive, and fail to capture the naturally arising irregularities which contribute significantly to the overall appearance of cloth. Techniques that acquire the detailed 3D structure of real fabric samples are constrained only to model the scanned samples and cannot represent different fabric designs.This paper presents a new approach to creating volumetric models of woven cloth, which starts with user-specified fabric designs and produces models that correctly capture the yarn-level structural details of cloth. We create a small database of volumetric exemplars by scanning fabric samples with simple weave structures. To build an output model, our method synthesizes a new volume by copying data from the exemplars at each yarn crossing to match a weave pattern that specifies the desired output structure. Our results demonstrate that our approach generalizes well to complex designs and can produce highly realistic results at both large and small scales.

1. Adabala, N., and Magnenat-Thalmann, N. 2003. A procedural thread texture model. Journal of Graphics Tools 8, 3, 33–40.Google ScholarCross Ref
2. Adabala, N., Magnenat-Thalmann, N., and Fei, G. 2003. Visualization of woven cloth. In Proceedings of the 14th Eurographics Workshop on Rendering, 178–185. Google ScholarDigital Library
3. Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, 217–226. Google ScholarDigital Library
4. Chen, Y., Tong, X., Wang, J., Lin, S., Guo, B., and Shum, H.-Y. 2004. Shell texture functions. ACM Transactions on Graphics 23, 3, 343–353. Google ScholarDigital Library
5. Cohen, M. F., Shade, J., Hiller, S., and Deussen, O. 2003. Wang tiles for image and texture generation. ACM Transactions on Graphics 22, 3, 287–294. Google ScholarDigital Library
6. Dong, Y., Wang, J., Tong, X., Snyder, J., Lan, Y., Ben-Ezra, M., and Guo, B. 2010. Manifold bootstrapping for SVBRDF capture. ACM Transactions on Graphics 29, 4, 98:1–98:10. Google ScholarDigital Library
7. Drago, F., and Chiba, N. 2004. Painting canvas synthesis. The Visual Computer 20, 5, 314–328. Google ScholarDigital Library
8. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 341–346. Google ScholarDigital Library
9. Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the 7th IEEE International Conference on Computer Vision, vol. 2, IEEE, 1033–1038. Google ScholarDigital Library
10. Ghosh, A., Chen, T., Peers, P., Wilson, C. A., and Debevec, P. 2009. Estimating specular roughness and anisotropy from second order spherical gradient illumination. Computer Graphics Forum 28, 4, 1161–1170. Google ScholarDigital Library
11. Ghosh, A., Chen, T., Peers, P., Wilson, C. A., and Debevec, P. 2010. Circularly polarized spherical illumination reflectometry. ACM Transactions on Graphics 29, 6, 162:1–162:12. Google ScholarDigital Library
12. Gröller, E., Rau, R. T., and Strasser, W. 1995. Modeling and visualization of knitwear. IEEE Transactions on Visualization and Computer Graphics 1, 4, 302–310. Google ScholarDigital Library
13. Gröller, E., Rau, R. T., and Strasser, W. 1996. Modeling textiles as three dimensional textures. In Proceedings of the Eurographics Workshop on Rendering Techniques ’96, 205–214. Google ScholarDigital Library
14. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, 229–238. Google ScholarDigital Library
15. Hurtut, T., Landes, P.-E., Thollot, J., Gousseau, Y., Drouillhet, R., and Coeurjolly, J.-F. 2009. Appearance-guided synthesis of element arrangements by example. In Proceedings of the 7th International Symposium on Non-Photorealistic Animation and Rendering, 51–60. Google ScholarDigital Library
16. Irawan, P., and Marschner, S. 2012. Specular reflection from woven cloth. ACM Transactions on Graphics 31, 1, 11:1–11:20. Google ScholarDigital Library
17. Jakob, W., Arbree, A., Moon, J. T., Bala, K., and Marschner, S. 2010. A radiative transfer framework for rendering materials with anisotropic structure. ACM Transactions on Graphics 29, 53:1–53:13. Google ScholarDigital Library
18. Jakob, W., 2010. Mitsuba physically based renderer. mitsuba-renderer.org.Google Scholar
19. Kajiya, J. T., and Kay, T. L. 1989. Rendering fur with three dimensional textures. SIGGRAPH Computer Graphics 23, 3, 271–280. Google ScholarDigital Library
20. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. ACM Transactions on Graphics 26, 3. Google ScholarDigital Library
21. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277–286. Google ScholarDigital Library
22. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Transactions on Graphics 24, 3, 795–802. Google ScholarDigital Library
23. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Transactions on Graphics 24, 3, 777–786. Google ScholarDigital Library
24. Ma, C., Wei, L.-Y., and Tong, X. 2011. Discrete element textures. ACM Transactions on Graphics 30, 4, 62:1–62:10. Google ScholarDigital Library
25. Marschner, S. R., Westin, S. H., Arbree, A., and Moon, J. T. 2005. Measuring and modeling the appearance of finished wood. ACM Transactions on Graphics 24, 3, 727–734. Google ScholarDigital Library
26. Merrell, P., and Manocha, D. 2008. Continuous model synthesis. ACM Transactions on Graphics 27, 5, 158:1–158:7. Google ScholarDigital Library
27. Perlin, K., and Hoffert, E. M. 1989. Hypertexture. SIGGRAPH Computer Graphics 23, 3, 253–262. Google ScholarDigital Library
28. Pointcarré, 2001. Pointcarré textile software. pointcarre. com.Google Scholar
29. Porumbescu, S. D., Budge, B., Feng, L., and Joy, K. I. 2005. Shell maps. ACM Transactions on Graphics 24, 3, 626–633. Google ScholarDigital Library
30. Ramanarayanan, G., and Bala, K. 2007. Constrained texture synthesis via energy minimization. IEEE Transactions on Visualization and Computer Graphics 13, 1, 167–178. Google ScholarDigital Library
31. Rolfsen, D. 2003. Knots and links. American Mathematical Society.Google Scholar
32. Shinohara, T., Takayama, J., Ohyama, S., and Kobayashi, A. 2010. Extraction of yarn positional information from a three-dimensional CT image of textile fabric using yarn tracing with a filament model for structure analysis. Textile Research Journal 80, 7, 623–630.Google ScholarCross Ref
33. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3, 665–672. Google ScholarDigital Library
34. Wang, J., Zhao, S., Tong, X., Snyder, J., and Guo, B. 2008. Modeling anisotropic surface reflectance with example-based microfacet synthesis. ACM Transactions on Graphics 27, 3, 41:1–41:9. Google ScholarDigital Library
35. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, 479–488. Google ScholarDigital Library
36. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report, EG-STAR.Google Scholar
37. Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. ACM Transactions on Graphics 23, 3, 364–367. Google ScholarDigital Library
38. Xu, Y.-Q., Chen, Y., Lin, S., Zhong, H., Wu, E., Guo, B., and Shum, H.-Y. 2001. Photorealistic rendering of knitwear using the lumislice. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, 391–398. Google ScholarDigital Library
39. Zhao, S., Jakob, W., Marschner, S., and Bala, K. 2011. Building volumetric appearance models of fabric using micro CT imaging. ACM Transactions on Graphics 30, 4, 44:1–44:10. Google ScholarDigital Library
40. Zhou, K., Huang, X., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H.-Y. 2006. Mesh quilting for geometric texture synthesis. ACM Transactions on Graphics 25, 3, 690–697. Google ScholarDigital Library