“Real-time Neural Woven Fabric Rendering”
Conference:
Type(s):
Title:
- Real-time Neural Woven Fabric Rendering
Presenter(s)/Author(s):
Abstract:
We propose a lightweight neural network to represent woven fabrics at different scales in real time. By encoding the regular and repetitive woven fabric pattern into a small latent vector, our network is able to handle three typical types of woven fabrics in our training dataset: plain, twill, and satin.
References:
[1]
Neeharika Adabala, Nadia Magnenat-Thalmann, and Guangzheng Fei. 2003. Real-time rendering of woven clothes. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ?03). Association for Computing Machinery, New York, NY, USA, 41?47. https://doi.org/10.1145/1008653.1008663
[2]
Carlos Aliaga, Carlos Castillo, Diego Gutierrez, Miguel A. Otaduy, Jorge Lopez-Moreno, and Adrian Jarabo. 2017. An Appearance Model for Textile Fibers. Computer Graphics Forum 36, 4 (2017), 35?45. https://doi.org/10.1111/cgf.13222
[3]
Pontus Andersson, Jim Nilsson, Peter Shirley, and Tomas Akenine-M?ller. 2021. Visualizing Errors in Rendered High Dynamic Range Images. In Eurographics Short Papers. https://doi.org/10.2312/egs.20211015
[4]
Jonathan Dupuy, Eric Heitz, Jean-Claude Iehl, Pierre Poulin, Fabrice Neyret, and Victor Ostromoukhov. 2013. Linear Efficient Antialiased Displacement and Reflectance Mapping. ACM Trans. Graph. 32, 6, Article 211 (nov 2013), 11 pages. https://doi.org/10.1145/2508363.2508422
[5]
Alban Gauthier, Robin Faury, J?r?my Levallois, Th?o Thonat, Jean-Marc Thiery, and Tamy Boubekeur. 2022. MIPNet: Neural Normal-to-Anisotropic-Roughness MIP Mapping. ACM Trans. Graph. 41, 6, Article 246 (nov 2022), 12 pages. https://doi.org/10.1145/3550454.3555487
[6]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770?778. https://doi.org/10.1109/CVPR.2016.90
[7]
Eric Heitz, Jonathan Dupuy, Cyril Crassin, and Carsten Dachsbacher. 2015. The SGGX microflake distribution. ACM Trans. Graph. 34, 4, Article 48 (jul 2015), 11 pages. https://doi.org/10.1145/2766988
[8]
Piti Irawan and Steve Marschner. 2012. Specular reflection from woven cloth. ACM Trans. Graph. 31, 1, Article 11 (feb 2012), 20 pages. https://doi.org/10.1145/2077341.2077352
[9]
Wenzel Jakob, Adam Arbree, Jonathan T. Moon, Kavita Bala, and Steve Marschner. 2010. A radiative transfer framework for rendering materials with anisotropic structure. ACM Trans. Graph. 29, 4, Article 53 (jul 2010), 13 pages. https://doi.org/10.1145/1778765.1778790
[10]
Wenhua Jin, Beibei Wang, Milos Hasan, Yu Guo, Steve Marschner, and Ling-Qi Yan. 2022. Woven Fabric Capture from a Single Photo. In SIGGRAPH Asia 2022 Conference Papers (Daegu, Republic of Korea) (SA ?22). Association for Computing Machinery, New York, NY, USA, Article 33, 8 pages. https://doi.org/10.1145/3550469.3555380
[11]
Simon Kallweit, Petrik Clarberg, Craig Kolb, Tom?a? Davidovi?, Kai-Hwa Yao, Theresa Foley, Yong He, Lifan Wu, Lucy Chen, Tomas Akenine-M?ller, Chris Wyman, Cyril Crassin, and Nir Benty. 2022. The Falcor Rendering Framework. https://github.com/NVIDIAGameWorks/Falcor
[12]
Anton S. Kaplanyan, Stephen Hill, Anjul Patney, and Aaron Lefohn. 2016. Filtering Distributions of Normals for Shading Antialiasing. In Eurographics/ ACM SIGGRAPH Symposium on High Performance Graphics, Ulf Assarsson and Warren Hunt (Eds.). The Eurographics Association. https://doi.org/10.2312/hpg.20161201
[13]
Pramook Khungurn, Daniel Schroeder, Shuang Zhao, Kavita Bala, and Steve Marschner. 2016. Matching Real Fabrics with Micro-Appearance Models. ACM Trans. Graph. 35, 1, Article 1 (dec 2016), 26 pages. https://doi.org/10.1145/2818648
[14]
Alexandr Kuznetsov, Krishna Mullia, Zexiang Xu, Milo? Ha?an, and Ravi Ramamoorthi. 2021. NeuMIP: Multi-Resolution Neural Materials. ACM Trans. Graph. 40, 4, Article 175 (jul 2021), 13 pages. https://doi.org/10.1145/3450626.3459795
[15]
Guillaume Loubet and Fabrice Neyret. 2017. Hybrid mesh-volume LoDs for all-scale pre-filtering of complex 3D assets. Computer Graphics Forum 36, 2 (2017), 431?442. https://doi.org/10.1111/cgf.13138
[16]
Zahra Montazeri, S?ren B. Gammelmark, Shuang Zhao, and Henrik Wann Jensen. 2020. A practical ply-based appearance model of woven fabrics. ACM Trans. Graph. 39, 6, Article 251 (nov 2020), 13 pages. https://doi.org/10.1145/3414685.3417777
[17]
Thomas M?ller, Fabrice Rousselle, Jan Nov?k, and Alexander Keller. 2021. Real-time Neural Radiance Caching for Path Tracing. ACM Trans. Graph. 40, 4, Article 36 (Aug. 2021), 36:1?36:16 pages. https://doi.org/10.1145/3450626.3459812
[18]
Marc Olano and Dan Baker. 2010. LEAN Mapping. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Washington, D.C.) (I3D ?10). Association for Computing Machinery, New York, NY, USA, 181?188. https://doi.org/10.1145/1730804.1730834
[19]
Iman Sadeghi, Oleg Bisker, Joachim De Deken, and Henrik Wann Jensen. 2013. A practical microcylinder appearance model for cloth rendering. ACM Trans. Graph. 32, 2, Article 14 (apr 2013), 12 pages. https://doi.org/10.1145/2451236.2451240
[20]
Beibei Wang, Wenhua Jin, Milo? Ha?an, and Ling-Qi Yan. 2022. SpongeCake: A Layered Microflake Surface Appearance Model. ACM Trans. Graph. 42, 1, Article 8 (sep 2022), 16 pages. https://doi.org/10.1145/3546940
[21]
Lance Williams. 1983. Pyramidal parametrics. In Proceedings of the 10th Annual Conference on Computer Graphics and Interactive Techniques (Detroit, Michigan, USA) (SIGGRAPH ?83). Association for Computing Machinery, New York, NY, USA, 1?11. https://doi.org/10.1145/800059.801126
[22]
Lifan Wu, Shuang Zhao, Ling-Qi Yan, and Ravi Ramamoorthi. 2019. Accurate appearance preserving prefiltering for rendering displacement-mapped surfaces. ACM Trans. Graph. 38, 4, Article 137 (jul 2019), 14 pages. https://doi.org/10.1145/3306346.3322936
[23]
Chao Xu, Rui Wang, Shuang Zhao, and Hujun Bao. 2017. Real-Time Linear BRDF MIP-Mapping. Computer Graphics Forum 36, 4 (2017), 27?34. https://doi.org/10.1111/cgf.13221
[24]
Tizian Zeltner, Fabrice Rousselle, Andrea Weidlich, Petrik Clarberg, Jan Nov?k, Benedikt Bitterli, Alex Evans, Tom?? Davidovi?, Simon Kallweit, and Aaron Lefohn. 2024. Real-Time Neural Appearance Models. ACM Trans. Graph. (apr 2024). https://doi.org/10.1145/3659577 Just Accepted.
[25]
Shuang Zhao, Wenzel Jakob, Steve Marschner, and Kavita Bala. 2011. Building volumetric appearance models of fabric using micro CT imaging. ACM Trans. Graph. 30, 4, Article 44 (jul 2011), 10 pages. https://doi.org/10.1145/2010324.1964939
[26]
Shuang Zhao, Lifan Wu, Fr?do Durand, and Ravi Ramamoorthi. 2016. Downsampling scattering parameters for rendering anisotropic media. ACM Trans. Graph. 35, 6, Article 166 (dec 2016), 11 pages. https://doi.org/10.1145/2980179.2980228
[27]
Junqiu Zhu, Adrian Jarabo, Carlos Aliaga, Ling-Qi Yan, and Matt Jen-Yuan Chiang. 2023a. A Realistic Surface-Based Cloth Rendering Model. In ACM SIGGRAPH 2023 Conference Proceedings (Los Angeles, CA, USA) (SIGGRAPH ?23). Association for Computing Machinery, New York, NY, USA, Article 5, 9 pages. https://doi.org/10.1145/3588432.3591554
[28]
Junqiu Zhu, Zahra Montazeri, Jean-Marie Aubry, Ling-Qi Yan, and Andrea Weidlich. 2023b. A Practical and Hierarchical Yarn-based Shading Model for Cloth. Computer Graphics Forum 42, 4 (2023), 2?11. https://doi.org/10.1111/cgf.14894
