“GPU-based simulation of cloth wrinkles at submillimeter levels” by Wang

In this paper, we study physics-based cloth simulation in a very high resolution setting, presumably at submillimeter levels with millions of vertices, to meet perceptual precision of our human eyes. State-of-the-art simulation techniques, mostly developed for unstructured triangular meshes, can hardly meet this demand due to their large computational costs and memory footprints. We argue that in a very high resolution, it is more plausible to use regular meshes with an underlying grid structure, which can be highly compatible with GPU acceleration like high-resolution images. Based on this idea, we formulate and solve the nonlinear optimization problem for simulating high-resolution wrinkles, by a fast block-based descent method with reduced memory accesses. We also investigate the development of the collision handling component in our system, whose performance benefits greatly from the grid structure. Finally, we explore various issues related to the applications of our system, including initialization for fast convergence and temporal coherence, gathering effects, inflation and stuffing models, and mesh simplification. We can treat our system as a quasistatic wrinkle synthesis tool, run it as a standalone dynamic simulator, or integrate it into a multi-resolution solver as an additional component. The experiment demonstrates the capability, efficiency and flexibility of our system in producing a variety of high-resolution wrinkles effects.

1. David Baraff and Andrew Witkin. 1998. Large Steps in Cloth Simulation. In Proceedings of SIGGRAPH 98 (Computer Graphics Proceedings, Annual Conference Series), Eugene Fiume (Ed.). ACM, 43–54.Google ScholarDigital Library
2. David Baraff, Andrew Witkin, and Michael Kass. 2003. Untangling Cloth. ACM Trans. Graph. (SIGGRAPH) 22, 3 (July 2003), 862–870.Google ScholarDigital Library
3. Miklós Bergou, Saurabh Mathur, Max Wardetzky, and Eitan Grinspun. 2007. TRACKS: Toward Directable Thin Shells. ACM Trans. Graph. (SIGGRAPH) 26, 3 (July 2007), 50:1–50:10.Google ScholarDigital Library
4. Miklos Bergou, Max Wardetzky, David Harmon, Denis Zorin, and Eitan Grinspun. 2006. A Quadratic Bending Model for Inextensible Surfaces. In Proceedings of SGP. 227–230.Google ScholarDigital Library
5. Sofien Bouaziz, Sebastian Martin, Tiantian Liu, Ladislav Kavan, and Mark Pauly. 2014. Projective Dynamics: Fusing Constraint Projections for Fast Simulation. ACM Trans. Graph. (SIGGRAPH) 33, 4, Article 154 (July 2014), 11 pages.Google ScholarDigital Library
6. Robert Bridson, Ronald Fedkiw, and John Anderson. 2002. Robust Treatment of Collisions, Contact and Friction for Cloth Animation. ACM Trans. Graph. (SIGGRAPH) 21, 3 (July 2002), 594–603.Google ScholarDigital Library
7. Robert Bridson, Sebastian Marino, and Ronald Fedkiw. 2003. Simulation of Clothing with Folds and Wrinkles. In Proceedings of SCA. 28–36.Google Scholar
8. Peter R. Brune, Matthew G. Knepley, Barry F. Smith, and Xuemin Tu. 2015. Composing Scalable Nonlinear Algebraic Solvers. SIAM Rev. 57, 4 (Nov. 2015), 535–565.Google ScholarDigital Library
9. Thomas Buffet, Damien Rohmer, Loïc Barthe, Laurence Boissieux, and Marie-Paule Cani. 2019. Implicit Untangling: A Robust Solution for Modeling Layered Clothing. ACM Trans. Graph. (SIGGRAPH) 38, 4 (2019).Google ScholarDigital Library
10. Nuttapong Chentanez, Miles Macklin, Matthias Müller, Stefan Jeschke, and Tae-Yong Kim. 2020. Cloth and Skin Deformation with a Triangle Mesh Based Convolutional Neural Network. Comput. Graph. Forum 39, 8 (Nov. 2020), 123–134.Google Scholar
11. Kwang-Jin Choi and Hyeong-Seok Ko. 2002. Stable but Responsive Cloth. ACM Trans. Graph. (SIGGRAPH) 21, 3 (July 2002), 604–611.Google ScholarDigital Library
12. Gabriel Cirio, Jorge Lopez-Moreno, David Miraut, and Miguel A. Otaduy. 2014. Yarn-Level Simulation of Woven Cloth. ACM Trans. Graph. (SIGGRAPH Asia) 33, 6, Article 207 (Nov. 2014), 11 pages.Google Scholar
13. Christopher DeCoro and Natalya Tatarchuk. 2007. Real-Time Mesh Simplification Using the GPU. In Proceedings of I3D. 161–166.Google ScholarDigital Library
14. Marco Fratarcangeli, Valentina Tibaldo, and Fabio Pellacini. 2016. Vivace: A Practical Gauss-Seidel Method for Stable Soft Body Dynamics. ACM Trans. Graph. (SIGGRAPH Asia) 35, 6, Article 214 (Nov. 2016), 9 pages.Google Scholar
15. Rony Goldenthal, David Harmon, Raanan Fattal, Michel Bercovier, and Eitan Grinspun. 2007. Efficient Simulation of Inextensible Cloth. ACM Trans. Graph. (SIGGRAPH) 26, 3, Article 49 (July 2007).Google ScholarDigital Library
16. Peng Guan, Loretta Reiss, David A. Hirshberg, Alexander Weiss, and Michael J. Black. 2012. DRAPE: DRessing Any PErson. ACM Trans. Graph. (SIGGRAPH) 31, 4, Article 35 (July 2012), 10 pages.Google Scholar
17. David Harmon, Etienne Vouga, Rasmus Tamstorf, and Eitan Grinspun. 2008. Robust Treatment of Simultaneous Collisions. ACM Trans. Graph. (SIGGRAPH) 27, 3, Article 23 (August 2008), 4 pages.Google ScholarDigital Library
18. Ning Jin, Yilin Zhu, Zhenglin Geng, and Ronald Fedkiw. 2020. A Pixel-Based Framework for Data-Driven Clothing. Comput. Graph. Forum 39, 8 (Nov. 2020), 135–144.Google Scholar
19. Jonathan M. Kaldor, Doug L. James, and Steve Marschner. 2010. Efficient Yarn-Based Cloth with Adaptive Contact Linearization. ACM Trans. Graph. (SIGGRAPH) 29, 4, Article 105 (July 2010), 10 pages.Google ScholarDigital Library
20. Doyub Kim, Woojong Koh, Rahul Narain, Kayvon Fatahalian, Adrien Treuille, and James F. O’Brien. 2013. Near-Exhaustive Precomputation of Secondary Cloth Effects. ACM Trans. Graph. (SIGGRAPH) 32, 4 (July 2013), 7 pages.Google ScholarDigital Library
21. Zorah Lähner, Daniel Cremers, and Tony Tung. 2018. Deepwrinkles: Accurate and Realistic Clothing Modeling. In The European Conference on Computer Vision (ECCV). 698–715.Google Scholar
22. Christian Lauterbach, Qi Mo, and Dinesh Manocha. 2010. gProximity: Hierarchical GPU-Based Operations for Collision and Distance Queries. In Proceedings of Eurographics, Vol. 29. 419–428.Google ScholarCross Ref
23. Yongjoon Lee, Sung-Eui Yoon, Seungwoo Oh, Duksu Kim, and Sunghee Choi. 2010. Multi-Resolution Cloth Simulation. Comput. Graph. Forum (Pacific Graphics) 29, 7 (2010), 2225–2232.Google ScholarCross Ref
24. Cheng Li, Min Tang, Ruofeng Tong, Ming Cai, Jieyi Zhao, and Dinesh Manocha. 2020. P-Cloth: Interactive Complex Cloth Simulation on Multi-GPU Systems Using Dynamic Matrix Assembly and Pipelined Implicit Integrators. ACM Trans. Graph. (SIGGRAPH Asia) 39, 6, Article 180 (Nov. 2020), 15 pages.Google Scholar
25. Jie Li, Gilles Daviet, Rahul Narain, Florence Bertails-Descoubes, Matthew Overby, George E. Brown, and Laurence Boissieux. 2018. An Implicit Frictional Contact Solver for Adaptive Cloth Simulation. ACM Trans. Graph. (SIGGRAPH) 37, 4, Article 52 (July 2018), 15 pages.Google ScholarDigital Library
26. Ling Li and Vasily Volkov. 2005. Cloth Animation with Adaptively Refined Meshes. In Proceedings of ACSC. 107–113.Google Scholar
27. Tiantian Liu, Adam W. Bargteil, James F. O’Brien, and Ladislav Kavan. 2013. Fast Simulation of Mass-Spring Systems. ACM Trans. Graph. (SIGGRAPH Asia) 32, 6, Article 214 (Nov. 2013), 7 pages.Google Scholar
28. Mickaël Ly, Jean Jouve, Laurence Boissieux, and Florence Bertails-Descoubes. 2020. Projective Dynamics with Dry Frictional Contact. ACM Trans. Graph. (SIGGRAPH) 39, 4, Article 57 (July 2020), 8 pages.Google ScholarDigital Library
29. Miles Macklin, Matthias Müller, Nuttapong Chentanez, and Tae-Yong Kim. 2014. Unified Particle Physics for Real-Time Applications. ACM Trans. Graph. (SIGGRAPH) 33, 4, Article 153 (July 2014), 12 pages.Google ScholarDigital Library
30. Matthias Müller. 2008. Hierarchical Position Based Dynamics. In Workshop on Virtual Reality Interaction and Physical Simulation (VRIPHYS).Google Scholar
31. Matthias Müller and Nuttapong Chentanez. 2010. Wrinkle Meshes. In Proceedings of SCA. 85–92.Google Scholar
32. Matthias Müller, Nuttapong Chentanez, Tae Yong Kim, and Miles Macklin. 2014. Strain Based Dynamics. In Proceedings of SCA. 149–157.Google Scholar
33. Rahul Narain, Matthew Overby, and George E. Brown. 2016. ADMM ⊇ Projective Dynamics: Fast Simulation of General Constitutive Models. In Proceedings of SCA. 21–28.Google ScholarDigital Library
34. Rahul Narain, Armin Samii, and James F. O’Brien. 2012. Adaptive Anisotropic Remeshing for Cloth Simulation. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, Article 152 (Nov. 2012), 10 pages.Google Scholar
35. Alexandros Neophytou and Adrian Hilton. 2014. A Layered Model of Human Body and Garment Deformation. In Proceedings of the 2014 2nd International Conference on 3D Vision, Vol. 1. 171–178.Google ScholarDigital Library
36. NVIDIA. 2021. NvCloth. https://gameworksdocs.nvidia.com/NvCloth/1.1/index.html.Google Scholar
37. SeungWoo Oh, Junyong Noh, and Kwangyun Wohn. 2008. A Physically Faithful Multigrid Method for Fast Cloth Simulation. Computer Animation and Virtual Worlds 19, 3 (2008), 479–492.Google ScholarDigital Library
38. Pontus Pall, Oskar Nylén, and Marco Fratarcangeli. 2018. Fast Quadrangular Mass-Spring Systems Using Red-Black Ordering. In Workshop on Virtual Reality Interaction and Physical Simulation (VRIPHYS). 7 pages.Google Scholar
39. Alexandros Papageorgiou and Nikos Platis. 2015. Triangular Mesh Simplification on the GPU. Vis. Comput. 31, 2 (Feb. 2015), 235–244.Google ScholarDigital Library
40. Chaitanya Patel, Zhouyingcheng Liao, and Gerard Pons-Moll. 2020. TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
41. Gerard Pons-Moll, Sergi Pujades, Sonny Hu, and Michael J. Black. 2017. ClothCap: Seamless 4D Clothing Capture and Retargeting. ACM Trans. Graph. (SIGGRAPH) 36, 4, Article 73 (July 2017), 15 pages.Google ScholarDigital Library
42. Xavier Provot. 1995. Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior. In Graphics Interface. 147–154.Google Scholar
43. Xavier Provot. 1997. Collision and Self-Collision Handling in Cloth Model Dedicated to Design Garments. In Computer Animation and Simulation. 177–189.Google Scholar
44. Igor Santesteban, Miguel A. Otaduy, and Dan Casas. 2019. Learning-Based Animation of Clothing for Virtual Try-On. Comput. Graph. Forum (Eurographics) 38, 2 (May 2019), 355–366.Google Scholar
45. Nikolas Schmitt, Martin Knuth, Jan Bender, and Arjan Kuijper. 2013. Multilevel Cloth Simulation using GPU Surface Sampling. In Workshop on Virtual Reality Interaction and Physical Simulation (VRIPHYS).Google Scholar
46. Andrew Selle, Jonathan Su, Geoffrey Irving, and Ronald Fedkiw. 2009. Robust High-Resolution Cloth Using Parallelism, History-Based Collisions, and Accurate Friction. IEEE Transactions on Visualization and Computer Graphics 15, 2 (March 2009), 339–350.Google ScholarDigital Library
47. Georg Sperl, Rahul Narain, and Chris Wojtan. 2020. Homogenized Yarn-Level Cloth. ACM Trans. Graph. (SIGGRAPH) 39, 4, Article 48 (July 2020), 16 pages.Google ScholarDigital Library
48. Jos Stam. 2009. Nucleus: Towards a Unified Dynamics Solver for Computer Graphics. In 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.Google ScholarCross Ref
49. Rasmus Tamstorf, Toby Jones, and Stephen F. McCormick. 2015. Smoothed Aggregation Multigrid for Cloth Simulation. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, Article 245 (Oct. 2015), 13 pages.Google Scholar
50. Min Tang, Ruofeng Tong, Rahul Narain, Chang Meng, and Dinesh Manocha. 2013. A GPU-based Streaming Algorithm for High-Resolution Cloth Simulation. Computer Graphics Forum 32, 7 (2013), 21–30.Google ScholarCross Ref
51. Min Tang, Huamin Wang, Le Tang, Ruofeng Tong, and Dinesh Manocha. 2016. CAMA: Contact-Aware Matrix Assembly with Unified Collision Handling for GPU-Based Cloth Simulation. Comput. Graph. Forum (Eurographics) 35, 2 (May 2016), 511–521.Google ScholarCross Ref
52. Min Tang, tongtong wang, Zhongyuan Liu, Ruofeng Tong, and Dinesh Manocha. 2018. I-Cloth: Incremental Collision Handling for GPU-Based Interactive Cloth Simulation. ACM Trans. Graph. (SIGGRAPH Asia) 37, 6, Article 204 (Dec. 2018), 10 pages.Google Scholar
53. Demetri Terzopoulos, John Platt, Alan Barr, and Kurt Fleischer. 1987. Elastically deformable models. Computer Graphics (SIGGRAPH 87) 21, 4 (Aug. 1987), 205–214.Google Scholar
54. Bernhard Thomaszewski, Simon Pabst, and Wolfgang Straßer. 2009. Continuum-Based Strain Limiting. Comput. Graph. Forum (Eurographics) 28, 2 (April 2009), 569–576.Google ScholarCross Ref
55. Raquel Vidaurre, Igor Santesteban, Elena Garces, and Dan Casas. 2020. Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On. Comput. Graph. Forum 39, 8 (Dec. 2020), 145–156.Google ScholarDigital Library
56. J. Villard and H. Borouchaki. 2005. Adaptive Meshing for Cloth Animation. Eng. with Comput. 20, 4 (Aug. 2005), 333–341.Google Scholar
57. Pascal Volino and Nadia Magnenat-Thalmann. 2006. Resolving Surface Collisions through Intersection Contour Minimization. ACM Trans. Graph. (SIGGRAPH) 25 (July 2006), 1154–1159. Issue 3.Google ScholarDigital Library
58. Pascal Volino, Nadia Magnenat-Thalmann, and Francois Faure. 2009. A Simple Approach to Nonlinear Tensile Stiffness for Accurate Cloth Simulation. ACM Trans. Graph. 28, 4, Article 105 (Sept. 2009), 16 pages.Google ScholarDigital Library
59. Huamin Wang. 2015. A Chebyshev Semi-Iterative Approach for Accelerating Projective and Position-Based Dynamics. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, Article 246 (Oct. 2015), 9 pages.Google Scholar
60. Huamin Wang, Florian Hecht, Ravi Ramamoorthi, and James F. O’Brien. 2010a. Example-Based Wrinkle Synthesis for Clothing Animation. ACM Trans. Graph. (SIGGRAPH) 29, 4, Article 107 (July 2010), 8 pages.Google ScholarDigital Library
61. Huamin Wang, James F. O’Brien, and Ravi Ramamoorthi. 2010b. Multi-Resolution Isotropic Strain Limiting. ACM Trans. Graph. (SIGGRAPH Asia) 29, 6, Article 156 (Dec. 2010), 10 pages.Google Scholar
62. Huamin Wang and Yin Yang. 2016. Descent Methods for Elastic Body Simulation on the GPU. ACM Trans. Graph. (SIGGRAPH Asia) 35, 6, Article 212 (Nov. 2016), 10 pages.Google Scholar
63. Zhendong Wang, Longhua Wu, Marco Fratarcangeli, Min Tang, and Huamin Wang. 2018. Parallel Multigrid for Nonlinear Cloth Simulation. Comput. Graph. Forum (Pacific Graphics) 37, 7 (2018), 131–141.Google ScholarCross Ref
64. Olof Widlund and Andrea Toselli. 2004. Domain Decomposition Methods – Algorithms and Theory. Springer.Google Scholar
65. Longhua Wu, Botao Wu, Yin Yang, and Huamin Wang. 2020. A Safe and Fast Repulsion Method for GPU-Based Cloth Self Collisions. ACM Trans. Graph. 40, 1, Article 5 (Dec. 2020), 18 pages.Google Scholar
66. Weiwei Xu, Nobuyuki Umentani, Qianwen Chao, Jie Mao, Xiaogang Jin, and Xin Tong. 2014. Sensitivity-Optimized Rigging for Example-Based Real-Time Clothing Synthesis. ACM Trans. Graph. 33, 4, Article 107 (July 2014), 11 pages.Google ScholarDigital Library
67. Jinlong Yang, Jean-Sébastien Franco, Franck Hétroy-Wheeler, and Stefanie Wuhrer. 2018. Analyzing Clothing Layer Deformation Statistics of 3D Human Motions. In The European Conference on Computer Vision (ECCV). 245–261.Google ScholarDigital Library