“ContourCraft: Learning to Resolve Intersections in Neural Multi-garment Simulations”
Conference:
Type(s):
Title:
- ContourCraft: Learning to Resolve Intersections in Neural Multi-garment Simulations
Presenter(s)/Author(s):
Abstract:
We present a learning-based solution for handling collisions and self-intersections. Our method robustly recovers from intersections introduced through missed collisions, self-penetrating bodies, or manually designed multi-layer outfits. The technical core of our method is a novel intersection contour loss that penalizes inter-penetrations and encourages rapid resolution thereof.
References:
[1]
David Baraff, Andrew Witkin, and Michael Kass. 2003. Untangling cloth. ACM Transactions on Graphics (TOG) 22, 3 (2003), 862?870.
[2]
Hugo Bertiche, Meysam Madadi, and Sergio Escalera. 2020. PBNS: physically based neural simulator for unsupervised garment pose space deformation. arXiv preprint arXiv:2012.11310 (2020).
[3]
Hugo Bertiche, Meysam Madadi, and Sergio Escalera. 2022. Neural Cloth Simulation. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1?14.
[4]
Michael J. Black, Priyanka Patel, Joachim Tesch, and Jinlong Yang. 2023. BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion. In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
[5]
Robert Bridson, Ronald Fedkiw, and John Anderson. 2002. Robust treatment of collisions, contact and friction for cloth animation. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques. 594?603.
[6]
Thomas Buffet, Damien Rohmer, Loic Barthe, Laurence Boissieux, and Marie-Paule Cani. 2019. Implicit untangling: A robust solution for modeling layered clothing. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1?12.
[7]
Ick-Hoon Cha and Hyeong-Seok Ko. 2020. Tanglement resolution in clothing simulation with explicit convergence. IEEE Transactions on Visualization and Computer Graphics 28, 7 (2020), 2764?2775.
[8]
CLO Virtual Fashion. 2022. Clo3D. CLO Virtual Fashion. https://clo3d.com/en/Computer Software.
[9]
Lawson Fulton, Vismay Modi, David Duvenaud, David I. W. Levin, and Alec Jacobson. 2019. Latent-space Dynamics for Reduced Deformable Simulation. Computer Graphics Forum (2019).
[10]
Artur Grigorev, Bernhard Thomaszewski, Michael J Black, and Otmar Hilliges. 2023. HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
[11]
Peng Guan, Loretta Reiss, David A Hirshberg, Alexander Weiss, and Michael J Black. 2012. Drape: Dressing any person. ACM Transactions on Graphics (ToG) 31, 4 (2012), 1?10.
[12]
David Harmon, Etienne Vouga, Breannan Smith, Rasmus Tamstorf, and Eitan Grinspun. 2009. Asynchronous contact mechanics. ACM Transactions on Graphics 28 (7 2009). Issue 3. https://doi.org/10.1145/1531326.1531393
[13]
David Harmon, Etienne Vouga, Rasmus Tamstorf, and Eitan Grinspun. 2008. Robust treatment of simultaneous collisions. In ACM SIGGRAPH 2008 papers. 1?4.
[14]
Daniel Holden, Bang Chi Duong, Sayantan Datta, and Derek Nowrouzezahrai. 2019. Subspace Neural Physics: Fast Data-Driven Interactive Simulation. In Proceedings of the 18th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA ?19). Association for Computing Machinery, New York, NY, USA, Article 6, 12 pages. https://doi.org/10.1145/3309486.3340245
[15]
Tero Karras. 2012. Maximizing parallelism in the construction of BVHs, octrees, and k-d trees. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics conference on High-Performance Graphics. 33?37.
[16]
Minchen Li, Zachary Ferguson, Teseo Schneider, Timothy R Langlois, Denis Zorin, Daniele Panozzo, Chenfanfu Jiang, and Danny M Kaufman. 2020. Incremental potential contact: intersection-and inversion-free, large-deformation dynamics.ACM Trans. Graph. 39, 4 (2020), 49.
[17]
Naureen Mahmood, Nima Ghorbani, Nikolaus F Troje, Gerard Pons-Moll, and Michael J Black. 2019. AMASS: Archive of motion capture as surface shapes. In Proceedings of the IEEE/CVF international conference on computer vision. 5442?5451.
[18]
Sebastian Martin, Bernhard Thomaszewski, Eitan Grinspun, and Markus Gross. 2011. Example-Based Elastic Materials. ACM Trans. Graph. 30, 4, Article 72 (jul 2011), 8 pages. https://doi.org/10.1145/2010324.1964967
[19]
Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed A. A. Osman, Dimitrios Tzionas, and Michael J. Black. 2019. Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).
[20]
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W. Battaglia. 2021. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations.
[21]
Cristian Romero, Dan Casas, Jes?s P?rez, and Miguel Otaduy. 2021. Learning Contact Corrections for Handle-Based Subspace Dynamics. ACM Trans. Graph. 40, 4, Article 131 (jul 2021), 12 pages. https://doi.org/10.1145/3450626.3459875
[22]
Igor Santesteban, Miguel Otaduy, Nils Thuerey, and Dan Casas. 2022b. Ulnef: Untangled layered neural fields for mix-and-match virtual try-on. Advances in Neural Information Processing Systems 35 (2022), 12110?12125.
[23]
Igor Santesteban, Miguel A Otaduy, and Dan Casas. 2019. Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 355?366.
[24]
Igor Santesteban, Miguel A Otaduy, and Dan Casas. 2022a. Snug: Self-supervised neural dynamic garments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 8140?8150.
[25]
Igor Santesteban, Nils Thuerey, Miguel A Otaduy, and Dan Casas. 2021. Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11763?11773.
[26]
Yidi Shao, Chen Change Loy, and Bo Dai. 2023. Towards Multi-Layered 3D Garments Animation. arXiv preprint arXiv:2305.10418 (2023).
[27]
Nicholas Sharp, Cristian Romero, Alec Jacobson, Etienne Vouga, Paul Kry, David I.W. Levin, and Justin Solomon. 2023. Data-Free Learning of Reduced-Order Kinematics. In ACM SIGGRAPH 2023 Conference Proceedings (, Los Angeles, CA, USA, ) (SIGGRAPH ?23). Association for Computing Machinery, New York, NY, USA, Article 40, 9 pages. https://doi.org/10.1145/3588432.3591521
[28]
Siyuan Shen, Yin Yang, Tianjia Shao, He Wang, Chenfanfu Jiang, Lei Lan, and Kun Zhou. 2021. High-Order Differentiable Autoencoder for Nonlinear Model Reduction. ACM Trans. Graph. 40, 4, Article 68 (jul 2021), 15 pages. https://doi.org/10.1145/3450626.3459754
[29]
Qingyang Tan, Yi Zhou, Tuanfeng Wang, Duygu Ceylan, Xin Sun, and Dinesh Manocha. 2022. A Repulsive Force Unit for Garment Collision Handling in Neural Networks. In Computer Vision?ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23?27, 2022, Proceedings, Part III. Springer, 451?467.
[30]
Min Tang, Zhongyuan Liu, Ruofeng Tong, and Dinesh Manocha. 2018a. PSCC: Parallel self-collision culling with spatial hashing on GPUs. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1 (2018), 1?18.
[31]
Min Tang, Dinesh Manocha, Jiang Lin, and Ruofeng Tong. 2011. Collision-streams: Fast GPU-based collision detection for deformable models. In Symposium on interactive 3D graphics and games. 63?70.
[32]
Min Tang, Ruofeng Tong, Rahul Narain, Chang Meng, and Dinesh Manocha. 2013. A GPU-based streaming algorithm for high-resolution cloth simulation. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 21?30.
[33]
Min Tang, Tongtong Wang, Zhongyuan Liu, Ruofeng Tong, and Dinesh Manocha. 2018b. I-Cloth: Incremental collision handling for GPU-based interactive cloth simulation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1?10.
[34]
Matthias Teschner, Stefan Kimmerle, Bruno Heidelberger, Gabriel Zachmann, Laks Raghupathi, Arnulph Fuhrmann, M-P Cani, Fran?ois Faure, Nadia Magnenat-Thalmann, Wolfgang Strasser, 2005. Collision detection for deformable objects. In Computer graphics forum, Vol. 24. Wiley Online Library, 61?81.
[35]
Pascal Volino and Nadia Magnenat-Thalmann. 2006. Resolving surface collisions through intersection contour minimization. ACM Transactions on Graphics (TOG) 25, 3 (2006), 1154?1159.
[36]
Huamin Wang. 2021. GPU-based simulation of cloth wrinkles at submillimeter levels. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1?14.
[37]
Jiahong Wang, Yinwei Du, Stelian Coros, and Thomaszewski. 2024. Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces. IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR).
[38]
Tongtong Wang, Zhihua Liu, Min Tang, Ruofeng Tong, and Dinesh Manocha. 2017. Efficient and Reliable Self-Collision Culling Using Unprojected Normal Cones. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 487?498.
[39]
Longhua Wu, Botao Wu, Yin Yang, and Huamin Wang. 2020. A safe and fast repulsion method for GPU-based cloth self collisions. ACM Transactions on Graphics (TOG) 40, 1 (2020), 1?18.
[40]
Juntao Ye, Guanghui Ma, Liguo Jiang, Lan Chen, Jituo Li, Gang Xiong, Xiaopeng Zhang, and Min Tang. 2017. A unified cloth untangling framework through discrete collision detection. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 217?228.
[41]
Juntao Ye, Timo R Nyberg, and Gang Xiong. 2015. Fast discrete intersection detection for cloth penetration resolution. In 2015 IEEE International Conference on Multimedia Big Data. IEEE, 352?357.
[42]
Juntao Ye and Jing Zhao. 2012. The intersection contour minimization method for untangling oriented deformable surfaces. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 311?316.
[43]
Yueqi Zhong. 2009. Fast penetration resolving for multi-layered virtual garment dressing. Textile Research Journal 79, 9 (2009), 815?821.
