“Proxy Asset Generation for Cloth Simulation in Games”
Conference:
Type(s):
Title:
- Proxy Asset Generation for Cloth Simulation in Games
Presenter(s)/Author(s):
Abstract:
This paper presents an automatic pipeline to convert an ill-conditioned high-resolution visual mesh into a single-layer, low-poly proxy mesh. Our approach simulates proxy mesh based on specific use scenarios and optimizes skinning weights, relying on differential skinning with several well-designed loss functions to ensure skinned mesh appears plausible in simulation.
References:
[1]
MOSEK ApS. 2019. The MOSEK optimization toolbox for MATLAB manual. Version 9.0. MOSEK.
[2]
Seungbae Bang and Sung-Hee Lee. 2018. Spline Interface for Intuitive Skinning Weight Editing. ACM Trans. Graph. 37, 5, Article 174 (sep 2018), 14 pages.
[3]
David Baraff and Andrew Witkin. 1998. Large Steps in Cloth Simulation. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’98). Association for Computing Machinery, New York, NY, USA, 43–54.
[4]
Fausto Bernardini, Joshua Mittleman, Holly Rushmeier, Cl?udio Silva, and Gabriel Taubin. 1999. The ball-pivoting algorithm for surface reconstruction. IEEE transactions on visualization and computer graphics 5, 4 (1999), 349–359.
[5]
Sofien Bouaziz, Sebastian Martin, Tiantian Liu, Ladislav Kavan, and Mark Pauly. 2014. Projective Dynamics: Fusing Constraint Projections for Fast Simulation. ACM Trans. Graph. 33, 4, Article 154 (July 2014), 11 pages.
[6]
St?phane Calderon and Tamy Boubekeur. 2017. Bounding Proxies for Shape Approximation. ACM Trans. Graph. 36, 4, Article 57 (jul 2017), 13 pages.
[7]
Weikai Chen, Cheng Lin, Weiyang Li, and Bo Yang. 2022a. 3PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologies. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 18501–18510.
[8]
Zhen Chen, Zherong Pan, Kui Wu, Etienne Vouga, and Xifeng Gao. 2023. Robust Low-Poly Meshing for General 3D Models. ACM Trans. Graph. 42, 4, Article 119 (jul 2023), 20 pages.
[9]
Zhiqin Chen, Andrea Tagliasacchi, Thomas Funkhouser, and Hao Zhang. 2022b. Neural dual contouring. ACM Transactions on Graphics (TOG) 41, 4 (2022), 1–13.
[10]
Zhiqin Chen and Hao Zhang. 2021. Neural marching cubes. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1–15.
[11]
Julian Chibane, Gerard Pons-Moll, et al. 2020. Neural unsigned distance fields for implicit function learning. Advances in Neural Information Processing Systems 33 (2020), 21638–21652.
[12]
Jonathan Cohen, Marc Olano, and Dinesh Manocha. 1998. Appearance-Preserving Simplification. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’98). Association for Computing Machinery, New York, NY, USA, 115–122.
[13]
David Cohen-Steiner, Pierre Alliez, and Mathieu Desbrun. 2004. Variational Shape Approximation. ACM Trans. Graph. 23, 3 (aug 2004), 905–914.
[14]
Olivier Dionne and Martin de Lasa. 2013. Geodesic Voxel Binding for Production Character Meshes. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Anaheim, California) (SCA ’13). Association for Computing Machinery, New York, NY, USA, 173–180.
[15]
Wei-Wen Feng, Byung-Uck Kim, and Yizhou Yu. 2008. Real-Time Data Driven Deformation Using Kernel Canonical Correlation Analysis. In ACM SIGGRAPH 2008 Papers (Los Angeles, California) (SIGGRAPH ’08). Association for Computing Machinery, New York, NY, USA, Article 91, 9 pages.
[16]
Wei-Wen Feng, Yizhou Yu, and Byung-Uck Kim. 2010. A Deformation Transformer for Real-Time Cloth Animation. In ACM SIGGRAPH 2010 Papers (SIGGRAPH ’10). Association for Computing Machinery, New York, NY, USA, Article 108, 9 pages.
[17]
Marco Fratarcangeli, Valentina Tibaldo, and Fabio Pellacini. 2016. Vivace: A Practical Gauss-Seidel Method for Stable Soft Body Dynamics. ACM Trans. Graph. 35, 6, Article 214 (Nov. 2016), 9 pages.
[18]
Xifeng Gao, Kui Wu, and Zherong Pan. 2022. Low-Poly Mesh Generation for Building Models. In ACM SIGGRAPH 2022 Conference Proceedings (Vancouver, BC, Canada) (SIGGRAPH ’22). Association for Computing Machinery, New York, NY, USA, Article 3, 9 pages.
[19]
Michael Garland and Paul S. Heckbert. 1997. Surface Simplification Using Quadric Error Metrics. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., USA, 209–216.
[20]
Timothy D Gatzke and Cindy M Grimm. 2006. Estimating curvature on triangular meshes. International journal of shape modeling 12, 01 (2006), 1–28.
[21]
Beno?t Guillard, Federico Stella, and Pascal Fua. 2022. MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks. In Computer Vision – ECCV 2022, Shai Avidan, Gabriel Brostow, Moustapha Ciss?, Giovanni Maria Farinella, and Tal Hassner (Eds.). Springer Nature Switzerland, Cham, 576–592.
[22]
Hugues Hoppe, Tony DeRose, Tom Duchamp, John McDonald, and Werner Stuetzle. 1993. Mesh Optimization. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, CA) (SIGGRAPH ’93). Association for Computing Machinery, New York, NY, USA, 19–26.
[23]
Fei Hou, Xuhui Chen, Wencheng Wang, Hong Qin, and Ying He. 2023. Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering. ACM Transactions on Graphics (TOG) 42, 6 (2023), 1–15.
[24]
Alec Jacobson, Ilya Baran, Jovan Popovi?, and Olga Sorkine. 2011. Bounded Biharmonic Weights for Real-Time Deformation. ACM Trans. Graph. 30, 4, Article 78 (jul 2011), 8 pages.
[25]
Wenzel Jakob, Marco Tarini, Daniele Panozzo, and Olga Sorkine-Hornung. 2015. Instant Field-Aligned Meshes. ACM Trans. Graph. 34, 6, Article 189 (nov 2015), 15 pages.
[26]
Doug L. James and Christopher D. Twigg. 2005. Skinning Mesh Animations. ACM Trans. Graph. 24, 3 (jul 2005), 399–407.
[27]
Ladislav Kavan, Steven Collins, Ji?? ??ra, and Carol O’Sullivan. 2007. Skinning with Dual Quaternions. In Proceedings of the 2007 Symposium on Interactive 3D Graphics and Games (Seattle, Washington) (I3D ’07). Association for Computing Machinery, New York, NY, USA, 39–46.
[28]
Ladislav Kavan, Dan Gerszewski, Adam W. Bargteil, and Peter-Pike Sloan. 2011. Physics-Inspired Upsampling for Cloth Simulation in Games. In ACM SIGGRAPH 2011 Papers (Vancouver, British Columbia, Canada) (SIGGRAPH ’11). Association for Computing Machinery, New York, NY, USA, Article 93, 10 pages.
[29]
Ladislav Kavan and Ji?? ??ra. 2005. Spherical Blend Skinning: A Real-Time Deformation of Articulated Models. In Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games (Washington, District of Columbia) (I3D ’05). Association for Computing Machinery, New York, NY, USA, 9–16.
[30]
Dawar Khan, Alexander Plopski, Yuichiro Fujimoto, Masayuki Kanbara, Gul Jabeen, Yongjie Jessica Zhang, Xiaopeng Zhang, and Hirokazu Kato. 2022. Surface Remeshing: A Systematic Literature Review of Methods and Research Directions. IEEE Transactions on Visualization and Computer Graphics 28, 3 (2022), 1680–1713.
[31]
Meekyoung Kim, Gerard Pons-Moll, Sergi Pujades, Seungbae Bang, Jinwook Kim, Michael J. Black, and Sung-Hee Lee. 2017. Data-Driven Physics for Human Soft Tissue Animation. ACM Trans. Graph. 36, 4, Article 54 (jul 2017), 12 pages.
[32]
Scott Kircher and Michael Garland. 2005. Progressive multiresolution meshes for deforming surfaces. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (Los Angeles, California) (SCA ’05). Association for Computing Machinery, New York, NY, USA, 191–200.
[33]
Vladimir Kolmogorov and Ramin Zabin. 2004. What energy functions can be minimized via graph cuts? IEEE transactions on pattern analysis and machine intelligence 26, 2 (2004), 147–159.
[34]
Nikos Komodakis and Georgios Tziritas. 2007. Approximate labeling via graph cuts based on linear programming. IEEE transactions on pattern analysis and machine intelligence 29, 8 (2007), 1436–1453.
[35]
Eric Landreneau and Scott Schaefer. 2009. Simplification of Articulated Meshes. Computer Graphics Forum 28, 2 (2009), 347–353.
[36]
Binh Huy Le and Zhigang Deng. 2014. Robust and Accurate Skeletal Rigging from Mesh Sequences. ACM Trans. Graph. 33, 4, Article 84 (jul 2014), 10 pages.
[37]
Minglei Li and Liangliang Nan. 2021. Feature-preserving 3D mesh simplification for urban buildings. ISPRS Journal of Photogrammetry and Remote Sensing 173 (2021), 135–150.
[38]
Selena Zihan Ling, Nicholas Sharp, and Alec Jacobson. 2022. VectorAdam for Rotation Equivariant Geometry Optimization. Advances in Neural Information Processing Systems 35 (2022), 4111–4122.
[39]
Lijuan Liu, Youyi Zheng, Di Tang, Yi Yuan, Changjie Fan, and Kun Zhou. 2019. NeuroSkinning: Automatic Skin Binding for Production Characters with Deep Graph Networks. ACM Trans. Graph. 38, 4, Article 114 (jul 2019), 12 pages.
[40]
Tiantian Liu, Adam W. Bargteil, James F. O’Brien, and Ladislav Kavan. 2013. Fast Simulation of Mass-Spring Systems. ACM Trans. Graph. 32, 6, Article 214 (Nov. 2013), 7 pages.
[41]
Yu-Tao Liu, Li Wang, Jie Yang, Weikai Chen, Xiaoxu Meng, Bo Yang, and Lin Gao. 2023. Neudf: Leaning neural unsigned distance fields with volume rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Los Alamitos, CA, USA, 237–247.
[42]
Xiaoxiao Long, Cheng Lin, Lingjie Liu, Yuan Liu, Peng Wang, Christian Theobalt, Taku Komura, and Wenping Wang. 2023. NeuralUDF: Learning Unsigned Distance Fields for Multi-View Reconstruction of Surfaces with Arbitrary Topologies. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 20834–20843.
[43]
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graph. 34, 6, Article 248 (oct 2015), 16 pages.
[44]
William E. Lorensen and Harvey E. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’87). Association for Computing Machinery, New York, NY, USA, 163–169.
[45]
Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 0, 0 (2017), 0.
[46]
Micka?l Ly, Jean Jouve, Laurence Boissieux, and Florence Bertails-Descoubes. 2020. Projective Dynamics with Dry Frictional Contact. ACM Trans. Graph. 39, 4, Article 57 (July 2020), 8 pages.
[47]
Miles Macklin, Matthias M?ller, and Nuttapong Chentanez. 2016. XPBD: Position-Based Simulation of Compliant Constrained Dynamics. In Proceedings of the 9th International Conference on Motion in Games (Burlingame, California) (MIG ’16). Association for Computing Machinery, New York, NY, USA, 49–54.
[48]
Ravish Mehra, Qingnan Zhou, Jeremy Long, Alla Sheffer, Amy Gooch, and Niloy J. Mitra. 2009. Abstraction of Man-Made Shapes. ACM Trans. Graph. 28, 5 (dec 2009), 1–10.
[49]
miHoYo. 2020. HoYoLAB. https://ys.biligame.com/gczj/.
[50]
Tomohiko Mukai and Shigeru Kuriyama. 2016. Efficient Dynamic Skinning with Low-Rank Helper Bone Controllers. ACM Trans. Graph. 35, 4, Article 36 (jul 2016), 11 pages.
[51]
Matthias M?ller, Bruno Heidelberger, Marcus Hennix, and John Ratcliff. 2007a. Position Based Dynamics. J. Vis. Comun. Image Represent. 18, 2 (April 2007), 109–118.
[52]
Matthias M?ller, Bruno Heidelberger, Marcus Hennix, and John Ratcliff. 2007b. Position Based Dynamics. J. Vis. Comun. Image Represent. 18, 2 (April 2007), 109–118.
[53]
NVIDIA. 2021. NVIDIA PhysX. https://developer.nvidia.com/physx-sdk. Version 4.1.
[54]
Siyu Ren, Junhui Hou, Xiaodong Chen, Ying He, and Wenping Wang. 2023. Geoudf: Surface reconstruction from 3d point clouds via geometry-guided distance representation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. IEEE Computer Society, Los Alamitos, CA, USA, 14214–14224.
[55]
William J. Schroeder, Jonathan A. Zarge, and William E. Lorensen. 1992. Decimation of Triangle Meshes. SIGGRAPH Comput. Graph. 26, 2 (jul 1992), 65–70.
[56]
Jonathan Richard Shewchuk. 2002. What is a good linear element? interpolation, conditioning, and quality measures. In IMR. n/a, n/a, 115–126.
[57]
Weiguang Si, Sung-Hee Lee, Eftychios Sifakis, and Demetri Terzopoulos. 2015. Realistic Biomechanical Simulation and Control of Human Swimming. ACM Trans. Graph. 34, 1, Article 10 (dec 2015), 15 pages.
[58]
Olga Sorkine and Marc Alexa. 2007. As-Rigid-as-Possible Surface Modeling. In Proceedings of the Fifth Eurographics Symposium on Geometry Processing (Barcelona, Spain) (SGP ’07). Eurographics Association, Goslar, DEU, 109–116.
[59]
Demetri Terzopoulos, John Platt, Alan Barr, and Kurt Fleischer. 1987. Elastically Deformable Models. SIGGRAPH Comput. Graph. 21, 4 (Aug. 1987), 205–214.
[60]
Jean-Marc Thiery and Elmar Eisemann. 2018. ARAPLBS: Robust and Efficient Elasticity-Based Optimization of Weights and Skeleton Joints for Linear Blend Skinning with Parametrized Bones. Computer Graphics Forum 37, 1 (2018), 32–44.
[61]
S?bastien Valette and Jean-Marc Chassery. 2004. Approximated Centroidal Voronoi Diagrams for Uniform Polygonal Mesh Coarsening. Computer Graphics Forum 23, 3 (2004), 381–389.
[62]
Huamin Wang. 2015. A Chebyshev Semi-Iterative Approach for Accelerating Projective and Position-Based Dynamics. ACM Trans. Graph. 34, 6, Article 246 (Oct. 2015), 9 pages.
[63]
Li Wang, Weikai Chen, Xiaoxu Meng, Bo Yang, Jintao Li, Lin Gao, et al. 2022. HSDF: Hybrid Sign and Distance Field for Modeling Surfaces with Arbitrary Topologies. Advances in Neural Information Processing Systems 35 (2022), 32172–32185.
[64]
Zhendong Wang, Longhua Wu, Marco Fratarcangeli, Min Tang, and Huamin Wang. 2018. Parallel Multigrid for Nonlinear Cloth Simulation. Computer Graphics Forum 37, 7 (2018), 131–141.
[65]
Kui Wu, Xu He, Zherong Pan, and Xifeng Gao. 2022. Occluder Generation for Buildings in Digital Games. Computer Graphics Forum 41, 7 (2022), 205–214.
[66]
Zangyueyang Xian, Xin Tong, and Tiantian Liu. 2019. A Scalable Galerkin Multigrid Method for Real-Time Simulation of Deformable Objects. ACM Trans. Graph. 38, 6, Article 162 (Nov. 2019), 13 pages.
[67]
Zhan Xu, Yang Zhou, Evangelos Kalogerakis, Chris Landreth, and Karan Singh. 2020. RigNet: Neural Rigging for Articulated Characters. ACM Trans. Graph. 39, 4, Article 58 (aug 2020), 14 pages.
[68]
Eugene Zhang and Greg Turk. 2002. Visibility-Guided Simplification. In Proceedings of the Conference on Visualization ’02 (Boston, Massachusetts) (VIS ’02). IEEE Computer Society, USA, 267–274.
[69]
Jiayi Eris Zhang, J?r?mie Dumas, Yun Fei, Alec Jacobson, Doug L James, and Danny M Kaufman. 2022. Progressive simulation for cloth quasistatics. ACM Transactions on Graphics (TOG) 41, 6 (2022), 1–16.
[70]
Zhongtian Zheng, Xifeng Gao, Zherong Pan, Wei Li, Peng-Shuai Wang, Guoping Wang, and Kui Wu. 2023. Visual-Preserving Mesh Repair. IEEE Transactions on Visualization and Computer Graphics 1, 1 (2023), 1–12.
[71]
Junsheng Zhou, Baorui Ma, Shujuan Li, Yu-Shen Liu, and Zhizhong Han. 2023. Learning a more continuous zero level set in unsigned distance fields through level set projection. In Proceedings of the IEEE/CVF international conference on computer vision. IEEE Computer Society, Los Alamitos, CA, USA, 3181–3192.
