“Stable spaces for real-time clothing” by de Aguiar, Sigal, Treuille and Hodgins

We present a technique for learning clothing models that enables the simultaneous animation of thousands of detailed garments in real-time. This surprisingly simple conditional model learns and preserves the key dynamic properties of a cloth motion along with folding details. Our approach requires no a priori physical model, but rather treats training data as a “black box.” We show that the models learned with our method are stable over large time-steps and can approximately resolve cloth-body collisions. We also show that within a class of methods, no simpler model covers the full range of cloth dynamics captured by ours. Our method bridges the current gap between skinning and physical simulation, combining benefits of speed from the former with dynamic effects from the latter. We demonstrate our approach on a variety of apparel worn by male and female human characters performing a varied set of motions typically used in video games (e.g., walking, running, jumping, etc.).

1. An, S., Kim, T., and James, D. 2008. Optimizing cubature for efficient integration of subspace deformations. ACM Transactions on Graphics 27, 5. Google ScholarDigital Library
2. Baraff, D., and Witkin, A. P. 1998. Large steps in cloth simulation. ACM Transactions on Graphics, 43–54.Google Scholar
3. Baraff, D., Witkin, A., and Kass, M. 2003. Untangling cloth. ACM Transactions on Graphics 22, 3, 862–870. Google ScholarDigital Library
4. Barbič, J., and James, D. L. 2005. Real-time subspace integration for st. venant-kirchhoff deformable models. ACM Transactions on Graphics 24, 3, 982–990. Google ScholarDigital Library
5. Bridson, R., Marino, S., and Fedkiw, R. 2003. Simulation of clothing with folds and wrinkles. In ACM/Eurographics Symposium on Computer Animation, 28–36. Google ScholarDigital Library
6. Bridson, R. 2005. Cloth collisions and contact. ACM SIGGRAPH 2005 Course Notes.Google ScholarDigital Library
7. Chui, N. L. C., and Maciejowski, J. M. 1996. Realization of stable models with subspace methods. Automatica 32, 11, 1587–1595. Google ScholarDigital Library
8. Cordier, F., and Magnenat-Thalmann, N. 2005. A data-driven approach for real-time clothes simulation. In Pacific Conference on Computer Graphics and Applications, vol. 24, 257–266. Google ScholarDigital Library
9. Cordier, F., and Thalmann, N. M. 2002. Real-time animation of dressed virtual humans. In Computer Graphics Forum, vol. 21, 327–335.Google ScholarCross Ref
10. Cutler, L., Gershbein, R., Wang, X., Curtis, C., Maigret, E., and Prasso, L. 2005. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation.Google Scholar
11. English, E., and Bridson, R. 2008. Animating developable surfaces using nonconforming elements. ACM Transactions on Graphics 27, 3, 66:1–66:5. Google ScholarDigital Library
12. Ghahramani, Z., and Hinton, G. E. 1996. Parameter estimation for linear dynamical systems. Tech. Rep. CRG-TR-96-2, University of Toronto.Google Scholar
13. Goldenthal, R., Harmon, D., Fattal, R., Bercovier, M., and Grinspun, E. 2007. Efficient simulation of inextensible cloth. ACM Transactions on Graphics 26, 3, 49. Google ScholarDigital Library
14. Grinspun, E., Hirani, A. N., Desbrun, M., and Schrćder, P. 2003. Discrete shells. In 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 62–67. Google ScholarDigital Library
15. Harmon, D., Vouga, E., Smith, B., Tamstorf, R., and Grinspun, E. 2009. Asynchronous contact mechanics. ACM Transactions on Graphics 28, 3. Google ScholarDigital Library
16. Hinton, G., and Roweis, S. 2002. Stochastic neighbor embedding. In Advances in Neural Information Processing Systems, vol. 15, 833–840.Google ScholarDigital Library
17. Hotelling, H. 1933. Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology 24, 417–441.Google ScholarCross Ref
18. James, D. L., and Fatahalian, K. 2003. Precomputing interactive dynamic deformable scenes. ACM Transactions on Graphics 22, 3, 879–887. Google ScholarDigital Library
19. James, D. L., and Twigg, C. D. 2005. Skinning mesh animations. ACM Transactions on Graphics 24, 3, 399–407. Google ScholarDigital Library
20. Kalman, R. 1960. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82, Series D, 35–45.Google ScholarCross Ref
21. Kang, Y.-M., and Cho, H.-G. 2002. Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. In Proceedings of Computer Animation, 203–211. Google ScholarDigital Library
22. Kang, Y.-M., Choi, J.-H., Cho, H.-G., and Lee, D.-H. 2001. An efficient animation of wrinkled cloth with approximate implicit integration. The Visual Computer 17, 3, 147–157.Google ScholarCross Ref
23. Kavan, L., Sloan, P.-P., and O’Sullivan, C. 2010. Fast and efficient skinning of animated meshes. Computer Graphics Forum 29, 2.Google ScholarCross Ref
24. Kim, T.-Y., and Vendrovsky, E. 2008. Drivenshape – a data-driven approach for shape deformation. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Google ScholarDigital Library
25. Kry, P. G., James, D. L., and Pai, D. K. 2002. Eigenskin: real time large deformation character skinning in hardware. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 153–159. Google ScholarDigital Library
26. Lacy, S., and Bernstein, D. 2003. Subspace identification with guaranteed stability using constrained optimization. IEEE Transactions on Automatic Control 48, 7, 1259–1263.Google ScholarCross Ref
27. Larboulette, C., Cani, M.-P., and Arnaldi, B. 2005. Dynamic skinning: Adding real-time dynamic effects to an existing character animation. In Spring Conference on Computer Graphics (SCCG). Google ScholarDigital Library
28. Lawrence, N. 2005. Probabilistic non-linear principal component analysis with gaussian process latent variable models. Journal of Machine Learning Research 6, 1783–1816. Google ScholarDigital Library
29. Ljung, L. 1986. System identification: theory for the user. Prentice-Hall, Inc., Upper Saddle River, NJ, USA. Google ScholarDigital Library
30. Nguyen, H., and Donnelly, W. 2005. Hair animation and rendering in the nalu demo. In GPU Gems 2: Programming Techniques for High-Performance Graphics and General-Purpose Computation (Gpu Gems), M. Pharr and R. Fernando, Eds. Addison-Wesley Professional, ch. 23.Google Scholar
31. Reissell, L., and Pai, D. 2001. Modeling stochastic dynamical systems for interactive simulation. In Computer Graphics Forum, vol. 20, 339–348.Google ScholarCross Ref
32. Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science, 5500, 2323–2326.Google ScholarCross Ref
33. Rudomin, I., and Castillo, J. L. 2002. Real-time clothing: Geometry and physics. WSCG 2002 Posters, 45–48.Google Scholar
34. Selle, A., Su, J., Irving, G., and Fedkiw, R. 2009. Robust high-resolution cloth using parallelism, history-based collisions, and accurate friction. IEEE Transactions on Visualization and Computer Graphics 15, 2, 339–350. Google ScholarDigital Library
35. Shi, X., Zhou, K., Tong, Y., Desbrun, M., Bao, H., and Guo, B. 2008. Example-based dynamic skinning in real time. ACM Transactions on Graphics 27, 3, 1–8. Google ScholarDigital Library
36. Siddiqi, S., Boots, B., and Gordon, G. 2007. A constraint generation approach to learning stable linear dynamical systems. In Advances in Neural Information Processing Systems.Google Scholar
37. Soderstrom, T., and Stoica, P. 1989. System Identification. Prentice-Hall, Upper Saddle River, NJ. Google ScholarDigital Library
38. Stam, J. 2009. Nucleus: Towards a unified dynamics solver for computer graphics. In IEEE International Conference on Computer-Aided Design and Computer Graphics, 1–11.Google ScholarCross Ref
39. Tenenbaum, J., de Silva, V., and Langford, J. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500, 2319–2323.Google Scholar
40. Treuille, A., Lewis, A., and Popović, Z. 2006. Model reduction for real-time fluids. ACM Transactions on Graphics 25, 826–834. Google ScholarDigital Library
41. Van Gestel, T., Suykens, J., Van Dooren, P., and De Moor, B. 2001. Identification of stable models in subspace identification by using regularization. IEEE Transactions on Automatic Control 46, 9, 1416–1420.Google ScholarCross Ref
42. van Overschee, P., and de Moor, B. L. R. 1996. Subspace identification for linear systems: theory, implementation, applications. Springer.Google Scholar
43. Vassilev, T., Spanlang, B., and Chrysanthou, Y. 2001. Fast cloth animation on walking avatars. Computer Graphics Forum 20, 3, 260–267.Google ScholarCross Ref
44. Viberg, M. 1995. Subspace-based methods for the identification of linear time-invariant systems. Automatica 31, 12, 1835–1851. Google ScholarDigital Library
45. Volino, P., and Magnenat-Thalmann, N. 2005. Implicit midpoint integration and adaptive damping for efficient cloth simulation: Collision detection and deformable objects. Computer Animation and Virtual Worlds 16, 3–4, 163–175. Google ScholarDigital Library