“Robust and accurate skeletal rigging from mesh sequences” by Le and Deng

  • ©Binh Huy Le and Zhigang Deng

Conference:


Type:


Title:

    Robust and accurate skeletal rigging from mesh sequences

Session/Category Title: Animating Characters


Presenter(s)/Author(s):


Moderator(s):



Abstract:


    We introduce an example-based rigging approach to automatically generate linear blend skinning models with skeletal structure. Based on a set of example poses, our approach can output its skeleton, joint positions, linear blend skinning weights, and corresponding bone transformations. The output can be directly used to set up skeleton-based animation in various 3D modeling and animation software as well as game engines. Specifically, we formulate the solving of a linear blend skinning model with a skeleton as an optimization with joint constraints and weight smoothness regularization, and solve it using an iterative rigging algorithm that (i) alternatively updates skinning weights, joint locations, and bone transformations, and (ii) automatically prunes redundant bones that can be generated by an over-estimated bone initialization. Due to the automatic redundant bone pruning, our approach is more robust than existing example-based rigging approaches. Furthermore, in terms of rigging accuracy, even with a single set of parameters, our approach can soundly outperform state of the art methods on various types of experimental datasets including humans, quadrupled animals, and highly deformable models.

References:


    1. Ali-Hamadi, D., Liu, T., Gilles, B., Kavan, L., Faure, F., Palombi, O., and Cani, M.-P. 2013. Anatomy transfer. ACM Trans. Graph. 32, 6 (Nov.), 188:1–188:8. Google ScholarDigital Library
    2. Anguelov, D., Koller, D., Pang, H.-C., Srinivasan, P., and Thrun, S. 2004. Recovering articulated object models from 3D range data. In UAI’04: Proc. of Conf. on Uncertainty in Artificial Intelligence, 18–26. Google ScholarDigital Library
    3. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. Scape: Shape completion and animation of people. ACM Trans. Graph. 24, 3 (July), 408–416. Google ScholarDigital Library
    4. Au, O. K.-C., Tai, C.-L., Chu, H.-K., Cohen-Or, D., and Lee, T.-Y. 2008. Skeleton extraction by mesh contraction. ACM Trans. Graph. 27, 3 (Aug.), 44:1–44:10. Google ScholarDigital Library
    5. Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26, 3 (July). Google ScholarDigital Library
    6. Briceño, H. M., Sander, P. V., McMillan, L., Gortler, S., and Hoppe, H. 2003. Geometry videos: A new representation for 3D animations. In SCA’03: Proc. of Symp. on Computer Animation, 136–146. Google ScholarDigital Library
    7. de Aguiar, E., Theobalt, C., Thrun, S., and Seidel, H.-P. 2008. Automatic conversion of mesh animations into skeleton-based animations. Comput. Graph. Forum 27, 2 (4), 389–397.Google Scholar
    8. de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. ACM Trans. Graph. 27, 3 (Aug.), 98:1–98:10. Google ScholarDigital Library
    9. Hahn, F., Martin, S., Thomaszewski, B., Sumner, R., Coros, S., and Gross, M. 2012. Rig-space physics. ACM Trans. Graph. 31, 4 (July), 72:1–72:8. Google ScholarDigital Library
    10. Hasler, N., Thormählen, T., Rosenhahn, B., and Seidel, H.-P. 2010. Learning skeletons for shape and pose. In I3D’10: Proc. of Symp. on Interactive 3D Graphics and Games, 23–30. Google ScholarDigital Library
    11. Huang, H., Wu, S., Cohen-Or, D., Gong, M., Zhang, H., Li, G., and Chen, B. 2013. L1-medial skeleton of point cloud. ACM Trans. Graph. 32, 4 (July), 65:1–65:8. Google ScholarDigital Library
    12. Jacobson, A., and Sorkine, O. 2011. Stretchable and twistable bones for skeletal shape deformation. ACM Trans. Graph. 30, 6 (Dec.), 165:1–165:8. Google ScholarDigital Library
    13. Jacobson, A., Baran, I., Popović, J., and Sorkine, O. 2011. Bounded biharmonic weights for real-time deformation. ACM Trans. Graph. 30, 4 (July), 78:1–78:8. Google ScholarDigital Library
    14. James, D. L., and Twigg, C. D. 2005. Skinning mesh animations. ACM Trans. Graph. 24, 3 (July), 399–407. Google ScholarDigital Library
    15. Kabsch, W. 1978. A discussion of the solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A 34, 827–828.Google ScholarCross Ref
    16. Kavan, L., and Sorkine, O. 2012. Elasticity-inspired deformers for character articulation. ACM Trans. Graph. 31, 6 (Nov.), 196:1–196:8. Google ScholarDigital Library
    17. Kavan, L., Collins, S., Žára, J., and O’Sullivan, C. 2008. Geometric skinning with approximate dual quaternion blending. ACM Trans. Graph. 27, 4 (Nov.), 105:1–105:23. Google ScholarDigital Library
    18. Kavan, L., Sloan, P.-P., and O’Sullivan, C. 2010. Fast and efficient skinning of animated meshes. Comput. Graph. Forum 29, 2, 327–336.Google ScholarCross Ref
    19. Kim, B.-U., Feng, W.-W., and Yu, Y. 2010. Real-time data driven deformation with affine bones. Vis. Comput. 26, 6–8 (June), 487–495. Google ScholarDigital Library
    20. Kirk, A. G., O’Brien, J. F., and Forsyth, D. A. 2005. Skeletal parameter estimation from optical motion capture data. In IEEE CVPR, 782–788. Google ScholarDigital Library
    21. Kruskal, J. B. 1956. On the Shortest Spanning Subtree of a Graph and the Traveling Salesman Problem. Proceedings of the American Mathematical Society 7, 1 (Feb.), 48–50.Google ScholarCross Ref
    22. Landreneau, E., and Schaefer, S. 2010. Poisson-based weight reduction of animated meshes. Comput. Graph. Forum 29, 6, 1945–1954.Google ScholarCross Ref
    23. Le, B. H., and Deng, Z. 2012. Smooth skinning decomposition with rigid bones. ACM Trans. Graph. 31, 6 (Nov.), 199:1–199:10. Google ScholarDigital Library
    24. Le, B. H., and Deng, Z. 2013. Two-layer sparse compression of dense-weight blend skinning. ACM Trans. Graph. 32, 4 (July), 124:1–124:10. Google ScholarDigital Library
    25. Lee, S.-H., Sifakis, E., and Terzopoulos, D. 2009. Comprehensive biomechanical modeling and simulation of the upper body. ACM Trans. Graph. 28, 4 (Sept.), 99:1–99:17. Google ScholarDigital Library
    26. Linde, Y., Buzo, A., and Gray, R. 1980. An algorithm for vector quantizer design. IEEE Trans. on Communication 28, 1, 84–95.Google ScholarCross Ref
    27. Liu, L., Yin, K., Wang, B., and Guo, B. 2013. Simulation and control of skeleton-driven soft body characters. ACM Trans. Graph. 32, 6 (Nov.), 215:1–215:8. Google ScholarDigital Library
    28. Livny, Y., Yan, F., Olson, M., Chen, B., Zhang, H., and El-Sana, J. 2010. Automatic reconstruction of tree skeletal structures from point clouds. ACM Trans. Graph. 29, 6 (Dec.), 151:1–151:8. Google ScholarDigital Library
    29. McAdams, A., Zhu, Y., Selle, A., Empey, M., Tamstorf, R., Teran, J., and Sifakis, E. 2011. Efficient elasticity for character skinning with contact and collisions. ACM Trans. Graph. 30, 4 (July), 37:1–37:12. Google ScholarDigital Library
    30. Merry, B., Marais, P., and Gain, J. 2006. Animation space: A truly linear framework for character animation. ACM Trans. Graph. 25, 4 (Oct.), 1400–1423. Google ScholarDigital Library
    31. Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Trans. Graph. 22, 3 (July), 562–568. Google ScholarDigital Library
    32. Park, S. I., and Hodgins, J. K. 2006. Capturing and animating skin deformation in human motion. ACM Trans. Graph. 25, 3 (July), 881–889. Google ScholarDigital Library
    33. Schaefer, S., and Yuksel, C. 2007. Example-based skeleton extraction. In SGP’07: Proc. of Symp. on Geometry Processing, 153–162. Google ScholarDigital Library
    34. Stoll, C., Gall, J., de Aguiar, E., Thrun, S., and Theobalt, C. 2010. Video-based reconstruction of animatable human characters. ACM Trans. Graph. 29, 6 (Dec.), 139:1–139:10. Google ScholarDigital Library
    35. Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. Graph. 23, 3 (Aug.), 399–405. Google ScholarDigital Library
    36. Tagliasacchi, A., Zhang, H., and Cohen-Or, D. 2009. Curve skeleton extraction from incomplete point cloud. ACM Trans. Graph. 28, 3 (July), 71:1–71:9. Google ScholarDigital Library
    37. Utah, 2013. The utah 3D animation repository.Google Scholar
    38. Vaillant, R., Barthe, L., Guennebaud, G., Cani, M.-P., Rohmer, D., Wyvill, B., Gourmel, O., and Paulin, M. 2013. Implicit skinning: Real-time skin deformation with contact modeling. ACM Trans. Graph. 32, 4 (July), 125:1–125:12. Google ScholarDigital Library
    39. Vlasic, D., Baran, I., Matusik, W., and Popović, J. 2008. Articulated mesh animation from multi-view silhouettes. ACM Trans. Graph. 27, 3 (Aug.), 97:1–97:9. Google ScholarDigital Library
    40. Vlasic, D., Peers, P., Baran, I., Debevec, P., Popović, J., Rusinkiewicz, S., and Matusik, W. 2009. Dynamic shape capture using multi-view photometric stereo. ACM Trans. Graph. 28, 5 (Dec.), 174:1–174:11. Google ScholarDigital Library
    41. Wang, X. C., and Phillips, C. 2002. Multi-weight enveloping: least-squares approximation techniques for skin animation. In SCA’02: Proc. of Symp. on Computer animation, 129–138. Google ScholarDigital Library


ACM Digital Library Publication:



Overview Page: