“SCAPE: shape completion and animation of people” by Anguelov, Srinivasan, Koller, Thrun, Rodgers, et al. …

  • ©Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, and James E. Davis

Conference:


Type:


Title:

    SCAPE: shape completion and animation of people

Presenter(s)/Author(s):



Abstract:


    We introduce the SCAPE method (Shape Completion and Animation for PEople)—a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both articulated and non-rigid deformations. We learn a pose deformation model that derives the non-rigid surface deformation as a function of the pose of the articulated skeleton. We also learn a separate model of variation based on body shape. Our two models can be combined to produce 3D surface models with realistic muscle deformation for different people in different poses, when neither appear in the training set. We show how the model can be used for shape completion — generating a complete surface mesh given a limited set of markers specifying the target shape. We present applications of shape completion to partial view completion and motion capture animation. In particular, our method is capable of constructing a high-quality animated surface model of a moving person, with realistic muscle deformation, using just a single static scan and a marker motion capture sequence of the person.

References:


    1. Allen, B., Curless, B., and Popović, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics, 21(3), 612–619. Google ScholarDigital Library
    2. Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics, 22(3), 587–594. Google ScholarDigital Library
    3. Anguelov, D., Koller, D., Pang, H., Srinivasan, P., and Thrun, S. 2004. Recovering articulated object models from 3D range data. In Proceedings of the 20th conference on Uncertainty in artificial intelligence, 18–26. Google ScholarDigital Library
    4. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Pang, H., and Davis, J. 2005. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Information Processing Systems 17, 33–40.Google Scholar
    5. Cheung, K. M., Baker, S., and Kanade, T. 2003. Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. In Conference on Computer Vision and Pattern Recognition (CVPR), 77–84. Google ScholarDigital Library
    6. Curless, B., and Levoy, M. 1996. A volumetric method of building complex models from range images. Proceedings of SIGGRAPH 1996, 303–312. Google ScholarDigital Library
    7. Davis, J., Marschner, S., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Symposium on 3D Data Processing, Visualization, and Transmission.Google Scholar
    8. Garland, M., and Heckbert, P. S. 1997. Surface simplification using quadric error metrics. In Proceedings of SIGGRAPH 97, 209-216. Google ScholarDigital Library
    9. Hähnel, D., Thrun, S., and Burgard, W. 2003. An extension of the ICP algorithm for modeling nonrigid objects with mobile robots. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Google ScholarDigital Library
    10. Hilton, A., Starck, J., and Collins, G. 2002. From 3d shape capture to animated models. In First International Symposion on 3D Data Processing. Visualization and Transmission (3DVPT2002).Google Scholar
    11. Kähler, K., Haber, J., Yamauchi, H., and Seidel, H.-P. 2002. Head shop: generating animated head models with anatomical structure. In ACM SIGGRAPH Symposium on Computer Animation, 55–64. Google ScholarDigital Library
    12. Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. Proceedings of ACM SIGGRAPH 2000, 165–172. Google ScholarDigital Library
    13. Liepa, P. 2003. Filling holes in meshes. In Proc. of the Eurographics/ACM SIGGRAPH symposium on Geometry processing, 200–205. Google ScholarDigital Library
    14. Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. 2004. An Invitation to 3D Vision. Springer Verlag.Google Scholar
    15. Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Transactions on Graphics, 22(3), 562–568. Google ScholarDigital Library
    16. Noh, J., and Neumann, U. 2001. Expression cloning. Proceedings of ACM SIGGRAPH 2001, 277–288. Google ScholarDigital Library
    17. Popović, Z., Grochow, K., Martin, S. L., and Hertzmann, A. 2004. Style-based inverse kinematics. ACM Transactions on Graphics, 23(3), 522–531. Google ScholarDigital Library
    18. Sand, P., McMillan, L., and Popović, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics, 22(3), 578–586. Google ScholarDigital Library
    19. Seo, H., and Magnenat-Thalmann, N. 2003. An automatic modeling of human bodies from sizing parameters. In ACM Symposium on Interactive 3D Graphics, 19–26. Google ScholarDigital Library
    20. Sloan, P.-P. J., Rose, C. F., and Cohen, M. F. 2001. Shape by example. In 2001 Symposium on Interactive 3D Graphics, 135–144. Google ScholarDigital Library
    21. Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. Proceedings of ACM SIGGRAPH 2004, 23(3), 399–405. Google ScholarDigital Library
    22. Szeliski, R., and Lavallee, S. 1996. Matching 3-d anatomical surfaces with non-rigid deformations using using octree-splines. International Journal of Computer Vision 18, 2, 171–186. Google ScholarDigital Library
    23. Vasilescu, M., and Terzopoulos, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In European Conference on Computer Vision (ECCV), 447–460. Google ScholarDigital Library
    24. Vlasic, D., Pfister, H., Brand, M., and Popović, J. 2004. Multilinear models for facial synthesis. In SIGGRAPH Research Sketch. Google ScholarDigital Library
    25. Wang, X. C., and Phillips, C. 2002. Multi-weight enveloping: least-squares approximation techniques for skin animation. In ACM SIGGRAPH Symposium on Computer Animation, 129–138. Google ScholarDigital Library


ACM Digital Library Publication: