“Breathing life into shape: capturing, modeling and animating 3D human breathing” by Tsoli, Mahmood and Black

  • ©Aggeliki Tsoli, Naureen Mahmood, and Michael J. Black



Session Title:

    Controlling Character


    Breathing life into shape: capturing, modeling and animating 3D human breathing




    Modeling how the human body deforms during breathing is important for the realistic animation of lifelike 3D avatars. We learn a model of body shape deformations due to breathing for different breathing types and provide simple animation controls to render lifelike breathing regardless of body shape. We capture and align high-resolution 3D scans of 58 human subjects. We compute deviations from each subject’s mean shape during breathing, and study the statistics of such shape changes for different genders, body shapes, and breathing types. We use the volume of the registered scans as a proxy for lung volume and learn a novel non-linear model relating volume and breathing type to 3D shape deformations and pose changes. We then augment a SCAPE body model so that body shape is determined by identity, pose, and the parameters of the breathing model. These parameters provide an intuitive interface with which animators can synthesize 3D human avatars with realistic breathing motions. We also develop a novel interface for animating breathing using a spirometer, which measures the changes in breathing volume of a “breath actor”.


    1. Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. ACM Trans. on Graphics (TOG) 22, 3, 587–594. Google ScholarDigital Library
    2. Allen, B., Curless, B., Popović, Z., and Hertzmann, A. 2006. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), Eurographics Association, 147–156. Google ScholarDigital Library
    3. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. SCAPE: Shape Completion and Animation of PEople. ACM Trans. on Graphics (TOG) 24, 3, 408–416. Google ScholarDigital Library
    4. Bogo, F., Romero, J., Loper, M., and Black, M. J. 2014. FAUST: Dataset and evaluation for 3D mesh registration. In Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.Google Scholar
    5. Cavagnaro, M., Pittella, E., and Pisa, S. 2013. Anatomical models of breathing subjects for absorption and scattering analysis. In International Symposium on Electromagnetic Compatibility (EMC EUROPE), IEEE, 149–153.Google Scholar
    6. Chen, Y., Liu, Z., and Zhang, Z. 2013. Tensor-based human body modeling. In Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 105–112. Google ScholarDigital Library
    7. Cosker, D., and Edge, J. 2009. Laughing, crying, sneezing and yawning: Automatic voice driven animation of non-speech articulations. In Computer Animation and Social Agents (CASA).Google Scholar
    8. DiLorenzo, P. C., Zordan, V. B., and Sanders, B. L. 2008. Laughing out loud: Control for modeling anatomically inspired laughter using audio. ACM Trans. on Graphics (TOG) 27, 5, 125–133. Google ScholarDigital Library
    9. Egges, A., Molet, T., and Magnenat-Thalmann, N. 2004. Personalised real-time idle motion synthesis. In Pacific Conf. on Comp. Graphics and Applications, IEEE, 121–130. Google ScholarDigital Library
    10. Egges, A., Giacomo, T., and Thalmann, N. 2006. Synthesis of realistic idle motion for interactive characters. Game Programming Gems 6, 3–2.Google Scholar
    11. Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., and Seidel, H. 2009. A statistical model of human pose and body shape. Computer Graphics Forum 28, 2, 337–346.Google ScholarCross Ref
    12. Hirshberg, D., Loper, M., Rachlin, E., and Black, M. 2012. Coregistration: Simultaneous alignment and modeling of articulated 3D shape. In European Conf. on Computer Vision (ECCV), Springer-Verlag, LNCS 7577, Part IV, 242–255. Google ScholarDigital Library
    13. Hsu, E., Gentry, S., and Popović, J. 2004. Example-based control of human motion. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 69–77. Google ScholarDigital Library
    14. Jain, A., Thormählen, T., Seidel, H.-P., and Theobalt, C. 2010. MovieReshape: Tracking and reshaping of humans in videos. ACM Trans. on Graphics (TOG) 29, 6, 148:1–148:10. Google ScholarDigital Library
    15. Kider, J., Pollock, K., and Safonova, A. 2011. A data-driven appearance model for human fatigue. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), ACM, 119–128. Google ScholarDigital Library
    16. Lee, S.-H., Sifakis, E., and Terzopoulos, D. 2009. Comprehensive biomechanical modeling and simulation of the upper body. ACM Trans. on Graphics (TOG) 28, 4, 99:1–99:17. Google ScholarDigital Library
    17. Lee, D., Glueck, M., Khan, A., Fiume, E., and Jackson, K. 2012. Modeling and simulation of skeletal muscle for computer graphics: A survey. Foundations and Trends in Computer Graphics and Vision 7, 4, 229–276. Google ScholarDigital Library
    18. Magnenat-Thalmann, N., Zhang, J. J., and Feng, D. D. 2009. Recent Advances in the 3D Physiological Human. Springer. Google ScholarDigital Library
    19. Mines, A. H. 1981. Respiratory Physiology. Raven Press.Google Scholar
    20. Moreno, A., Chambon, S., Santhanam, A. P., Brocardo, R., Kupelian, P., Rolland, J. P., Angelini, E., and Bloch, I. 2007. Thoracic CT-PET registration using a 3D breathing model. In Medical Image Computing and ComputerAssisted Intervention (MICCAI). Springer, 626–633. Google ScholarDigital Library
    21. MPI IS, 2011. http://bodyvisualizer.com/.Google Scholar
    22. Neumann, T., Varanasi, K., Hasler, N., Wacker, M., Magnor, M., and Theobalt, C. 2013. Capture and statistical modeling of arm-muscle deformations. Computer Graphics Forum 32, 285–294.Google ScholarCross Ref
    23. Park, S. I., and Hodgins, J. K. 2006. Capturing and animating skin deformation in human motion. ACM Trans. on Graphics (TOG) 25, 3, 881–889. Google ScholarDigital Library
    24. Park, S. I., and Hodgins, J. K. 2008. Data-driven modeling of skin and muscle deformation. ACM Trans. on Graphics (TOG) 27, 3, 96:1–96:6. Google ScholarDigital Library
    25. Park, M. J., and Shin, S. Y. 2004. Example-based motion cloning. Comp. Anim. and Virtual Worlds 15, 3-4, 245–257. Google ScholarDigital Library
    26. Penne, J., Schaller, C., Hornegger, J., and Kuwert, T. 2008. Robust real-time 3D respiratory motion detection using Time-of-Flight cameras. International Journal of Computer Assisted Radiology and Surgery 3, 5, 427–431.Google ScholarCross Ref
    27. Promayon, E., Baconnier, P., and Puech, C. 1997. Physically-based model for simulating the human trunk respiration movements. In Computer Vision, Virtual Reality and Robotics in Medicine and Medical Robotics and ComputerAssisted Surgery (CVRMed-MRCAS), Springer, 379–388. Google ScholarDigital Library
    28. Robinette, K., Blackwell, S., Daanen, H., Boehmer, M., Fleming, S., Brill, T., Hoeferlin, D., and Burnsides, D. 2002. Civilian American and European Surface Anthropometry Resource (CAESAR) final report. Tech. Rep. AFRL-HE-WP-TR-2002-0169, US Air Force Research Laboratory.Google Scholar
    29. Sanders, B., DiLorenzo, P., Zordan, V., and Bakal, D. 2009. Toward anatomical simulation for breath training in mind/body medicine. In Recent Advances in the 3D Physiological Human. Springer, 105–119.Google Scholar
    30. Sánta, Z., and Kato, Z. 2013. Correspondence-less non-rigid registration of triangular surface meshes. In Conference on Computer Vision and Pattern Recognition (CVPR), 2275–2282. Google ScholarDigital Library
    31. Santhanam, A., Pattanaik, S., Rolland, J., Imielinska, C., and Norfleet, J. 2003. Physiologically-based modeling and visualization of deformable lungs. In Pacific Conf. on Comp. Graphics and Applications, IEEE, 507–511. Google ScholarDigital Library
    32. Stoll, C., Gall, J., De Aguiar, E., Thrun, S., and Theobalt, C. 2010. Video-based reconstruction of animatable human characters. ACM Trans. on Graphics (TOG) 29, 6, 139:1–139:10. Google ScholarDigital Library
    33. Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. on Graphics (TOG) 23, 3, 399–405. Google ScholarDigital Library
    34. Veltkamp, R. C., and Piest, B. 2009. A physiological torso model for realistic breathing simulation. In Modelling the Physiological Human. Springer, 84–94. Google ScholarDigital Library
    35. West, J. 2012. Respiratory Physiology: The Essentials. Lippincott Williams & Wilkins.Google Scholar
    36. Zordan, V. B., Celly, B., Chiu, B., and DiLorenzo, P. C. 2004. Breathe Easy: Model and control of simulated respiration for animation. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA), 29–37. Google ScholarDigital Library

ACM Digital Library Publication: