“Laughing out loud: control for modeling anatomically inspired laughter using audio”
Conference:
Type(s):
Title:
- Laughing out loud: control for modeling anatomically inspired laughter using audio
Session/Category Title: Character animation II
Presenter(s)/Author(s):
Abstract:
We present a novel technique for generating animation of laughter for a character. Our approach utilizes an anatomically inspired, physics-based model of a human torso that includes a mix of rigid-body and deformable components and is driven by Hill-type muscles. We propose a hierarchical control method which synthesizes laughter from a simple set of input signals. In addition, we present a method for automatically creating an animation from a soundtrack of an individual laughing. We show examples of laugh animations generated by hand-selected input parameters and by our audio-driven optimization approach. We also include results for other behaviors, such as coughing and a sneeze, created using the same model. These animations demonstrate the range of possible motions that can be generated using the proposed system. We compare our technique with both data-driven and procedural animations of laughter.
References:
1. Albrecht, I., Haber, J., and Seidel, H. 2003. Construction and animation of anatomically based human hand models. In ACM SIGGRAPH Symposium on Computer Animation, 98–109. Google ScholarDigital Library
2. Allen, B., Curless, B., and Popović, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics 21, 3, 612–619. Google ScholarDigital Library
3. Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. Scape: shape completion and animation of people. ACM Transactions on Graphics 24, 3 (Aug.), 408–416. Google ScholarDigital Library
4. Buchanan, T., Lloyd, D., Manal, K., and Besier, T. 2004. Neuromusculoskeletal Modeling: Estimation of Muscle Forces and Joint Moments and Movements From Measurements of Neural Command. Journal of applied biomechanics 20, 4.Google ScholarCross Ref
5. Chen, D. T., and Zeltzer, D. 1992. Pump it up: computer animation of a biomechanically based model of muscle using the finite element method. SIGGRAPH 1992 26, 2, 89–98. Google Scholar
6. Dennis Jr, J., and Torczon, V. 1991. Direct Search Methods on Parallel Machines. SIAM Journal on Optimization 1, 448.Google ScholarCross Ref
7. DiLorenzo, P. C. 2008. Breathing, Laughing, Sneezing, Coughing: Model and Control of an Anatomically Inspired, Physically-Based Human Torso Simulation. PhD thesis, University of California, Riverside. Google Scholar
8. Dong, F., Clapworthy, G. J., Krokos, M. A., and Yao, J. 2002. An anatomy-based approach to human muscle modeling and deformation. IEEE Transactions on Visualization and Computer Graphics 8, 2 (Apr./June), 154–170. Google Scholar
9. Filippelli, M., Pellegrino, R., Iandelli, I., Misuri, G., Rodarte, J., Duranti, R., Brusasco, V., and Scano, G. 2001. Respiratory dynamics during laughter. Journal of Applied Physiology 90, 4, 1441–1446.Google ScholarCross Ref
10. Finnegan, E. M., Luschei, E. S., and Hoffman, H. T. 1999. Estimation of Alveolar Pressure During Speech Using Direct Measures of Tracheal Pressure. Journal of Speech, Language and Hearing Research 42, 5, 1136–1147.Google ScholarCross Ref
11. Grzeszczuk, R., and Terzopoulos, D. 1995. Automated learning of muscle-actuated locomotion through control abstraction. In SIGGRAPH 95, 63–70. Google Scholar
12. Hatze, H. 1981. Myocybernetic control models of skeletal muscle: Characteristics and applications. University of South Africa.Google Scholar
13. Hill, A. 1970. The force-velocity relation in shortening muscle. In First and Last Experiments in Muscle Mechanics, 23–41.Google Scholar
14. Hoit, J. D., Plassman, B. L., Lansing, R. W., and Hixon, T. J. 1988. Abdominal muscle activity during speech production. Journal of Applied Physiology 65, 6, 2656–2664.Google ScholarCross Ref
15. Kähler, K., Haber, J., Yamauchi, H., and Seidel, H.-P. 2002. Head shop: Generating animated head models with anatomical structure. In ACM SIGGRAPH Symposium on Computer Animation, 55–64. Google Scholar
16. Kaye, J., Metaxas, D. N., and Jr., F. P. P. 1997. A 3d virtual environment for modeling mechanical cardiopulmonary interactions. In CVRMed, 389–398. Google Scholar
17. Lee, S.-H., and Terzopoulos, D. 2006. Heads up!: biomechanical modeling and neuromuscular control of the neck. ACM Transactions on Graphics 25, 3 (July), 1188–1198. Google ScholarDigital Library
18. Lee, Y., Terzopoulos, D., and Waters, K. 1995. Realistic modeling for facial animation. SIGGRAPH ’95, 55–62. Google Scholar
19. Lemos, R. R., Rokne, J., Baranoski, G. V. G., Kawakami, Y., and Kurihara, T. 2005. Modeling and simulating the deformation of human skeletal muscle based on anatomy and physiology. Computer Animation and Virtual Worlds 16, 3, 319–330. Google ScholarDigital Library
20. Luschei, E., Ramig, L., Finnegan, E., Baker, K., and Smith, M. 2006. Patterns of Laryngeal Electromyography and the Activity of the Respiratory System During Spontaneous Laughter. Journal of Neurophysiology 96, 1, 442.Google ScholarCross Ref
21. Meza, J., Oliva, R., Hough, P., and Williams, P. 2007. OPT++: An object oriented toolkit for nonlinear optimization. ACM Transactions on Mathematical Software 33, 2 (June), 12. Article 12, 27 pages. Google ScholarDigital Library
22. Mines, A. H. 1993. Respiratory Physiology. Raven Press.Google Scholar
23. Monheit, G., and Badler, N. I. 1991. A kinematic model of the human spine and torso. IEEE Computer Graphics & Applications 11, 2 (Mar.), 29–38. Google Scholar
24. Nedel, L. P., and Thalmann, D. 2000. Anatomic modeling of deformable human bodies. The Visual Computer 16, 6, 306–321.Google ScholarCross Ref
25. Ng-Thow-Hing, V. 2001. Anatomically-Based Models for Physical and Geometric Reconstruction of Humans and Other Animals. PhD thesis, University of Toronto. Google Scholar
26. Park, S. I., and Hodgins, J. K. 2006. Capturing and animating skin deformation in human motion. ACM Transactions on Graphics 25, 3 (July), 881–889. Google ScholarDigital Library
27. Platt, S., and Badler, N. 1981. Animating facial expression. Computer Graphics, 245–252.Google Scholar
28. Pratscher, M., Coleman, P., Laszlo, J., and Singh, K. 2005. Outside-in anatomy based character rigging. In 2005 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 329–338. Google Scholar
29. Promayon, E., Baconnier, P., and Puech, C. 1997. Physically-based model for simulating the human trunk respiration movements. In Lecture Notes in Computer Science 1205, 379–388. Springer Verlag CVRMED II-MRCAS III first joint conference. Google ScholarDigital Library
30. Sand, P., McMillan, L., and Popović, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics 22, 3, 578–586. Google ScholarDigital Library
31. Scheepers, F., Parent, R. E., Carlson, W. E., and May, S. F. 1997. Anatomy-based modeling of the human musculature. SIGGRAPH 1997, 163–172. Google ScholarDigital Library
32. Schutte, L. 1992. Using musculoskeletal models to explore strategies for improving performance in electrical stimulation-induced leg cycle ergometry. PhD thesis, Stanford University.Google Scholar
33. Seo, H., and Magnenat-Thalmann, N. 2003. An automatic modeling of human bodies from sizing parameters. Symposium on Interactive 3D graphics, 19–26. Google Scholar
34. Sifakis, E., Neverov, I., and Fedkiw, R. 2005. Automatic determination of facial muscle activations from sparse motion capture marker data. ACM Transactions on Graphics 24, 3 (Aug.), 417–425. Google ScholarDigital Library
35. Slutsky, A., Drazen, J., O’Cain, C., and Ingram, R. 1981. Alveolar pressure-airflow characteristics in humans breathing air, He-O2, and SF6-O2. Journal of Applied Physiology 51, 4, 1033–1037.Google ScholarCross Ref
36. Teran, J., Sifakis, E., Blemker, S. S., Ng-Thow-Hing, V., Lau, C., and Fedkiw, R. 2005. Creating and simulating skeletal muscle from the visible human data set. IEEE Transactions on Visualization and Computer Graphics 11, 3, 317–328. Google ScholarDigital Library
37. Tsang, W., Singh, K., and Fiume, E. 2005. Helping hand: An anatomically accurate inverse dynamics solution for unconstrained hand motion. In 2005 ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 319–328. Google Scholar
38. Tu, X., and Terzopoulos, D. 1994. Artificial fishes: Physics, locomotion, perception, behavior. In SIGGRAPH 94, 43–50. Google Scholar
39. van den Bogert, A. J., and Nigg, B. M. 1999. Simulation. In: Biomechanics of the Musculo-skeletal System, 594–617.Google Scholar
40. Waters, K. 1987. A muscle model for animating three-dimensional facial expressions. SIGGRAPH 1987, 17–24. Google Scholar
41. West, J. 2004. Respiratory Physiology: the essentials. Lippincott Williams & Wilkins.Google Scholar
42. Wilhelms, J., and Gelder, A. V. 1997. Anatomically based modeling. SIGGRAPH 1997, 173–180. Google ScholarDigital Library
43. Zajac, F. E. 1989. Muscle and tendon: Properties, models, scaling, and application to biomechanics and motor control. CRC Critical reviews in biomedical engineering 17, 359–411.Google Scholar
44. Zordan, V. B., Celly, B., Chiu, B., and DiLorenzo, P. C. 2004. Breathe easy: model and control of simulated respiration for animation. ACM SIGGRAPH/Eurographics symposium on Computer animation, 29–37. Google Scholar
