“Realistic modeling for facial animation” by Lee, Terzopoulos and Waters

A major unsolved problem in computer graphics is the construction and animation of realistic human facial models. Traditionally, facial models have been built painstakingly by manual digitization and animated by ad hoc parametrically controlled facial mesh deformations or kinematic approximation of muscle actions. Fortunately, animators are now able to digitize facial geometries through the use of scanning range sensors and animate them through the dynamic simulation of facial tissues and muscles. However, these techniques require considerable user input to construct facial models of individuals suitable for animation. In this paper, we present a methodology for automating this challenging task. Starting with a structured facial mesh, we develop algorithms that automatically construct functional models of the heads of human subjects from laser-scanned range and reflectance data. These algorithms automatically insert contractile muscles at anatomically correct positions within a dynamic skin model and root them in an estimated skull structure with a hinged jaw. They also synthesize functional eyes, eyelids, teeth, and a neck and fit them to the final model. The constructed face may be animated via muscle actuations. In this way, we create the most authentic and functional facial models of individuals available to date and demonstrate their use in facial animation.

1. T. Akimoto, Y. Suenaga, and R. Wallace. Automatic creation of 3D facial models. IEEE Computer Graphics and Applications, 13(5): 16- 22, September 1993.
2. James Doyle and James Philips. Manual on Experimental Stress Analysis. Society for Experimental Mechanics, fifth edition, 1989.
3. Irfan A. Essa. Visual Interpretation of Facial Expressions using Dynamic Modeling. PhD thesis, MIT, 1994.
4. Frick and Hans. Human Anatomy, volume 1. Thieme Medical Publishers, Stuttgart, 1991.
5. H. Gray. Anatomy of the Human Body. Lea & Febiber, Philadelphia, PA, 29th edition, 1985.
6. Brian Guenter. A system for simulating human facial expression. In State of the Art in Computer Animation, pages 191-202. Springer- Verlag, 1992.
7. T. Kurihara and K. Arai. A transformation method for modeling and animation of the human face from photographs. In State of the Art in Computer Animation, pages 45-57. Springer-Verlag, 1991.
8. Y.C. Lee, D. Terzopoulos, and K. Waters. Constructing physics-based facial models of individuals. In Proceedings of Graphics Interface ’93, pages 1-8, Toronto, May 1993.
9. N. Magneneat-Thalmann, H. Minh, M. Angelis, and D. Thalmann. Design, transformation and animation of human faces. Visual Computer, 5:32-39,1989.
10. D. Metaxas and E. Milios. Reconstruction of a color image from nonuniformly distributed sparse and noisy data. Computer Vision, Graphics, and Image Processing, 54(2):103-111, March 1992.
11. M. Nahas, H. Hutric, M. Rioux, and J. Domey. Facial image synthesis using skin texture recording. Visual Computer, 6(6):337-343,1990.
12. M. Oka, K. Tsutsui, A. Ohba, Y. Kurauchi, and T. Tago. Real-time manipulation of texture-mapped surfaces. In SIGGRAPH 21, pages 181-188. ACM Computer Graphics, 1987.
13. E Parke. Computer generated animation of faces. In ACM National Conference, pages 451-457. ACM, 1972.
14. E Parke. Parameterized models for facial animation. IEEE Computer Graphics and Applications, 2(9):61-68, November 1982.
15. E Parke. Parameterized models for facial animation revisited. In SIG- GRAPH Facial Animation Tutorial Notes, pages 43-56. ACM SIG- GRAPH, 1989.
16. Elizabeth C. Patterson, Peter C. Litwinowicz, and N. Greene. Facial animation by spatial mapping. In State of the Art in Computer Animation, pages 31-44. Springer-Verlag, 1991.
17. S. Platt and N. Badler. Animating facial expression. Computer Graphics, 15(3):245-252, August 1981.
18. D. Terzopoulos. The computation of visible-surface representations. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-10(4):417-438, 1988.
19. D. Terzopoulos and M. Vasilescu. Sampling and reconstruction with adaptive meshes. In Proceedings of Computer Vision and Pattern Recognition Conference, pages 70-75. IEEE, June 1991.
20. D. Terzopoulos and K. Waters. Physically-based facial modeling, analysis, and animation. Visualization and ComputerAnimation, 1:73- 80, 1990.
21. K. Waters. A muscle model for animating three-dimensional facial expression. Computer Graphics, 22(4): 17-24,1987.
22. K. Waters. A physcial model of facial tissue and muscle articulation derived from computer tomography data. In Visualization in Biomedical Computing, pages 574-583. SPIE, Vol. 1808, 1992.
23. K. Waters and D. Terzopoulos. Modeling and animating faces using scanned data. Visualization and Computer Animation, 2:123-128, 1991.
24. L. Williams. Performance-driven facial animation. In SIGGRAPH 24, pages 235-242. ACM Computer Graphics, 1990.
25. J. Yau and N. Duffy. 3-D facial animation using image samples. InNew Trends in Computer Graphics, pages 64-73. Springer-Verlag, 1988.