“An Expressive Text-Driven 3D Talking Head” by Anderson, Stenger, Wan and Cipolla
Conference:
Type:
Entry Number: 19
Title:
- An Expressive Text-Driven 3D Talking Head
Presenter(s)/Author(s):
Abstract:
Creating a realistic talking head, which given an arbitrary text as input generates a realistic looking face speaking the text, has been a long standing research challenge. Talking heads which cannot express emotion have been made to look very realistic by using concatenative approaches [Wang et al. 2011], however allowing the head to express emotion creates a much more challenging problem and model based approaches have shown promise in this area. While 2D talking heads currently look more realistic than their 3D counterparts, they are limited both in the range of poses they can express and in the lighting conditions that they can be rendered under. Previous attempts to produce videorealistic 3D expressive talking heads [Cao et al. 2005] have produced encouraging results but not yet achieved the level of realism of their 2D counterparts.
References:
1. Anderson, R., Stenger, B., Wan, V., and Cipolla, R. 2013. Expressive visual text-to-speech using active appearance models. In CVPR.
2. Cao, Y., Tien, W., Faloutsos, P., and Pighin, F. 2005. Expressive speech-driven facial animation. ACM TOG 24, 4, 1283–1302.
3. Wang, L., Han, W., Soong, F., and Huo, Q. 2011. Text driven 3D photo-realistic talking head. In Interspeech, 3307–3308.
Additional Images:
