“Expressive expression mapping with ratio images” by Liu, Shan and Zhang

  • ©Zicheng Liu, Ying Shan, and Zhengyou Zhang




    Expressive expression mapping with ratio images



    Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression mapping techniques consider feature motions while the details in illumination changes are ignored. In this paper, we present a novel technique for facial expression mapping. We capture the illumination change of one person’s expression in what we call an expression ratio image (ERI). Together with geometric warping, we map an ERI to any other person’s face image to generate more expressive facial expressions.


    1. N.Badler and S.Platt.Animating facial expressions.In Computer Graphics ,pages 245 -252.Siggraph,August 1981.
    2. T.Beier and S.Neely.Feature-based image metamorphosis.In Computer Graphics ,pages 35 -42.Siggraph,July 1992.
    3. C.Bregler,M.Covell,and M.Slaney.Video rewrite:Driving visual speechwithaudio.In Computer Graphics ,pages 353 – 360.Siggraph,August 1997.
    4. S.E.Brennan.Caricature Generator .M.S.Visual Studies,Dept of Architecture,Massachusetts Institute of Technology,Cambridge,MA.,Sept.1982.
    5. P.E.Debevec.Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography.In Computer Graphics,Annual Conference Series ,pages 189 -198.Siggraph, July 1998.
    6. P.E.Debevec,T.Hawkins,C.Tchou,H.-P.Duiker,W.Sarokin, and M.Sagar.Acquiring the re .ectance .eld of a human face.In Computer Graphics,Annual Conference Series ,pages 145 -156. Siggraph,July 2000.
    7. J.Foley,A.van Dam,S.Feiner,and J.Hughes.Computer Graphics:Principles and Practice .Addison-Wesley Publishing Company,1992.
    8. R.Gonzalez and R.Woods.Digital Image Processing .Addison- Wesley Publishing Company,1992.
    9. Y.Lee,D.Terzopoulos,and K.Waters.Realistic modeling for facial animation.In Computer Graphics ,pages 55 -62.Siggraph, August 1995.
    10. P.Litwinowicz and L.Williams.Animating images withdrawings.In Computer Graphics ,pages 235 -242.Siggraph,August 1990.
    11. S.R.Marschner and D.P.Greenberg.Inverse lighting for photography.In IST/SID Fifth Colort Imaging Conference ,November 1997.
    12. S.R.Marschner,B.Guenter,and S.Raghupathy.Modeling and rendering for realistic facial animation.In Rendering Techniques ,pages 231 -242.Springer Wien New York,2000.
    13. F.I.Parke and K.Waters.Computer Facial Animation . AKPeters,Wellesley,Massachusetts,1996.
    14. F.Pighin,J.Hecker,D.Lischinski,R.Szeliski,and D.H.Salesin. Synthesizing realistic facial expressions from photographs.In Computer Graphics,Annual Conference Series ,pages 75 -84. Siggraph,July 1998.
    15. T.Riklin-Raviv and A.Shashua.The quotient image:Class based re-rendering and recongnition withvarying illuminations. In IEEE Conference on Computer Vision and Pattern Recognition ,pages 566 -571,June 1999.
    16. S.M.Seize and C.R.Dyer.View morphing.In Computer Graphics ,pages 21 -30.Siggraph,August 1996.
    17. A.Stoschek.Image-based re-rendering of faces for continuous pose and illumination directions.In IEEE Conference on Computer Vision and Pattern Recognition ,pages 582 -587,2000.
    18. D.Terzopoulos and K.Waters.Physically-based facial modeling and animation.Journal of Visualization and Computer Animation ,1(4):73 -80,March1990.
    19. K.Waters.A muscle model for animating three-dimensional facial expression.Computer Graphics ,22(4):17 -24,1987.
    20. L.Williams.Performace-driven facial animation.In Computer Graphics ,pages 235 -242.Siggraph,August 1990.
    21. G.Wolberg.Digital Image Warping .IEEE Computer Society Press,1990.

ACM Digital Library Publication:

Overview Page: