“Masquerade: fine-scale details for head-mounted camera motion capture data” by Moser, Hendler and Roble

  • ©Lucio Moser, Darren Hendler, and Doug Roble


Entry Number: 18


    Masquerade: fine-scale details for head-mounted camera motion capture data



    We present Masquerade, a novel modular and expandable tool for adding fine-scale details to facial motion capture data from head-mounted cameras. After studying two important related works we developed a framework to reproduce the original approaches as well as to test equally promising alternatives. This framework has been vital for understanding the limitations of previous approaches and to explore ways to improve the results. Our final solution was a combination of algorithms and data representations that produced better results than previous works when tested with our evaluation data. Since then, Masquerade is being actively used in production for enhancing marker data with fine-scale details.


    Amit H. Bermano, Derek Bradley, Thabo Beeler, Fabio Zund, Derek Nowrouzezahrai, Ilya Baran, Olga Sorkine-Hornung, Hanspeter Pfister, Robert W. Sumner, Bernd Bickel, and Markus Gross. 2014. Facial Performance Enhancement Using Dynamic Shape Space Analysis. ACM Trans. Graph. 33, 2, Article 13 (April 2014), 12 pages. Google ScholarDigital Library
    Bernd Bickel, Manuel Lang, Mario Botsch, Miguel A. Otaduy, and Markus Gross. 2008. Pose-space Animation and Transfer of Facial Details. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA ’08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 57–66. http://dl.acm.org/citation.cfm?id=1632592.1632602Google ScholarDigital Library
    Steven McDonagh, Martin Klaudiny, Derek Bradley, Thabo Beeler, Iain Matthews, Kenny Mitchell, undefined, undefined, undefined, and undefined. 2016. Synthetic Prior Design for Real-Time Face Tracking. 2016 Fourth International Conference on 3D Vision (3DV) 00 (2016), 639–648. DOI:http://dx.doi.org/doi.ieeecomputersociety.org/10.1109/3DV.2016.72Google ScholarCross Ref
    Chenglei Wu, Derek Bradley, Markus Gross, and Thabo Beeler. 2016. An Anatomically-constrained Local Deformation Model for Monocular Face Capture. ACM Trans. Graph. 35, 4, Article 115 (July 2016), 12 pages.



ACM Digital Library Publication:

Overview Page: