“Just-in-time, viable, 3D avatars from scans” by Feng, Suma and Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro

  • ©Andrew W. Feng, Evan A. Suma, and Ari Shapiro



Entry Number: 19


    Just-in-time, viable, 3D avatars from scans



    We demonstrate a system that can generate a photorealistic, interactive 3D character from a human subject that is capable of movement, emotion, speech and gesture in less than 20 minutes without the need for 3D artist intervention or specialized technical knowledge through a near automatic process. Our method uses mostly commodity- or of-the-shelf hardware. We demonstrate the just-in-time use of generating such 3D models for virtual and augmented reality, games, simulation and communication. We anticipate that the inexpensive generation of such photorealistic models will be useful in many venues where a just-in-time 3D construction of digital avatars that resemble particular human subjects is necessary. Figure 1 shows the overall workflow of our virtual character creation pipeline.


    Dan Casas, Oleg Alexander, Andrew W. Feng, Graham Fyffe, Ryosuke Ichikari, Paul Debevec, Rhuizhe Wang, Evan Suma, and Ari Shapiro. 2015. Blendshapes from Commodity RGB-D Sensors. In ACM SIGGRAPH 2015 Talks (SIGGRAPH 15). ACM, New York, NY, USA, Article 33, 1 pages. Google ScholarDigital Library
    Dan Casas, Marco Volino, John Collomosse, and Adrian Hilton. 2014. 4D Video Textures for Interactive Character Appearance. Computer Graphics Forum 33, 2 (2014), 371–380. Google ScholarDigital Library
    Alvaro Collet, Ming Chuang, Pat Sweeney, Don Gillett, Dennis Evseev, David Calabrese, Hugues Hoppe, Adam Kirk, and Steve Sullivan. 2015. High-quality Streamable Free-viewpoint Video. ACM Trans. Graph. 34, 4, Article 69 (July 2015), 13 pages. Google ScholarDigital Library
    Andrew Feng, Dan Casas, and Ari Shapiro. 2015. Avatar reshaping and automatic rigging using a deformable model. In Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games. ACM, 57–64. Google ScholarDigital Library
    Alexandru Eugen Ichim, Sofien Bouaziz, and Mark Pauly. 2015. Dynamic 3D avatar creation from hand-held video input. ACM Transactions on Graphics (TOG) 34, 4 (2015), 45.Google ScholarDigital Library
    Travis Perry. 2014. Leaving the uncanny valley behind. Spectrum, IEEE 51, 6 (2014), 48–53.Google ScholarCross Ref
    Jeremy Straub and Scott Kerlin. 2014. Development of a large, low-cost, instant 3D scanner. Technologies 2, 2 (2014), 76–95.



ACM Digital Library Publication:

Overview Page: