“Virtual Headcam: Pan/tilt Mirror-based Facial Performance Tracking” by Yu, Wang, Busch, Phan, McSheery, et al. …

  • ©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec

  • ©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec

  • ©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec

Conference:


Type:


Entry Number: 94

Title:

    Virtual Headcam: Pan/tilt Mirror-based Facial Performance Tracking

Presenter(s)/Author(s):



Abstract:


    High-end facial performance capture solutions typically use head-mounted camera systems which provide one or more close-up video streams of each actor’s performance. These provide clear views of each actor’s performance, but can be bulky, uncomfortable, get in the way of sight lines, and prevent actors from getting close to each other. To address this, we propose a virtual head-mounted camera system: an array of cameras placed around around the performance capture volume which automatically track zoomed-in, sharply focussed, high-resolution views of the each actor’s face from a multitude of directions. The resulting imagery can be used in conjunction with body motion capture data to derive nuanced facial performances without head-mounted cameras.


Additional Images:

©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec ©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec ©Xueming Yu, Shanhe Wang, Jay Busch, Thai Phan, Tracy McSheery, Mark T. Bolas, and Paul E. Debevec

PDF:



ACM Digital Library Publication:



Overview Page: