“A cell phone based platform for facial performance capture” by Akim, Jones, Yu, Busch, Fyffe, et al. …

  • ©Svetlana Akim, Andrew Jones, Xueming Yu, Jay Busch, Graham Fyffe, Paul Graham, and Paul E. Debevec

Conference:


Type:


Title:

    A cell phone based platform for facial performance capture

Presenter(s)/Author(s):



Abstract:


    We propose a new head-mounted camera system based on stereo cell phone cameras. These cameras have the advantage of being extremely small, light-weight, and programmable. We provide step-by-step details on how to recreate this apparatus and also how to apply this data to multiple applications in facial tracking and reconstruction. Our system is based on the LG Thrill, a 3D enabled cell phone that provides two synchronized stereo cameras in a tiny 4.2 gram module. We use two phones for a total of four cameras. However we do not want to mount the entire phone at the end of the helmet arm. Instead we designed a custom umbilical cord that allows the camera module to function at a large distance from the phone itself.

References:


    1. Adams, A., Talvala, E.-V., Park, S. H., Jacobs, D. E., Ajdin, B., Gelfand, N., Dolson, J., Vaquero, D., Baek, J., Tico, M., Lensch, H. P. A., Matusik, W., Pulli, K., Horowitz, M., and Levoy, M. 2010. The frankencamera: An experimental platform for computational photography. ACM Transactions on Graphics 29, 4 (July), 29:1–29:12.
    2. Beeler, T., Bickel, B., Beardsley, P., Sumner, B., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Transactions on Graphics 29, 4 (July), 40:1–40:9.


Additional Images:

©Svetlana Akim, Andrew Jones, Xueming Yu, Jay Busch, Graham Fyffe, Paul Graham, and Paul E. Debevec ©Svetlana Akim, Andrew Jones, Xueming Yu, Jay Busch, Graham Fyffe, Paul Graham, and Paul E. Debevec

ACM Digital Library Publication:



Overview Page: