“3D Facial Geometry Analysis and Estimation Using Embedded Optical Sensors on Smart Eyewear” by Asano, Sugiura, Masai and Sugimoto
Conference:
Type:
Entry Number: 45
Title:
- 3D Facial Geometry Analysis and Estimation Using Embedded Optical Sensors on Smart Eyewear
Presenter(s)/Author(s):
Abstract:
Facial performance capture is used for animation production that projects a performer’s facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place markers on the performer’s face and calibrate the intrinsic and extrinsic parameters of cameras in advance. However, the measurable space is limited to the calibrated area. In this study, we propose a system to capture facial performance using a smart eyewear with photo-reflective sensors and machine learning technique. Also, we show a result of principal components analysis of facial geometry to determine a good estimation parameter set.
References:
- Sofien Bouaziz, Yangang Wang, and Mark Pauly. 2013. Online Modeling for Realtime Facial Animation. ACM Trans. Graph. 32, 4, Article 40 (July 2013), 10 pages. https: //doi.org/10.1145/2461912.2461976
- Gruebler and K. Suzuki. 2014. Design of a Wearable Device for Reading Positive Expressions from Facial EMG Signals. IEEE Transactions on Affective Computing 5, 3 (July 2014), 227–237. https://doi.org/10.1109/TAFFC.2014.2313557
- Katsutoshi Masai, Yuta Sugiura, Masa Ogata, Kai Kunze, Masahiko Inami, and Maki Sugimoto. 2016. Facial Expression Recognition in Daily Life by Embedded Photo Reflective Sensors on Smart Eyewear. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI ’16). ACM, New York, NY, USA, 317–326. https://doi.org/10.1145/2856767.2856770
- Lance Williams. 1990. Performance-driven Facial Animation. In Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’90). ACM, New York, NY, USA, 235–242. https://doi.org/10.1145/97879.97906
- Chenglei Wu, Derek Bradley, Markus Gross, and Thabo Beeler. 2016. An Anatomicallyconstrained Local Deformation Model for Monocular Face Capture. ACM Trans. Graph. 35, 4, Article 115 (July 2016), 12 pages. https://doi.org/10.1145/2897824. 292588
Keyword(s):
Additional Images:
Acknowledgements:
This research was partially supported by JST CREST (JPMJCR14E1) and JSPS KAKENHI (16H05870).
