“AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors” by Murakami, Kikui, Suzuki, Nakamura, Fukuoka, et al. …
Conference:
Experience Type(s):
Title:
- AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors
Program Title:
- New Technologies Research & Education
Organizer(s)/Presenter(s):
Description:
In this exhibition, we demonstrate facial expression recognition technology inside the head-mounted display (HMD) using photo reflective sensors and machine learning. By acquiring reflection intensity information with a number of optical sensors embedded in HMD and training a machine learning system, our system is able to recognize intermediate facial expressions.
References:
[1] K. Masai, Y. Sugiura, M. Ogata, K. Kunze, M. Inami, and M. Sugimoto. 2016. Facial Expression Recognition in Daily Life by Embedded Photo Reflective Sensors on Smart Eyewear. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI ’16). 317–326.
[2] K. Suzuki, F. Nakamura, J. Otsuka, K. Masai, Y. Itoh, Y. Sugiura, and M. Sugimoto. 2017. Recognition and mapping of facial expressions to avatar by embedded photo reflective sensors in head mounted display. In 2017 IEEE Virtual Reality (VR). 177–185.
Additional Images:
- 2019 ETech Murakami: AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors




