“AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors” by Murakami, Kikui, Suzuki, Nakamura, Fukuoka, et al. … – ACM SIGGRAPH HISTORY ARCHIVES

“AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors” by Murakami, Kikui, Suzuki, Nakamura, Fukuoka, et al. …

  • 2019 ETech Murakami: AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors

  • 2019 ETech Murakami: AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors

Conference:


Experience Type(s):


Title:


    AffectiveHMD: Facial Expression Recognition in Head Mounted Display Using Embedded Photo Reflective Sensors

Program Title:


    New Technologies Research & Education

Organizer(s)/Presenter(s):



Description:


    In this exhibition, we demonstrate facial expression recognition technology inside the head-mounted display (HMD) using photo reflective sensors and machine learning. By acquiring reflection intensity information with a number of optical sensors embedded in HMD and training a machine learning system, our system is able to recognize intermediate facial expressions.

References:


    [1] K. Masai, Y. Sugiura, M. Ogata, K. Kunze, M. Inami, and M. Sugimoto. 2016. Facial Expression Recognition in Daily Life by Embedded Photo Reflective Sensors on Smart Eyewear. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI ’16). 317–326.

    [2] K. Suzuki, F. Nakamura, J. Otsuka, K. Masai, Y. Itoh, Y. Sugiura, and M. Sugimoto. 2017. Recognition and mapping of facial expressions to avatar by embedded photo reflective sensors in head mounted display. In 2017 IEEE Virtual Reality (VR). 177–185.


Additional Images:



ACM Digital Library Publication:


Overview Page:



Submit a story:

If you would like to submit a story about this experience or presentation, please contact us: historyarchives@siggraph.org