““Real Baby – Real Family” – VR Entertainment Baby Interaction System” by Hsieh, Mochizuki, Asano, Higashida and Shirai
Conference:
Type(s):
Entry Number: 20
Title:
- “Real Baby - Real Family” - VR Entertainment Baby Interaction System
Organizer(s)/Presenter(s):
Description:
This research, “Real Baby – Real Family” – VR Entertainment Baby Interaction System, is a project aimed at generating virtual baby avatars from any 2D facial images. By pulling specific facial features from photographs, analyzing them, and then merging the obtained data together, the virtual baby avatars whose face closely resembles that of subjects has been successfully created. Furthermore, this experience contains various interactions with physical and virtual baby avatar aimed at provoking thoughts regarding to solving social issue of rapid aging society.
References:
Junichi IDO, Etsuko UEDA, Yoshio MATSUMOTO, and Tsukasa OGASAWARA. 2006. 2P2-C20 Robotic Telecommunication System based on Facial Information Measurement. JSME annual Conference on Robotics and Mechatronics (Robomec) (2006). http://ci.nii.ac.jp/naid/110008694348/
H. KOZIMA. 2001. A Robot that Learns to Communicate with Human Caregivers. Proceedings of the First International Workshop on Epigenetic Robotics, 2001 (2001). http://ci.nii.ac.jp/naid/10014858498/
Giorgio Metta, Giulio Sandini, Lorenzo Natale, and Francesco Panerai. 2001. Sensorimotor interaction in a developing robot.
Chiyoko ONO, Hiroki KUNIMURA, Madoka HIRAI, Tetsuya Wagner MATSUZAKI, Masatada MURAMOTO, Toshiaki UCHIYAMA, Kazuhito SHIRATORI, and Junichi HOSHINO. 2009. Design Consideration in Developing Baby Type Robot. Bulletin of Japanese Society for Science of Design 56 (2009). http://ci.nii.ac.jp/naid/ 110007380346/
B. SCASSELLATI. 2001. Theory of mind for a humanoid robot. Autonomous Robots (2001). h.ps://doi.org/10.1023/A:1013298507114
Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, and Matthias Nie. 2016. Demo of Face2Face: Real-time Face Capture and Reenactment of RGB Videos. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH ’16). ACM, New York, NY, USA, Article 5, 2 pages. h.ps://doi.org/10.1145/2929464.2929475
Naoko TOSA. 1995. Neuro Baby. Journal of the Society of Instrument and Control Engineers (1995). http://ci.nii.ac.jp/naid/10006207702/
Keyword(s):
- VR
- Baby
- Face Generation
- Haptic Feedback
- Nursing Simulator
- Entertainment VR
Additional Images:
Acknowledgements:
Special thanks to Fujitsu Social Science Laboratory for helping us realizing this project. “Real Baby – Real Family” belongs to ShiraiLab, VR Entertainment Application Knowledge (VREAK) Center, and Kanagawa Institute of Technology.
