“Yadori: Mask-type User Interface for Manipulation of Puppets” by Sakashita, Kawahara, Koike, Suzuki, Suzuki, et al. …

  • ©Mose Sakashita, Keisuke Kawahara, Amy Koike, Kenta Suzuki, Ippei Suzuki, and Yoichi Ochiai

Conference:


Type(s):


Entry Number: 23

Title:


    Yadori: Mask-type User Interface for Manipulation of Puppets

Presenter(s):


Description:


    We propose a system for animatronics storytelling that enables performers to manipulate puppets by wearing a mask-type device on their faces.

    There have been several studies on devices for sensing facial movements. For example, Affectivewear [Masai et al. 2015] captures user’s eyes movements with glasses device. However, mask-type device for sensing facial movements has not been focused on.

    In Japanese theatrical arts, there is a cultural show called “Noh” where the actors cover their faces with special masks, and act to music to convey a story. Wearing a mask of certain character help Noh-actors to play the role in the story as if they were the character. In puppetry, performers manipulate puppets using their hands above the desk while rest of the body is below the desk. This poses a challenge in coordination of actions mostly so if there are multiple actors. Mask-type device for animatronics is new user interface that allows users to manipulate puppets more easily and intuitively since they are manipulated in accordance with the movements of the performer’s face and mouth. It facilitates coordination of movements to appear more natural since the actors are relaxed and in direct eye contact with each other. Performers can wear a mask of any character on their faces that they want to manipulate. It allows performers to be excited in manipulating puppets and get right into their own part.

References:


    ARAVIND, M. A., DINESH, N. S., RAO, N. C., AND CHARAN, P. R. 2015. ICoRD’15 – Research into Design Across Boundaries Volume 2: Creativity, Sustainability, DfX, Enabling Technologies, Management and Applications. Springer India, New Delhi, ch. Automated Puppetry—Robo-Puppetc , 579–590.

    MASAI, K., SUGIURA, Y., OGATA, M., SUZUKI, K., NAKAMURA, F., SHIMAMURA, S., KUNZE, K., INAMI, M., AND SUGIMOTO, M. 2015. Affectivewear: Toward recognizing facial expression. In ACM SIGGRAPH 2015 Posters, ACM, New York, NY, USA, SIGGRAPH ’15, 16:1–16:1.

Keyword(s):