“HyperMask: Virtual Reactive Faces for Storytelling” by Binsted

HyperMask projects an animated face onto a physical mask that is worn by an actor. As the mask moves within a prescribed area (the stage), its position and orientation are detected by a camera, and the computed projected image moves accordingly. If the orientation of the mask changes, the projected image changes with respect to the viewpoint of the audience. The lips of the projected face are automatically synchronized in real time with the voice of the actor, who also controls the face’s expressions.

As a theatrical tool, HyperMask enables a new style of storytelling. In the Millennium Motel, a self-contained system in a linen cart projects onto the mask worn. The actor pushes the cart and portrays a chambermaid (“Millie”) who tells amusing stories set in the motel.