“HEROES: A Duet in Mixed Reality” by Painter

  • ©Melissa Painter


Entry Number: 08


    HEROES: A Duet in Mixed Reality



    Using 2-D, virtual reality, and augmented reality headsets, Heroes crafts a multidimensional experience that lets you chase dancers around a pool and on stage, scale through a labyrinth of stunning architecture, and even reach out and hold the dancers in the palm of your hand. Set to David Bowie’s iconic track Heroes, and filmed at the historic Theater at Ace Hotel in Los Angeles, Heroes is experienced by users in three ways: as a linear narrative, from within an Oculus Gear VR headset, and using the Microsoft HoloLens AR headset.

    Built with Unity in collaboration with MPC VR, the project utilizes the 360-degree Nokia OZO camera, photogrammetry, rapid avatar creation, as well as traditional 2D film, Oculus Gear VR, Microsoft HoloLens, painting, animation, dance and even the users’ voice and body.


    Andrew Feng, Dan Casas, and Ari Shapiro. 2015. Avatar Reshaping and Automatic Rigging Using a Deformable Model. In Proceedings of the 8th ACM SIGGRAPH Conference on Motion in Games (MIG ’15). ACM, New York, NY, USA, 57–64.

ACM Digital Library Publication:

Overview Page: