“Real-time Motion Capture for Performing Arts and Stage” by Mokhov, Kaur, Talwar, Gudavalli, Song, et al. …
Conference:
Type(s):
Title:
- Real-time Motion Capture for Performing Arts and Stage
Presenter(s)/Author(s):
Abstract:
How can software engineers and artists work effectively together to create real-time CG for performing arts on stage? We answer that with Illimitable Space System (ISS) and a live performances. Since 2012, ISS evolved its reusable pipeline architecture for interactive projection mapping, voice recognition, real-time audio/video effects through gesture and motion to achieve mixed reality and immersive visual effects for stage. ISS is a configurable toolbox for multimodal interaction and serves as a platform for artists to enhance their performance.
In 2016-2017, we deployed ISSv2 during Chinese New Year Galas held in West Island, Montreal as well other other events and educational outreach activities. We followed agile software engineering practices to adapt to the new productions. ISS can be configured with different visual effects profiles according to the requirement. Computation artists and designers can make the said effects without formal software engineering training.
