“Real-time Auditorium Modeling and Visual Effects for Live Performances” by Chalmers, Zaman, Stangnes, Finnie, Nguyen, et al. …
Conference:
Type(s):
Title:
- Real-time Auditorium Modeling and Visual Effects for Live Performances
Developer(s):
Description:
A live visual effects platform for stage performances faces key challenges, including 1) reconstructing a 3D digital twin [Chen et al. 2022] of a large auditorium, 2) real-time rendering and composition of 3D visual assets into the 3D digital twin while ensuring coherent lighting [Rhee et al. 2017] and blending with the real stage [Young et al. 2022], and 3) enabling mutual interaction between real and virtual objects to provide a synchronized mixed reality performance [Rhee et al. 2022, 2023]. Our demo showcases a novel platform for live visual effects.