“Actualities: Seamless Live Performance with the Physical and Virtual Audiences in Multiverse” by Lin, Chou, Weng, Tsai Chen, Lim, et al. …

  • ©Ke-Fan Lin, Yu-Chih Chou, Yu-Hsiang Weng, Yvone Tsai Chen, Zin-Yin Lim, Chi-Po Lin, Ping-Hsuan Han, and Tse-Yu Pan


Entry Number: 01


    Actualities: Seamless Live Performance with the Physical and Virtual Audiences in Multiverse



    During the pandemic, the popularity of VR concerts increased, providing the audience with a novel experience of watching performances where performers and online attendees typically exist in different spaces and times. However, as the pandemic recovered gradually, people returned to live performances physically due to the diminished sense of co-presence experienced in VR concerts. We present Actualities, a seamless live performance consisting of onsite and online form with a multiverse interaction to create an engaging experience for all participants. By utilizing various sensors, we capture signals from the performance venue and digitalize all onsite elements into virtual scenes. The visual content is projected onto screens for the onsite audience, while being simultaneously broadcast via live-streaming to the online audience.


    1. Leila Amirsadeghi. 2020. Location-Based Entertainment: How Immersive Technology Can Make Us More Human. In Handbook of Research on the Global Impacts and Roles of Immersive Media. IGI Global, 284–313.
    2. Steven Caldwell Brown and Don Knox. 2017. Why go to pop concerts? The motivations behind live music attendance. Musicae Scientiae 21, 3 (2017), 233–249.
    3. Jean-Philippe Charron. 2017. Music audiences 3.0: Concert-goers’ psychological motivations at the dawn of virtual reality. Frontiers in psychology 8 (2017), 800.
    4. Ryota Horie, Minami Wada, and Eri Watanabe. 2018. Participation in a virtual reality concert via brainwave and heartbeat. In Advances in Affective and Pleasurable Design: Proceedings of the AHFE 2017 International Conference on Affective and Pleasurable Design, July 17–21, 2017, The Westin Bonaventure Hotel, Los Angeles, California, USA 8. Springer, 276–284.
    5. Hiromu Yakura and Masataka Goto. 2020. Enhancing participation experience in vr live concerts by improving motions of virtual audience avatars. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 555–565.

ACM Digital Library Publication:

Overview Page: