“Games In Concert – Collaborative Music Making in VR”
Conference:
Experience Type(s):
Title:
- Games In Concert - Collaborative Music Making in VR
Description:
The Games in Concert project explores the possibilities and possible implications of collaborative artistic creation of music in virtual reality. Therefor a multi-user VR environment and three virtual instruments have been designed to create and shape sound in various ways. The musicians are thus able to freely roam and fill the environment with sounds and music using these instruments. Paint: The artist can literally paint music in the 3d space. Parameters such as position, size, colour and materiality of the strokes are translated into sound. Trees: The artist can add and sculpt sounding objects in the 3d space. Parameters such as position, shape, size, colour and materiality of the objects are translated into sound. Keys: An external input device was used to explore the possibility of non VR instruments being incorporated and visualized in the VR space. Additionally, a stage setup has been implemented to explore the impact of a VR-concert on an audience. As the artistic content is being embedded within the virtual environment by the musicians, the spectator can independently explore the work created by the musicians from his/her own perspective. Alternatively, one can directly observe what the artists are creating in real-time. Standing on stage with them in a manner of speaking. For presenting the spectacle in a more classical, manner we introduced the “Game Jockey”. Acting as the link between artists and the public, his in-game view and hearing are rendered on a large screen and multiple speakers, providing a visual experience with surround sound.
References:
[1] Tina Blaine and Sidney Fels. 2017. 2003: Contexts of Collaborative Musical Experiences. In A NIME Reader. Springer International Publishing, 71–87.
[2] Nick Bryan-Kinns. 2013. Mutual engagement and collocation with shared representations. International Journal of Human-Computer Studies 71, 1 (jan 2013), 76–90.
[3] Nick Bryan-Kinns and Fraser Hamilton. 2012. Identifying mutual engagement. Behaviour & Information Technology 31, 2 (feb 2012), 101–125.
[4] Nick Bryan-Kinns, Patrick G. T. Healey, and Joe Leach. 2007. Exploring mutual engagement in creative collaborations. In Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition – C&C ’07. ACM Press.
[5] Hanna Nader and Deborah Richards. 2014. Evaluation framework for 3D collaborative virtual environments (the core). Pacific Asia Conference on Information Systems, 1–10.

