“TimbreSpace: Spatial Storytelling Through Interactive Soundscapes” by Van and Moore
Conference:
Type(s):
Title:
- TimbreSpace: Spatial Storytelling Through Interactive Soundscapes
Session/Category Title:
- Spatial Storytelling
Presenter(s)/Author(s):
Abstract:
TimbreSpace is an XR music sandbox where users sculpt sound in an immersive spatial environment. Merging AI-driven analysis, interactive sampling, and generative audio, it transforms audio into evolving soundscapes. Our demo showcases intuitive, embodied sound design, enabling playful, expressive music creation beyond traditional DAW interfaces.
References:
[1] William Brent. 2010. A Timbre Analysis And Classification Toolkit For Pure Data. International Computer Music Conference, ICMC 2010 (01 2010). https://quod.lib.umich.edu/cgi/p/pod/dod-idx/timbre-analysis-and-classification-toolkit-for-pure-data.pdf?c=icmc;idno=bbp2372.2010.044;format=pdf
[2] Brian McFee, Colin Raffel, Dawen Liang, Daniel P.W. Ellis, Matt McVicar, Eric Battenberg, and Oriol Nieto. 2015. librosa: Audio and Music Signal Analysis in Python. In Proceedings of the 14th Python in Science Conference, Kathryn Huff and James Bergstra (Eds.). 18–24. https://doi.org/10.25080/Majora-7b98e3ed-003
[3] Konstantinos Drossos, Stylianos I. Mimilakis, Shayan Gharib, Yanxiong Li, and Tuomas Virtanen. 2020. Sound Event Detection with Depthwise Separable and Dilated Convolutions. arxiv:https://arXiv.org/abs/2002.00476 [cs.SD] https://arxiv.org/abs/2002.00476
[4] Leland McInnes, John Healy, and James Melville. 2018. UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arxiv:https://arXiv.org/abs/1802.03426 [stat.ML] https://arxiv.org/abs/1802.03426
[5] Carl Moore and William Brent. 2019. Interactive Real-time Concatenative Synthesis in Virtual Reality. In Proceedings of the 25th International Conference on Auditory Display (ICAD 2019). 317–320. https://doi.org/10.21785/ICAD2019.068
[6] Yusong Wu, Ke Chen, Tianyu Zhang, Yuchen Hui, Marianna Nezhurina, Taylor Berg-Kirkpatrick, and Shlomo Dubnov. 2024. Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentation. arxiv:https://arXiv.org/abs/2211.06687 [cs.SD] https://arxiv.org/abs/2211.06687
