“Audio-driven Violin Performance Animation With Clear Fingering and Bowing” by Hirata, Tanaka, Hamanaka and Morishima
Conference:
Type(s):
Entry Number: 07
Title:
- Audio-driven Violin Performance Animation With Clear Fingering and Bowing
Presenter(s)/Author(s):
Abstract:
This paper presents an audio-to-animation synthesis method for violin performance. This new approach provides a fine-grained violin performance animation using information on playing procedure consisting of played string, finger number, position, and bow direction. We demonstrate that our method is capable of synthesizing natural violin performance animation with fine fingering and bowing through extensive evaluation.
References:
Asuka Hirata, Keitaro Tanaka, Ryo Shimamura, and Shigeo Morishima. 2021. Bowing-Net: Motion Generation for String Instruments Based on Bowing Information. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Posters (SIGGRAPH). 1–2.Google Scholar
Hsuan-Kai Kao and Li Su. 2020. Temporally Guided Music-to-Body-Movement Generation. In Proceedings of the 28th ACM International Conference on Multimedia (ACM MM). 147–155.Google ScholarDigital Library
Brian McFee, Colin Raffel, Dawen Liang, Daniel PW Ellis, Matt McVicar, Eric Battenberg, and Oriol Nieto. 2015. librosa: Audio and music signal analysis in python. In Proceedings of the 14th python in science conference, Vol. 8.Google ScholarCross Ref
Eli Shlizerman, Lucio Dery, Hayden Schoen, and Ira Kemelmacher-Shlizerman. 2018. Audio to body dynamics. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 7574–7583.Google ScholarCross Ref
Snehesh Shrestha, Cornelia Fermüller, Tianyu Huang, Pyone Thant Win, Adam Zukerman, Chethan M Parameshwara, and Yiannis Aloimonos. 2022. AIMusicGuru: Music Assisted Human Pose Correction. arXiv preprint arXiv:2203.12829.Google Scholar
