“The Gesture Lives On: A VR-Driven Puppet Performance in Immersive Space” by Lin, Yen and Hsu
Conference:
Type(s):
Title:
- The Gesture Lives On: A VR-Driven Puppet Performance in Immersive Space
Session/Category Title:
- Augmented & Virtual Reality
Presenter(s)/Author(s):
Abstract:
The Gesture Lives On transforms traditional Taiwanese glove puppetry into an immersive digital performance through real-time VR gesture tracking and virtual puppet co-performance, offering a novel model for integrating cultural heritage with contemporary performance technologies.
References:
[1] Shangchen Han, Beibei Liu, Randi Cabezas, Christopher D Twigg, Peizhao Zhang, Jeff Petkau, Tsz-Ho Yu, Chun-Jung Tai, Muzaffer Akbay, Zheng Wang, et al. 2020. MEgATrack: monochrome egocentric articulated hand-tracking for virtual reality. ACM Transactions on Graphics (ToG) 39, 4 (2020), 87–1.
[2] Chi-Yen Lin, Zhang-Hao Yang, Heng-Wei Zhou, Tsai-Ni Yang, Hong-Nien Chen, and Timothy K Shih. 2018. Combining leap motion with unity for virtual glove puppets. In 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, 251–255.
[3] Der-Lor Way, Weng-Kei Lau, and Tzu Ying Huang. 2019. Glove puppetry cloud theater through a virtual reality network. In ACM SIGGRAPH 2019 Posters. 1–2.
[4] Wei-Chen Yen, Jen-Kai Liu, Jia-Jiu Peng, Hsiao-Yu Luo, Ping-Hsuan Han, and Chun-Cheng Hsu. 2024. Theater of Future Puppetry: An Immersive Puppeteering Experience Based on Hands Tracking and Gestures Recognition. In SIGGRAPH Asia 2024 XR. 1–2.


