“Remixing the Flying Words Project” by Chateauvert, Jégo and Tsampounaris
Conference:
Type(s):
Title:
- Remixing the Flying Words Project
Session/Category Title:
- Spatial Storytelling
Presenter(s)/Author(s):
Abstract:
Remixing the Flying Words Project is a mixed-reality installation that reimagines an ASL poem through immersive technology. Using motion capture and AI-generated imagery, it enables audiences to experience sign language poetry kinesthetically. Presented in a mixed-reality headset, it transforms linguistic translation into a dynamic, multisensory engagement with spatial storytelling.
References:
[1] Julie Chateauvert. 2019. Intermédialité et proxémie Propositions pour une méthodologie d’analyse de la création en langue des signes. 275, 88. Littérature générale et comparée, n° 34 in Rencontres. Paris: Classiques Garnier.
[2] Peter S. Cook. 2011. Features in American Sign Language Storytelling. Storytelling, Self, Society. 7, 1. 36-62.
[3] Jean-François Jégo, Vincent Meyrueis and Dominique Boutet. 2019. A Workflow for Real-Time Visualization and Data Analysis of Gesture Using Motion Capture. In Proceedings of the 6th International Conference on Movement and Computing MOCO ’19. New York, NY, USA: Association for Computing Machinery.
[4] Comfy.org. 2025. ComfyUI Text to Image Workflow. ComfyUI, Retrieved 10 March 2025 from https://docs.comfy.org/tutorials/basic/text-to-image
