“Boundless Conversations: AI-Powered Video Interactions across Domains, Languages, and Time”
Conference:
Experience Type(s):
Title:
- Boundless Conversations: AI-Powered Video Interactions across Domains, Languages, and Time
Organizer(s)/Presenter(s):
Description:
We present novel web applications that blend AI and video communication, offering an interactive way to engage with videos, transcending time and distance constraints. Known as Time Offset Interaction Application (TOIA), the platform transforms passive video viewing into dynamic conversations using personal recordings or YouTube clips. Our work expands TOIA with two unique experiences: 1) “The Elephant in the Room” project, stimulating dialogues on sensitive topics like childbirth, sex, and death; 2) Support for multilingual interactions, fostering a global collection of diverse personal narratives. Through AI and interactive media, we aim to broaden the horizons for sharing human experiences and perspectives.
References:
[1]
Dana Abu Ali, Muaz Ahmad, Hayat Al Hassan, Paula Dozsa, Ming Hu, Jose Varias, and Nizar Habash. 2018. A bilingual interactive human avatar dialogue system. In Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue.
Crossref
Google Scholar
[2]
Alberto Chierici, Tyeece Kiana Fredorcia Hensley, Wahib Kamran, Kertu Koss, Armaan Agrawal, Erin Meekhof, Goffredo Puccetti, and Nizar Habash. 2021. A Cloud-based User-Centered Time-Offset Interaction Application. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue.
Crossref
Google Scholar
[3]
Alberto Maria Chierici. 2023. Scalable, Human-Like Asynchronous Communication. Ph. D. Dissertation. New York University Tandon School of Engineering.
Google Scholar
[4]
Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan, and Wei Wang. 2020. Language-agnostic bert sentence embedding. preprint arXiv:2007.01852 (2020).
Google Scholar
[5]
Arvind Neelakantan, Tao Xu, Raul Puri, Alec Radford, Jesse Michael Han, Jerry Tworek, Qiming Yuan, Nikolas Tezak, Jong Wook Kim, Chris Hallacy, Johannes Heidecke, Pranav Shyam, Boris Power, Tyna Eloundou Nekoul, Girish Sastry, Gretchen Krueger, David Schnurr, Felipe Petroski Such, Kenny Hsu, Madeleine Thompson, Tabarak Khan, Toki Sherbakov, Joanne Jang, Peter Welinder, and Lilian Weng. 2022. Text and code embeddings by contrastive pre-training. preprint arXiv:2201.10005 (2022).
Google Scholar
[6]
David Traum, Andrew Jones, Kia Hays, Heather Maio, Oleg Alexander, Ron Artstein, Paul Debevec, Alesia Gainer, Kallirroi Georgila, Kathleen Haase, Karen Jungblut, Anton Leuski, Stephen Smith, and William Swartout. 2015. New Dimensions in Testimony: Digitally preserving a Holocaust survivor’s interactive storytelling. In Proceedings of the International Conference on Interactive Digital Storytelling. Copenhagen, Denmark.
Crossref
Google Scholar
