“Miruoto: Sports Event Atmosphere Visual Rendering Through Real-time Image and Sound Processing System”
Conference:
Type(s):
Title:
- Miruoto: Sports Event Atmosphere Visual Rendering Through Real-time Image and Sound Processing System
Collaborator(s):
Description:
Did you already imagine how it would be to watch a sporting match without sounds? We developed a system that displays in real-time onomatopoeia, representing sounds during a sports event for hearing impaired and hearing public. In this way, they can enjoy manga-like onomatopoeia overlay on the match video stream.
References:
[1]
Akita. 2009. A grammar of sound-symbolic words in Japanese : theoretical approaches to iconic and lexical properties of mimetics. Ph.D. Dissertation. Kobe Univ.
[2]
Jort F.2017. Audio Set: An ontology and human-labeled dataset for audio events. In Proc. IEEE ICASSP 2017.
[3]
Tsukasa Fukusato and Shigeo Morishima. 2014. Automatic depiction of onomatopoeia in animation considering physical phenomena. In Proceedings of the 7th International Conference on Motion in Games. 161?169. https://doi.org/10.1145/2668064.2668096
[4]
Andrew G.2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arxiv:cs.CV/1704.04861
[5]
Carling Gerd. 2014. Motivated language change: processes involved in the growth and conventionalization of onomatopoeia and sound symbolism. Acta Linguistica Hafniensia 46, 2 (2014), 199?217. https://doi.org/10.1080/03740463.2014.990293
[6]
Hamano. 2000. The Sound-Symbolic System of Japanese. Language 76, 1 (March 2000), 174. https://doi.org/10.2307/417404
[7]
Keisuke Kambara and Koji Tsukada. 2010. Onomatopen: Painting Using Onomatopoeia. Springer Berlin Heidelberg, 43?54. https://doi.org/10.1007/978-3-642-15399-0_5
[8]
M. Manar. 2021. Onomatopoeia and Direct Speech on the Narratives of Deaf and Hearing Students. In Proceedings of the Tenth International Conference on Languages and Arts (ICLA 2021). 85?91. https://doi.org/10.2991/assehr.k.211129.015
[9]
M. Namatame. 2019. Effectiveness of Multisensory Methods in Learning Onomatopoeia for the Hearing-Impaired. https://doi.org/10.1007/978-3-030-21151-6_1
[10]
Statista. 2022. Japan: manga reading frequency. http://tinyurl.com/4jwsw68b.
[11]
Jan?Olof Svantesson. 2017. Sound symbolism: the role of word sound in meaning. WIREs Cognitive Science 8, 5 (March 2017). https://doi.org/10.1002/wcs.1441
[12]
Lei Ye. 2023. Onomatopoeia, Sound Effects and Humour in Japanese Anime and US Animation Films and Television. Animation 18, 3 (Nov. 2023), 273?291. https://doi.org/10.1177/17468477231206681
