“Sphere: A Novel Approach to 3D and Active Sound Localization” by Gaveau, Coudert, Salemme, Koun, Desoche, et al. …

  • ©Valerie Gaveau, Aurélie Coudert, Romeo Salemme, Eric Koun, Clément Desoche, Eric Truy, Alessandro Farnè, and Francesco Pavani

Conference:


Type:


Entry Number: 33

Title:

    Sphere: A Novel Approach to 3D and Active Sound Localization

Presenter(s)/Author(s):



Abstract:


    In everyday life, localizing a sound source entails more than the sole extraction of auditory cues to define its three-dimensions: spatial hearing also takes into account the available visual information (e.g. cues to sound position) and resolves perceptual ambiguities through active listening behavior (e.g. exploring the auditory environment with head movements). We introduce a novel approach to sound localization in 3D named SPHERE which exploits a commercially available Virtual Reality Head-mounted display system with real- time kinematic tracking to combine all of these elements (controlled positioning of a real sound source, recording of participants’ responses in 3D, controlled visual stimulations and active listening behavior). SPHERE allows accurate sampling of 3D spatial hearing abilities, and allows detection and quantification of the contribution of active listening.

References:


    Piotr Majdak, Matthew J. Goupell and Bernhard Laback. 2011. Two-Dimensional Localization of Virtual Sound Sources in Cochlear-Implant Listeners. Ear Hearing 32 (2): 198-208. DOI: 10.1097/AUD.0b013e3181f4dfe9.Google ScholarCross Ref
    Kazuhiro Lida. 2019. Head-Related Transfer Functions Ans Acoustic Virtual Reality. Springer Singapore. Biomedical Sciences.Google Scholar
    Hans Wallach. 1940. The Role of Head Movements and Vestibular and Visual Cues in Sound Localization. Journal Experimental Psychology 27 (4): 339-68. DOI: 0.1037/h0054629.Google ScholarCross Ref
    Chiara Valzolgher, Grégoire Verdelet, Romeo Salemme, Luigi Lombardi, Alessandro Farnè, Francesco Pavani. 2020. Reaching to sounds in virtual reality: A multisensory-motor approach to promote adaptation to altered auditory cues. Neuropsychologie149:107665. DOI:10.1016/j.neuropsychologia.2020.107665Google Scholar
    Aurélie Coudert, Valérie Gaveau, Julie Gatel, Grégoire Verdelet, Romeo Salemme, Alessandro Farnè, Francesco Pavani, Eric Truy. 2022. Spatial Hearing Difficulties in Reaching Space in Bilateral Cochlear Implant Children Improve With Head Movements. Ear Hearing. 43(1):192-205. DOI: https://doi.org/10.1097/AUD.0000000000001090%3c/bib>Google ScholarCross Ref
    Chiara Valzolgher, Michaela Todeschini, Grégoire Verdelet, Julie Gatel, Romeo Salemme, Valérie Gaveau, Eric Truy, Alessandro Farnè, Francesco Pavani. Adapting to altered auditory cues: Generalization from manual reaching to head pointing. (2022).PloSone17(4), e0263509. DOI:10.1371/journal.pone.0263509Google Scholar
    Romeo Salemme, Valérie Gaveau, Alessandro Farnè, Francesco Pavani, Eric Koun, Anaël Belle. Method and apparatus for acquiring a spatial map of auditory perception of a subject. (2021). Patent No. 11176727, Filed May 26th., 2017. Issued Nov. 16th., 2021.Google Scholar


ACM Digital Library Publication:



Overview Page: