Studies on audio-visual interactions in sound localization have primarily focused on the relations between the spatial position of sounds and their perceived visual source, as in the famous ventriloquist effect. Much less work has examined the effects on sound localization of seeing aspects of the visual environment. In this study, we took advantage of an innovative method for the study of spatial hearing – based on real sounds, virtual reality and real-time kinematic tracking – to examine the impact of a minimal visual spatial frame on sound localization. We tested sound localization in normal hearing participants (N=36) in two visual conditions: a uniform gray scene and a simple visual environment comprising only a grid. In both cases, no visual cues about the sound sources were provided. During and after sound emission, participants were free to move their head and eyes without restriction. We found that the presence of a visual spatial frame improved hand-pointing in elevation. In addition, it determined faster first-gaze movements to sounds. Our findings show that sound localization benefits from the presence of a minimal visual spatial frame and confirm the importance of combining kinematic tracking and virtual reality when aiming to reveal the multisensory and motor contributions to spatial-hearing abilities.

The impact of a visual spatial frame on real sound-source localization in virtual reality / Valzolgher, Chiara; Alzhaler, Mariam; Gessa, Elena; Todeschini, Michela; Nieto, Pauline; Verdelet, Gregoire; Salemme, Romeo; Gaveau, Valerie; Marx, Mathieu; Truy, Eric; Barone, Pascal; Farnè, Alessandro; Pavani, Francesco. - In: CURRENT RESEARCH IN BEHAVIORAL SCIENCES. - ISSN 2666-5182. - 1:100003(2020). [10.1016/j.crbeha.2020.100003]

The impact of a visual spatial frame on real sound-source localization in virtual reality

Valzolgher, Chiara
;
Gessa, Elena;Farnè, Alessandro;Pavani, Francesco
2020-01-01

Abstract

Studies on audio-visual interactions in sound localization have primarily focused on the relations between the spatial position of sounds and their perceived visual source, as in the famous ventriloquist effect. Much less work has examined the effects on sound localization of seeing aspects of the visual environment. In this study, we took advantage of an innovative method for the study of spatial hearing – based on real sounds, virtual reality and real-time kinematic tracking – to examine the impact of a minimal visual spatial frame on sound localization. We tested sound localization in normal hearing participants (N=36) in two visual conditions: a uniform gray scene and a simple visual environment comprising only a grid. In both cases, no visual cues about the sound sources were provided. During and after sound emission, participants were free to move their head and eyes without restriction. We found that the presence of a visual spatial frame improved hand-pointing in elevation. In addition, it determined faster first-gaze movements to sounds. Our findings show that sound localization benefits from the presence of a minimal visual spatial frame and confirm the importance of combining kinematic tracking and virtual reality when aiming to reveal the multisensory and motor contributions to spatial-hearing abilities.
2020
100003
Valzolgher, Chiara; Alzhaler, Mariam; Gessa, Elena; Todeschini, Michela; Nieto, Pauline; Verdelet, Gregoire; Salemme, Romeo; Gaveau, Valerie; Marx, Mathieu; Truy, Eric; Barone, Pascal; Farnè, Alessandro; Pavani, Francesco
The impact of a visual spatial frame on real sound-source localization in virtual reality / Valzolgher, Chiara; Alzhaler, Mariam; Gessa, Elena; Todeschini, Michela; Nieto, Pauline; Verdelet, Gregoire; Salemme, Romeo; Gaveau, Valerie; Marx, Mathieu; Truy, Eric; Barone, Pascal; Farnè, Alessandro; Pavani, Francesco. - In: CURRENT RESEARCH IN BEHAVIORAL SCIENCES. - ISSN 2666-5182. - 1:100003(2020). [10.1016/j.crbeha.2020.100003]
File in questo prodotto:
File Dimensione Formato  
The impact of a visual spatial frame on real sound-source localization in virtual reality.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 1.02 MB
Formato Adobe PDF
1.02 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/286173
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 19
  • ???jsp.display-item.citation.isi??? ND
social impact