Issue |
Acta Acust.
Volume 9, 2025
|
|
---|---|---|
Article Number | 21 | |
Number of page(s) | 15 | |
Section | Virtual Acoustics | |
DOI | https://doi.org/10.1051/aacus/2025005 | |
Published online | 11 March 2025 |
Scientific Article
Effect of HRTFs and head motion on auditory-visual localization in real and virtual studio environments
Institute of Electronic Music and Acoustics, University of Music and Performing Arts Graz, 8010 Graz, Austria
* Corresponding author: riedel@iem.at
Received:
2
July
2024
Accepted:
27
January
2025
When localizing sound sources in natural or virtual environments, multisensory integration that combines auditory and visual cues is often involved. This study aims to determine the effect of (non-)individual head-related transfer functions (HRTFs) on sound source localization in the presence of visual cues. Participants (N = 16) were seated in a hemispherical loudspeaker arrangement, and their task was to indicate the perceived direction of pink-noise bursts. The conditions included localization of real loudspeakers and virtualized loudspeakers based on binaural rendering with (non-)individual HRTFs. The horizontal spacing of the visible loudspeakers was 30 degrees or larger and the vertical spacing was varied between 30 degrees and 15 degrees, to focus on vertical discrimination. The results of a static localization experiment (no head movements during playback) demonstrated an increased rate of vertical local confusions using non-individual binaural room impulse responses (BRIRs) of the KU100 dummy head compared to individual BRIRs. Dynamic auditory-visual localization with non-individual HRTFs suffered from vertical uncertainty and bias in the frontal area, where local confusion rates were consistent with the static experiment. In conclusion, the horizontal localization mapping of dynamic binaural rendering with non-individual HRTFs was comparable to real loudspeaker reproduction, while the vertical mapping was significantly impaired.
Key words: Auditory-visual localization / Binaural rendering / Virtual and augmented reality / Head-related transfer functions
© The Author(s), Published by EDP Sciences, 2025
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.