The use of spatial audio plugins (SAPs) with Ambisonics processing and binaural rendering has become widespread in the last decade, thanks to their increased accessibility and usability. SAPs are particularly relevant in scenarios involving real-time music playing with headphones, such as networked music performance and individual recreational musicmaking using backing tracks. However, a crucial issue that has been largely overlooked thus far is the measurement of the processing latency introduced by currently available SAPs. Identifying which SAPs are the fastest is essential to enable designers, musicians, and researchers to create time-sensitive applications involving 3D audio. To bridge this gap, we compared nine systems formed by different SAPs that enable 3D audio management. We measured the latency of each system throughout the third-order Ambisonics plugins pipeline: encoding, room simulation, sound scene rotation, and binaural decoding. In particular, the measurements were performed utilizing different buffer sizes. Results showed that to achieve a minimization of the latency, it is necessary to use a combination of different SAPs from different systems. Based on our measurements, we propose two spatial audio systems that mix different SAPs. Considering a sampling rate of 48 kHz, a Dell Alienware x15 R2 laptop running the Windows 10 operating system, and an RME Fireface UFX sound card, the two systems achieved an overall latency of 0.33 ms and 0.94 ms respectively.

Latency of spatial audio plugins: a comparative study / Tomasetti, Matteo; Farina, Angelo; Turchet, Luca. - ELETTRONICO. - (2023), pp. 1-10. (Intervento presentato al convegno 2023 Immersive and 3D Audio: from Architecture to Automotive, I3DA 2023 tenutosi a Bologna, Italy nel 05-07 September 2023) [10.1109/I3DA57090.2023.10289279].

Latency of spatial audio plugins: a comparative study

Tomasetti, Matteo
Primo
;
Turchet, Luca
Ultimo
2023-01-01

Abstract

The use of spatial audio plugins (SAPs) with Ambisonics processing and binaural rendering has become widespread in the last decade, thanks to their increased accessibility and usability. SAPs are particularly relevant in scenarios involving real-time music playing with headphones, such as networked music performance and individual recreational musicmaking using backing tracks. However, a crucial issue that has been largely overlooked thus far is the measurement of the processing latency introduced by currently available SAPs. Identifying which SAPs are the fastest is essential to enable designers, musicians, and researchers to create time-sensitive applications involving 3D audio. To bridge this gap, we compared nine systems formed by different SAPs that enable 3D audio management. We measured the latency of each system throughout the third-order Ambisonics plugins pipeline: encoding, room simulation, sound scene rotation, and binaural decoding. In particular, the measurements were performed utilizing different buffer sizes. Results showed that to achieve a minimization of the latency, it is necessary to use a combination of different SAPs from different systems. Based on our measurements, we propose two spatial audio systems that mix different SAPs. Considering a sampling rate of 48 kHz, a Dell Alienware x15 R2 laptop running the Windows 10 operating system, and an RME Fireface UFX sound card, the two systems achieved an overall latency of 0.33 ms and 0.94 ms respectively.
2023
2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)
Piscataway, NJ USA
Institute of Electrical and Electronics Engineers Inc.
979-8-3503-1104-4
979-8-3503-1105-1
Tomasetti, Matteo; Farina, Angelo; Turchet, Luca
Latency of spatial audio plugins: a comparative study / Tomasetti, Matteo; Farina, Angelo; Turchet, Luca. - ELETTRONICO. - (2023), pp. 1-10. (Intervento presentato al convegno 2023 Immersive and 3D Audio: from Architecture to Automotive, I3DA 2023 tenutosi a Bologna, Italy nel 05-07 September 2023) [10.1109/I3DA57090.2023.10289279].
File in questo prodotto:
File Dimensione Formato  
Latency_of_spatial_audio_plugins__a_comparative_study_DEF.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 557.52 kB
Formato Adobe PDF
557.52 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/399755
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact