Music playing with binaural systems has thus far received remarkably little attention by the research community. Such an activity is particularly relevant for the case of networked music performances (NMPs), where geographically displaced musicians play together over a telecommunication network. Recent findings obtained in simulated settings have shown the preference of musicians for spatialized listening during collaborative playing using headphones, as opposed to listening with conventional stereophonic systems. This result has highlighted the need to enhance current NMP systems with the spatial rendering of the acoustic scene, leading to the development of immersive networked music performance (INMP) systems. A crucial aspect that needs to be addressed is the contribution of the spatial audio system to the overall latency of the audio processing and transmission chain between the network nodes. In this paper, we provide an overview of the INMP topic and identify the latency contributions of the components of an INMP system. We then relate such components to state-of-the-art hardware and software systems. Based on our analysis, we draw concluding remarks and discuss the open challenges for progressing the INMP field.

Immersive networked music performance systems: identifying latency factors / Turchet, Luca; Tomasetti, Matteo. - (2023). (Intervento presentato al convegno I3DA tenutosi a Bologna, Italy nel 3-5 Settembre 2023) [10.1109/I3DA57090.2023.10289169].

Immersive networked music performance systems: identifying latency factors

Turchet, Luca
Primo
;
Tomasetti, Matteo
Secondo
2023-01-01

Abstract

Music playing with binaural systems has thus far received remarkably little attention by the research community. Such an activity is particularly relevant for the case of networked music performances (NMPs), where geographically displaced musicians play together over a telecommunication network. Recent findings obtained in simulated settings have shown the preference of musicians for spatialized listening during collaborative playing using headphones, as opposed to listening with conventional stereophonic systems. This result has highlighted the need to enhance current NMP systems with the spatial rendering of the acoustic scene, leading to the development of immersive networked music performance (INMP) systems. A crucial aspect that needs to be addressed is the contribution of the spatial audio system to the overall latency of the audio processing and transmission chain between the network nodes. In this paper, we provide an overview of the INMP topic and identify the latency contributions of the components of an INMP system. We then relate such components to state-of-the-art hardware and software systems. Based on our analysis, we draw concluding remarks and discuss the open challenges for progressing the INMP field.
2023
2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA)
Piscataway, NJ USA
IEEE Xplore
979-8-3503-1104-4
979-8-3503-1105-1
Turchet, Luca; Tomasetti, Matteo
Immersive networked music performance systems: identifying latency factors / Turchet, Luca; Tomasetti, Matteo. - (2023). (Intervento presentato al convegno I3DA tenutosi a Bologna, Italy nel 3-5 Settembre 2023) [10.1109/I3DA57090.2023.10289169].
File in questo prodotto:
File Dimensione Formato  
Immersive_networked_music_performance_systems__identifying_latency_factors.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 869.46 kB
Formato Adobe PDF
869.46 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/399757
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact