As of today, the field of networked musical XR is in its infancy. While the next generation networks keep pushing the available bandwidth towards new frontiers, promoting the deployment of new services and applications, a limited amount of residual latency still hinders the possibility for musicians to seamlessly interact over the Internet. In fact, while audiovisual (and audio in particular) streaming has reached high performances, allowing for smooth interaction in many application scenarios such as video calls and dialogues, the study of tools to ensure a flawless immersive interplay experience among musicians is a rather unexplored area. This paper reports a preliminary investigation on a technical setup that couples a networked music performance system with an XR system, conceived to interconnect geographically displaced musicians. The setup we have envisaged has allowed us to identify the existing technical issues in current technologies used for networked musical XR. We discuss such issues and reason about possible future research directions in this area that should be covered to advance the current state of the art.

Networked Musical XR: Where's the limit? A preliminary investigation on the joint use of point clouds and low-latency audio communication / Turchet, L.; Garau, N.; Conci, N.. - (2022), pp. 226-230. (Intervento presentato al convegno 17th International Audio Mostly Conference: What You Hear is What You See? Perspectives on Modalities in Sound and Music Interaction, AM 2022 tenutosi a St. Polten University of Applied Sciences, Austria nel 6-9 September 2022) [10.1145/3561212.3561237].

Networked Musical XR: Where's the limit? A preliminary investigation on the joint use of point clouds and low-latency audio communication

Turchet L.
Primo
;
Garau N.
Secondo
;
Conci N.
Ultimo
2022-01-01

Abstract

As of today, the field of networked musical XR is in its infancy. While the next generation networks keep pushing the available bandwidth towards new frontiers, promoting the deployment of new services and applications, a limited amount of residual latency still hinders the possibility for musicians to seamlessly interact over the Internet. In fact, while audiovisual (and audio in particular) streaming has reached high performances, allowing for smooth interaction in many application scenarios such as video calls and dialogues, the study of tools to ensure a flawless immersive interplay experience among musicians is a rather unexplored area. This paper reports a preliminary investigation on a technical setup that couples a networked music performance system with an XR system, conceived to interconnect geographically displaced musicians. The setup we have envisaged has allowed us to identify the existing technical issues in current technologies used for networked musical XR. We discuss such issues and reason about possible future research directions in this area that should be covered to advance the current state of the art.
2022
AM '22: Proceedings of the 17th International Audio Mostly Conference
New York
Association for Computing Machinery
9781450397018
Turchet, L.; Garau, N.; Conci, N.
Networked Musical XR: Where's the limit? A preliminary investigation on the joint use of point clouds and low-latency audio communication / Turchet, L.; Garau, N.; Conci, N.. - (2022), pp. 226-230. (Intervento presentato al convegno 17th International Audio Mostly Conference: What You Hear is What You See? Perspectives on Modalities in Sound and Music Interaction, AM 2022 tenutosi a St. Polten University of Applied Sciences, Austria nel 6-9 September 2022) [10.1145/3561212.3561237].
File in questo prodotto:
File Dimensione Formato  
Networked_Musical_XR__a_preliminary_investigation_on_point_cloud_methods.pdf

accesso aperto

Descrizione: first online
Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.45 MB
Formato Adobe PDF
2.45 MB Adobe PDF Visualizza/Apri
3561212.3561237.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.47 MB
Formato Adobe PDF
2.47 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/364730
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
social impact