In recent years, various explainable artificial intelligence methods have been proposed for different Music Information Retrieval (MIR) applications. However, real-time aspects of explainability and the musical applications that they can enable have been largely overlooked by researchers. In this position paper, we propose a vision for real-time explanation systems in the context of MIR applications. We describe three application scenarios where such systems would be useful, although the same concepts can be applied to other musical cases. In the first scenario, we propose a system that provides explanations for an emotion recognition model in the context of music composition and production. In the second scenario, we investigate the benefits of explaining a music genre recognition system for live performances. In the third scenario, we explore the utility of an explanation system for an application in musical instrument learning. Subsequently, we discuss the main challenges associated with the envisioned real-time explanation systems and use cases, especially in relation to the need for easy-to-grasp explanations and to the possible embedding of such systems into smart musical instruments.

Explainability and Real-Time in Music Information Retrieval: Motivations and Possible Scenarios / Rossi, Michele; Iacca, Giovanni; Turchet, Luca. - (2023), pp. 96-104. (Intervento presentato al convegno 4th International Symposium on the Internet of Sounds, ISIoS 2023 tenutosi a Pisa, Italy nel 26th-27th October 2023) [10.1109/IEEECONF59510.2023.10335217].

Explainability and Real-Time in Music Information Retrieval: Motivations and Possible Scenarios

Rossi, Michele;Iacca, Giovanni;Turchet, Luca
2023-01-01

Abstract

In recent years, various explainable artificial intelligence methods have been proposed for different Music Information Retrieval (MIR) applications. However, real-time aspects of explainability and the musical applications that they can enable have been largely overlooked by researchers. In this position paper, we propose a vision for real-time explanation systems in the context of MIR applications. We describe three application scenarios where such systems would be useful, although the same concepts can be applied to other musical cases. In the first scenario, we propose a system that provides explanations for an emotion recognition model in the context of music composition and production. In the second scenario, we investigate the benefits of explaining a music genre recognition system for live performances. In the third scenario, we explore the utility of an explanation system for an application in musical instrument learning. Subsequently, we discuss the main challenges associated with the envisioned real-time explanation systems and use cases, especially in relation to the need for easy-to-grasp explanations and to the possible embedding of such systems into smart musical instruments.
2023
2023 4th International Symposium on the Internet of Sounds
Piscataway, NJ USA
IEEE
979-8-3503-8254-9
Rossi, Michele; Iacca, Giovanni; Turchet, Luca
Explainability and Real-Time in Music Information Retrieval: Motivations and Possible Scenarios / Rossi, Michele; Iacca, Giovanni; Turchet, Luca. - (2023), pp. 96-104. (Intervento presentato al convegno 4th International Symposium on the Internet of Sounds, ISIoS 2023 tenutosi a Pisa, Italy nel 26th-27th October 2023) [10.1109/IEEECONF59510.2023.10335217].
File in questo prodotto:
File Dimensione Formato  
Towards_real_time_explainability_in_music_information_retrieval.v1.pdf

Solo gestori archivio

Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 180.5 kB
Formato Adobe PDF
180.5 kB Adobe PDF   Visualizza/Apri
Explainability_and_Real-Time_in_Music_Information_Retrieval_Motivations_and_Possible_Scenarios.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 871.98 kB
Formato Adobe PDF
871.98 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/399010
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
  • OpenAlex ND
social impact