In recent years, various explainable artificial intelligence methods have been proposed for different Music Information Retrieval (MIR) applications. However, real-time aspects of explainability and the musical applications that they can enable have been largely overlooked by researchers. In this position paper, we propose a vision for real-time explanation systems in the context of MIR applications. We describe three application scenarios where such systems would be useful, although the same concepts can be applied to other musical cases. In the first scenario, we propose a system that provides explanations for an emotion recognition model in the context of music composition and production. In the second scenario, we investigate the benefits of explaining a music genre recognition system for live performances. In the third scenario, we explore the utility of an explanation system for an application in musical instrument learning. Subsequently, we discuss the main challenges associated with the envisioned real-time explanation systems and use cases, especially in relation to the need for easy-to-grasp explanations and to the possible embedding of such systems into smart musical instruments.
Explainability and Real-Time in Music Information Retrieval: Motivations and Possible Scenarios / Rossi, Michele; Iacca, Giovanni; Turchet, Luca. - (2023), pp. 96-104. (Intervento presentato al convegno 4th International Symposium on the Internet of Sounds, ISIoS 2023 tenutosi a Pisa, Italy nel 26th-27th October 2023) [10.1109/IEEECONF59510.2023.10335217].
Explainability and Real-Time in Music Information Retrieval: Motivations and Possible Scenarios
Rossi, Michele;Iacca, Giovanni;Turchet, Luca
2023-01-01
Abstract
In recent years, various explainable artificial intelligence methods have been proposed for different Music Information Retrieval (MIR) applications. However, real-time aspects of explainability and the musical applications that they can enable have been largely overlooked by researchers. In this position paper, we propose a vision for real-time explanation systems in the context of MIR applications. We describe three application scenarios where such systems would be useful, although the same concepts can be applied to other musical cases. In the first scenario, we propose a system that provides explanations for an emotion recognition model in the context of music composition and production. In the second scenario, we investigate the benefits of explaining a music genre recognition system for live performances. In the third scenario, we explore the utility of an explanation system for an application in musical instrument learning. Subsequently, we discuss the main challenges associated with the envisioned real-time explanation systems and use cases, especially in relation to the need for easy-to-grasp explanations and to the possible embedding of such systems into smart musical instruments.File | Dimensione | Formato | |
---|---|---|---|
Towards_real_time_explainability_in_music_information_retrieval.v1.pdf
Solo gestori archivio
Tipologia:
Post-print referato (Refereed author’s manuscript)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
180.5 kB
Formato
Adobe PDF
|
180.5 kB | Adobe PDF | Visualizza/Apri |
Explainability_and_Real-Time_in_Music_Information_Retrieval_Motivations_and_Possible_Scenarios.pdf
Solo gestori archivio
Tipologia:
Versione editoriale (Publisher’s layout)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
871.98 kB
Formato
Adobe PDF
|
871.98 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione