Explanations have gained an increasing level of interest in the AI and Machine Learning (ML) communities in order to improve model transparency and allow users to form a mental model of a trained ML model. However, explanations can go beyond this one way communication as a mechanism to elicit user control, because once users understand, they can then provide feedback. The goal of this paper is to present an overview of research where explanations are combined with interactive capabilities as a mean to learn new models from scratch and to edit and debug existing ones. To this end, we draw a conceptual map of the state-of-the-art, grouping relevant approaches based on their intended purpose and on how they structure the interaction, highlighting similarities and differences between them. We also discuss open research issues and outline possible directions forward, with the hope of spurring further research on this blooming research topic.

Leveraging explanations in interactive machine learning: An overview / Teso, Stefano; Alkan, Öznur; Stammer, Wolfgang; Daly, Elizabeth. - In: FRONTIERS IN ARTIFICIAL INTELLIGENCE. - ISSN 2624-8212. - 6:(2023), pp. 1-19. [10.3389/frai.2023.1066049]

Leveraging explanations in interactive machine learning: An overview

Teso, Stefano
Primo
;
2023-01-01

Abstract

Explanations have gained an increasing level of interest in the AI and Machine Learning (ML) communities in order to improve model transparency and allow users to form a mental model of a trained ML model. However, explanations can go beyond this one way communication as a mechanism to elicit user control, because once users understand, they can then provide feedback. The goal of this paper is to present an overview of research where explanations are combined with interactive capabilities as a mean to learn new models from scratch and to edit and debug existing ones. To this end, we draw a conceptual map of the state-of-the-art, grouping relevant approaches based on their intended purpose and on how they structure the interaction, highlighting similarities and differences between them. We also discuss open research issues and outline possible directions forward, with the hope of spurring further research on this blooming research topic.
2023
Teso, Stefano; Alkan, Öznur; Stammer, Wolfgang; Daly, Elizabeth
Leveraging explanations in interactive machine learning: An overview / Teso, Stefano; Alkan, Öznur; Stammer, Wolfgang; Daly, Elizabeth. - In: FRONTIERS IN ARTIFICIAL INTELLIGENCE. - ISSN 2624-8212. - 6:(2023), pp. 1-19. [10.3389/frai.2023.1066049]
File in questo prodotto:
File Dimensione Formato  
for IRIS - 2207.14526v2.pdf

accesso aperto

Descrizione: Manuscript
Tipologia: Pre-print non referato (Non-refereed preprint)
Licenza: Creative commons
Dimensione 1.92 MB
Formato Adobe PDF
1.92 MB Adobe PDF Visualizza/Apri
frai-06-1066049.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 1.18 MB
Formato Adobe PDF
1.18 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/437494
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 30
  • ???jsp.display-item.citation.isi??? 18
  • OpenAlex ND
social impact