Most AI applications are hybrid, that is, employ machines to make inferences but can fall back on humans when the algorithm is not confident enough. This is true for a wide class of applications ranging from self-driving cars to decision making and process automation in enterprise AI. In this WIP paper we present our vision and progress towards an AI and crowd service that trains, assess and refines ML systems intended to be used in hybrid context. We specifically focus on crowdsourcing as a mean to assist ML algorithm development, and on the different ways in which crowd and machine can interact before, during and after the training process in a synergic way that goes well beyond the "traditional" application of crowd workers to provide data labels for ML training.

Crowd Science for Hybrid AI Applications / Taran, Ekaterina; Malanina, Veronika; Casati, Fabio. - (2021), pp. 172-175. (Intervento presentato al convegno 15th IEEE International Conference on Service-Oriented System Engineering, SOSE 2021 tenutosi a Virtual, Oxford nel 23-26 August 2021) [10.1109/SOSE52839.2021.00027].

Crowd Science for Hybrid AI Applications

Casati, Fabio
2021-01-01

Abstract

Most AI applications are hybrid, that is, employ machines to make inferences but can fall back on humans when the algorithm is not confident enough. This is true for a wide class of applications ranging from self-driving cars to decision making and process automation in enterprise AI. In this WIP paper we present our vision and progress towards an AI and crowd service that trains, assess and refines ML systems intended to be used in hybrid context. We specifically focus on crowdsourcing as a mean to assist ML algorithm development, and on the different ways in which crowd and machine can interact before, during and after the training process in a synergic way that goes well beyond the "traditional" application of crowd workers to provide data labels for ML training.
2021
Proceedings - 15th IEEE International Conference on Service-Oriented System Engineering, SOSE 2021
10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
IEEE COMPUTER SOC
978-1-6654-3477-5
978-1-6654-3478-2
Taran, Ekaterina; Malanina, Veronika; Casati, Fabio
Crowd Science for Hybrid AI Applications / Taran, Ekaterina; Malanina, Veronika; Casati, Fabio. - (2021), pp. 172-175. (Intervento presentato al convegno 15th IEEE International Conference on Service-Oriented System Engineering, SOSE 2021 tenutosi a Virtual, Oxford nel 23-26 August 2021) [10.1109/SOSE52839.2021.00027].
File in questo prodotto:
File Dimensione Formato  
csience.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.52 MB
Formato Adobe PDF
1.52 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/397745
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact