In this paper and demo we present a crowd and crowd+AI based system, called CrowdRev, supporting the screening phase of literature reviews and achieving the same quality as author classification at a fraction of the cost, and near-instantly. CrowdRev makes it easy for authors to leverage the crowd, and ensures that no money is wasted even in the face of difficult papers or criteria: if the system detects that the task is too hard for the crowd, it just gives up trying (for that paper, or for that criteria, or altogether), without wasting money and never compromising on quality.

CrowdRev: A platform for Crowd-based Screening of Literature Reviews / Jorge, Ramirez; Krivosheev, Evgeny; Marcos, Baez; Casati, Fabio; Benatallah, Boualem. - (2018). (Intervento presentato al convegno Collective Intelligence tenutosi a Zurich, Switzerland nel 7-8 July).

CrowdRev: A platform for Crowd-based Screening of Literature Reviews

Jorge Ramirez;Evgeny Krivosheev;Marcos Baez;Fabio Casati;
2018-01-01

Abstract

In this paper and demo we present a crowd and crowd+AI based system, called CrowdRev, supporting the screening phase of literature reviews and achieving the same quality as author classification at a fraction of the cost, and near-instantly. CrowdRev makes it easy for authors to leverage the crowd, and ensures that no money is wasted even in the face of difficult papers or criteria: if the system detects that the task is too hard for the crowd, it just gives up trying (for that paper, or for that criteria, or altogether), without wasting money and never compromising on quality.
2018
Proceedings of the ACM Collective Intelligence Conference
Zurich, Switzerland
ACM
CrowdRev: A platform for Crowd-based Screening of Literature Reviews / Jorge, Ramirez; Krivosheev, Evgeny; Marcos, Baez; Casati, Fabio; Benatallah, Boualem. - (2018). (Intervento presentato al convegno Collective Intelligence tenutosi a Zurich, Switzerland nel 7-8 July).
Jorge, Ramirez; Krivosheev, Evgeny; Marcos, Baez; Casati, Fabio; Benatallah, Boualem
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/295846
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact