In this paper and demo we present a crowd and crowd+AI based system, called CrowdRev, supporting the screening phase of literature reviews and achieving the same quality as author classification at a fraction of the cost, and near-instantly. CrowdRev makes it easy for authors to leverage the crowd, and ensures that no money is wasted even in the face of difficult papers or criteria: if the system detects that the task is too hard for the crowd, it just gives up trying (for that paper, or for that criteria, or altogether), without wasting money and never compromising on quality.
CrowdRev: A platform for Crowd-based Screening of Literature Reviews / Jorge, Ramirez; Krivosheev, Evgeny; Marcos, Baez; Casati, Fabio; Benatallah, Boualem. - (2018). (Intervento presentato al convegno Collective Intelligence tenutosi a Zurich, Switzerland nel 7-8 July).
CrowdRev: A platform for Crowd-based Screening of Literature Reviews
Jorge Ramirez;Evgeny Krivosheev;Marcos Baez;Fabio Casati;
2018-01-01
Abstract
In this paper and demo we present a crowd and crowd+AI based system, called CrowdRev, supporting the screening phase of literature reviews and achieving the same quality as author classification at a fraction of the cost, and near-instantly. CrowdRev makes it easy for authors to leverage the crowd, and ensures that no money is wasted even in the face of difficult papers or criteria: if the system detects that the task is too hard for the crowd, it just gives up trying (for that paper, or for that criteria, or altogether), without wasting money and never compromising on quality.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione
