Factors such as instructions, payment schemes, platform demographics, along with strategies for mapping studies into crowdsourcing environments, play an important role in the reproducibility of results. However, inferring these details from scientific articles is often a challenging endeavor, calling for the development of proper reporting guidelines. This paper makes the first steps towards this goal, by describing an initial taxonomy of relevant attributes for crowdsourcing experiments, and providing a glimpse into the state of reporting by analyzing a sample of CSCW papers.

DREC: Towards a datasheet for reporting experiments in crowdsourcing / Ramirez, Jorge; Baez, Marcos; Casati, Fabio; Cernuzzi, Luca; Benatallah, Boualem. - (2020), pp. 377-382. ((Intervento presentato al convegno 3rd ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2020 tenutosi a usa nel 2020 [10.1145/3406865.3418318].

DREC: Towards a datasheet for reporting experiments in crowdsourcing

Ramirez Jorge;Casati Fabio;
2020

Abstract

Factors such as instructions, payment schemes, platform demographics, along with strategies for mapping studies into crowdsourcing environments, play an important role in the reproducibility of results. However, inferring these details from scientific articles is often a challenging endeavor, calling for the development of proper reporting guidelines. This paper makes the first steps towards this goal, by describing an initial taxonomy of relevant attributes for crowdsourcing experiments, and providing a glimpse into the state of reporting by analyzing a sample of CSCW papers.
Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW
;2 Penn Plaza, Suite 701
Association for Computing Machinery
9781450380591
DREC: Towards a datasheet for reporting experiments in crowdsourcing / Ramirez, Jorge; Baez, Marcos; Casati, Fabio; Cernuzzi, Luca; Benatallah, Boualem. - (2020), pp. 377-382. ((Intervento presentato al convegno 3rd ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2020 tenutosi a usa nel 2020 [10.1145/3406865.3418318].
Ramirez, Jorge; Baez, Marcos; Casati, Fabio; Cernuzzi, Luca; Benatallah, Boualem
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11572/295853
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? ND
social impact