Task execution timeliness, i.e., the completion of a task within a given time frame, is a known open issue in crowdsourcing. While running tasks on crowdsourcing platforms a requester experiences long tails in execution caused by abandoned assignments (those left by workers unfinished), which become available for other workers only after some expiration time (e.g., 30 minutes in CrowdFlower). These abandoned assignments result in significant delays and a poor predictability of the overall task execution time. In this paper, we propose an approach and an implementation called ReLauncher to identify such abandoned assignments and relaunch them for other workers. We evaluate our implementation with an experiment on CrowdFlower that provides substantive evidence for a significant execution speed improvement with an average extra cost of about 10%.
ReLauncher: Crowdsourcing Micro-Tasks runtime controller / Kucherbaev, Pavel; Daniel, Florian; Tranquillini, Stefano; Marchese, Maurizio. - STAMPA. - (2016), pp. 1609-1614. ((Intervento presentato al convegno CSCW 2016 tenutosi a San Francisco, CA nel 27th February - 2nd March 2016 [10.1145/2818048.2820005].
Titolo: | ReLauncher: Crowdsourcing Micro-Tasks runtime controller | |
Autori: | Kucherbaev, Pavel; Daniel, Florian; Tranquillini, Stefano; Marchese, Maurizio | |
Autori Unitn: | ||
Titolo del volume contenente il saggio: | CSCW '16: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work and Social Computing | |
Luogo di edizione: | New York | |
Casa editrice: | Association for Computing Machinery | |
Anno di pubblicazione: | 2016 | |
Codice identificativo Scopus: | 2-s2.0-84963623512 | |
Codice identificativo WOS: | WOS:000389809500128 | |
ISBN: | 9781450335928 | |
Handle: | http://hdl.handle.net/11572/159753 | |
Citazione: | ReLauncher: Crowdsourcing Micro-Tasks runtime controller / Kucherbaev, Pavel; Daniel, Florian; Tranquillini, Stefano; Marchese, Maurizio. - STAMPA. - (2016), pp. 1609-1614. ((Intervento presentato al convegno CSCW 2016 tenutosi a San Francisco, CA nel 27th February - 2nd March 2016 [10.1145/2818048.2820005]. | |
Appare nelle tipologie: | 04.1 Saggio in atti di convegno (Paper in Proceedings) |
File in questo prodotto:
File | Descrizione | Tipologia | Licenza | |
---|---|---|---|---|
Relauncher.pdf | Articolo principale | Versione editoriale (Publisher’s layout) | Tutti i diritti riservati (All rights reserved) | Administrator |