This PhD thesis explores gamification strategies concerning video games for crowdsourcing, in particular for linguistic annotation. First, a categorization of the current approaches is proposed. In doing so, a new framework is provided to analyse and understand different game design strategies and their impact on linguistic annotation tasks. Two artefacts are developed to test and validate the framework: Spacewords, a 2D space shooter game, and High School Superhero, a 3D role-playing game. In particular, research questions and hypotheses concerning so-called orthogonal mechanics are tested, which are defined by previous research as game mechanics that although being similar to those found in commercial games, can hinder the annotation process by adding a layer of challenge and unpredictability. The artefacts are employed for three tasks: synonymy, linguistic acceptability and abusive language annotation. It is found that some challenging game-like features slightly improves Precision measure in certain circumstances. Experiments also suggest that motivation to play may be improved by in-game resources or collectible elements. Finally, in High School Superhero a mismatch is observed between the judgements given by linguists and players. The approach adopted in this work is intended to pave the way to a more insightful use of gaming elements inspired by entertainment games in the context of games with a purpose for linguistic annotation.

Designing Video Games to Crowdsource Linguistic Annotations / Bonetti, Federico. - (2022 May 19), pp. 1-164. [10.15168/11572_342492]

Designing Video Games to Crowdsource Linguistic Annotations

Bonetti, Federico
2022-05-19

Abstract

This PhD thesis explores gamification strategies concerning video games for crowdsourcing, in particular for linguistic annotation. First, a categorization of the current approaches is proposed. In doing so, a new framework is provided to analyse and understand different game design strategies and their impact on linguistic annotation tasks. Two artefacts are developed to test and validate the framework: Spacewords, a 2D space shooter game, and High School Superhero, a 3D role-playing game. In particular, research questions and hypotheses concerning so-called orthogonal mechanics are tested, which are defined by previous research as game mechanics that although being similar to those found in commercial games, can hinder the annotation process by adding a layer of challenge and unpredictability. The artefacts are employed for three tasks: synonymy, linguistic acceptability and abusive language annotation. It is found that some challenging game-like features slightly improves Precision measure in certain circumstances. Experiments also suggest that motivation to play may be improved by in-game resources or collectible elements. Finally, in High School Superhero a mismatch is observed between the judgements given by linguists and players. The approach adopted in this work is intended to pave the way to a more insightful use of gaming elements inspired by entertainment games in the context of games with a purpose for linguistic annotation.
19-mag-2022
XXXIV
2020-2021
Psicologia e scienze cognitive (29/10/12-)
Cognitive Science
Zancanaro, Massimo
Tonelli, Sara
no
Inglese
Settore ING-INF/05 - Sistemi di Elaborazione delle Informazioni
Settore INF/01 - Informatica
File in questo prodotto:
File Dimensione Formato  
DesigningVideoGamesToCrowdsourceLinguisticAnnotation.pdf

accesso aperto

Tipologia: Tesi di dottorato (Doctoral Thesis)
Licenza: Creative commons
Dimensione 10.14 MB
Formato Adobe PDF
10.14 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/342492
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact