The Acceptability and Complexity eval-uation task for Italian (AcCompl-it) wasaimed at developing and evaluating meth-ods to classify Italian sentences accordingto Acceptability and Complexity. It con-sists of two independent tasks asking par-ticipants to predict either the acceptabil-ity or the complexity rate (or both) of agiven set of sentences previously scoredby native speakers on a 1-to-7 points Lik-ert scale. In this paper, we introduce thedatasets distributed to the participants, wedescribe the different approaches of theparticipating systems and provide a firstanalysis of the obtained results.

AcCompl-it @ EVALITA2020: overview of the acceptability & complexity evaluation task for Italian / Brunato, Dominique; Chesi, Cristiano; Dell'Orletta, Felice; Montemagni, Simonetta; Venturi, Giulia; Zamparelli, Roberto. - ELETTRONICO. - (2020). (Intervento presentato al convegno EVALITA 2020 tenutosi a Online event nel 17th December-17 December 2020).

AcCompl-it @ EVALITA2020: overview of the acceptability & complexity evaluation task for Italian

Roberto Zamparelli
2020-01-01

Abstract

The Acceptability and Complexity eval-uation task for Italian (AcCompl-it) wasaimed at developing and evaluating meth-ods to classify Italian sentences accordingto Acceptability and Complexity. It con-sists of two independent tasks asking par-ticipants to predict either the acceptabil-ity or the complexity rate (or both) of agiven set of sentences previously scoredby native speakers on a 1-to-7 points Lik-ert scale. In this paper, we introduce thedatasets distributed to the participants, wedescribe the different approaches of theparticipating systems and provide a firstanalysis of the obtained results.
2020
Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020)
Germania
CEUR Workshop Proceedings (CEUR-WS.org)
Brunato, Dominique; Chesi, Cristiano; Dell'Orletta, Felice; Montemagni, Simonetta; Venturi, Giulia; Zamparelli, Roberto
AcCompl-it @ EVALITA2020: overview of the acceptability & complexity evaluation task for Italian / Brunato, Dominique; Chesi, Cristiano; Dell'Orletta, Felice; Montemagni, Simonetta; Venturi, Giulia; Zamparelli, Roberto. - ELETTRONICO. - (2020). (Intervento presentato al convegno EVALITA 2020 tenutosi a Online event nel 17th December-17 December 2020).
File in questo prodotto:
File Dimensione Formato  
paper163.pdf

accesso aperto

Descrizione: PDF
Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Creative commons
Dimensione 244.04 kB
Formato Adobe PDF
244.04 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/285471
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact