The Acceptability and Complexity evaluation task for Italian (AcCompl-it) was aimed at developing and evaluating methods to classify Italian sentences according to Acceptability and Complexity. It consists of two independent tasks asking participants to predict either the acceptability or the complexity rate (or both) of a given set of sentences previously scored by native speakers on a 1-to-7 points Likert scale. In this paper, we introduce the datasets distributed to the participants, we describe the different approaches of the participating systems and provide a first analysis of the obtained results.
AcCompl-it @ EVALITA2020: Overview of the acceptability & complexity evaluation task for Italian
Brunato D;Dell'Orletta F;Montemagni S;Venturi G;
2020
Abstract
The Acceptability and Complexity evaluation task for Italian (AcCompl-it) was aimed at developing and evaluating methods to classify Italian sentences according to Acceptability and Complexity. It consists of two independent tasks asking participants to predict either the acceptability or the complexity rate (or both) of a given set of sentences previously scored by native speakers on a 1-to-7 points Likert scale. In this paper, we introduce the datasets distributed to the participants, we describe the different approaches of the participating systems and provide a first analysis of the obtained results.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.anceserie | CEUR WORKSHOP PROCEEDINGS | - |
| dc.authority.anceserie | CEUR Workshop Proceedings | - |
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | - |
| dc.authority.people | Brunato D | it |
| dc.authority.people | Chesi C | it |
| dc.authority.people | Dell'Orletta F | it |
| dc.authority.people | Montemagni S | it |
| dc.authority.people | Venturi G | it |
| dc.authority.people | Zamparelli R | it |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.date.accessioned | 2024/02/21 04:06:58 | - |
| dc.date.available | 2024/02/21 04:06:58 | - |
| dc.date.issued | 2020 | - |
| dc.description.abstracteng | The Acceptability and Complexity evaluation task for Italian (AcCompl-it) was aimed at developing and evaluating methods to classify Italian sentences according to Acceptability and Complexity. It consists of two independent tasks asking participants to predict either the acceptability or the complexity rate (or both) of a given set of sentences previously scored by native speakers on a 1-to-7 points Likert scale. In this paper, we introduce the datasets distributed to the participants, we describe the different approaches of the participating systems and provide a first analysis of the obtained results. | - |
| dc.description.affiliations | ILC-CNR, Via G. Moruzzi 1, Pisa, ILC-CNR, Via G. Moruzzi 1, Pisa, Italy, , Italy; NETS-IUSS, P.zza Vittoria 15, Pavia, NETS-IUSS, P.zza Vittoria 15, Pavia, Italy, , Italy; CIMeC-UNITRENTO, Corso Bettini 31, Rovereto, CIMeC-UNITRENTO, Corso Bettini 31, Rovereto Italy, , Italy | - |
| dc.description.allpeople | Brunato, D; Chesi, C; Dell'Orletta, F; Montemagni, S; Venturi, G; Zamparelli, R | - |
| dc.description.allpeopleoriginal | Brunato D.; Chesi C.; Dell'Orletta F.; Montemagni S.; Venturi G.; Zamparelli R. | - |
| dc.description.fulltext | none | en |
| dc.description.numberofauthors | 6 | - |
| dc.identifier.scopus | 2-s2.0-85097543361 | - |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/423611 | - |
| dc.identifier.url | http://ceur-ws.org/Vol-2765/paper163.pdf | - |
| dc.language.iso | eng | - |
| dc.relation.conferencedate | 17/12/2020 | - |
| dc.relation.conferencename | EVALITA '20, Evaluation of NLP and Speech Tools for Italian | - |
| dc.relation.conferenceplace | Online | - |
| dc.relation.firstpage | 1 | - |
| dc.relation.lastpage | 8 | - |
| dc.relation.volume | 2765 | - |
| dc.subject.keywords | Shared Task | - |
| dc.subject.keywords | Linguistic Complexity | - |
| dc.subject.keywords | Acceptability | - |
| dc.subject.singlekeyword | Shared Task | * |
| dc.subject.singlekeyword | Linguistic Complexity | * |
| dc.subject.singlekeyword | Acceptability | * |
| dc.title | AcCompl-it @ EVALITA2020: Overview of the acceptability & complexity evaluation task for Italian | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| dc.type.referee | Sì, ma tipo non specificato | - |
| dc.ugov.descaux1 | 444114 | - |
| iris.orcid.lastModifiedDate | 2024/04/04 14:42:13 | * |
| iris.orcid.lastModifiedMillisecond | 1712234533596 | * |
| iris.scopus.extIssued | 2020 | - |
| iris.scopus.extTitle | AcCompl-it @ EVALITA2020: Overview of the acceptability & complexity evaluation task for Italian | - |
| iris.sitodocente.maxattempts | 1 | - |
| scopus.authority.anceserie | CEUR WORKSHOP PROCEEDINGS###1613-0073 | * |
| scopus.category | 1700 | * |
| scopus.contributor.affiliation | ILC-CNR | - |
| scopus.contributor.affiliation | NETS-IUSS | - |
| scopus.contributor.affiliation | ILC-CNR | - |
| scopus.contributor.affiliation | ILC-CNR | - |
| scopus.contributor.affiliation | ILC-CNR | - |
| scopus.contributor.affiliation | CIMeC-UNITRENTO | - |
| scopus.contributor.afid | 60021199 | - |
| scopus.contributor.afid | 60105475 | - |
| scopus.contributor.afid | 60021199 | - |
| scopus.contributor.afid | 60021199 | - |
| scopus.contributor.afid | 60021199 | - |
| scopus.contributor.afid | 110078739 | - |
| scopus.contributor.auid | 55237740200 | - |
| scopus.contributor.auid | 55570075100 | - |
| scopus.contributor.auid | 57540567000 | - |
| scopus.contributor.auid | 15056781100 | - |
| scopus.contributor.auid | 27568199800 | - |
| scopus.contributor.auid | 55817552867 | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.name | Dominique | - |
| scopus.contributor.name | Cristiano | - |
| scopus.contributor.name | Felice | - |
| scopus.contributor.name | Simonetta | - |
| scopus.contributor.name | Giulia | - |
| scopus.contributor.name | Roberto | - |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.surname | Brunato | - |
| scopus.contributor.surname | Chesi | - |
| scopus.contributor.surname | Dell'Orletta | - |
| scopus.contributor.surname | Montemagni | - |
| scopus.contributor.surname | Venturi | - |
| scopus.contributor.surname | Zamparelli | - |
| scopus.date.issued | 2020 | * |
| scopus.description.abstracteng | The Acceptability and Complexity evaluation task for Italian (AcCompl-it) was aimed at developing and evaluating methods to classify Italian sentences according to Acceptability and Complexity. It consists of two independent tasks asking participants to predict either the acceptability or the complexity rate (or both) of a given set of sentences previously scored by native speakers on a 1-to-7 points Likert scale. In this paper, we introduce the datasets distributed to the participants, we describe the different approaches of the participating systems and provide a first analysis of the obtained results. | * |
| scopus.description.allpeopleoriginal | Brunato D.; Chesi C.; Dell'Orletta F.; Montemagni S.; Venturi G.; Zamparelli R. | * |
| scopus.differences | scopus.relation.conferencename | * |
| scopus.differences | scopus.authority.anceserie | * |
| scopus.differences | scopus.publisher.name | * |
| scopus.differences | scopus.relation.conferencedate | * |
| scopus.document.type | cp | * |
| scopus.document.types | cp | * |
| scopus.identifier.pui | 633673224 | * |
| scopus.identifier.scopus | 2-s2.0-85097543361 | * |
| scopus.journal.sourceid | 21100218356 | * |
| scopus.language.iso | eng | * |
| scopus.publisher.name | CEUR-WS | * |
| scopus.relation.conferencedate | 2020 | * |
| scopus.relation.conferencename | 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop, EVALITA 2020 | * |
| scopus.relation.volume | 2765 | * |
| scopus.title | AcCompl-it @ EVALITA2020: Overview of the acceptability & complexity evaluation task for Italian | * |
| scopus.titleeng | AcCompl-it @ EVALITA2020: Overview of the acceptability & complexity evaluation task for Italian | * |
| Appare nelle tipologie: | 04.01 Contributo in Atti di convegno | |
File in questo prodotto:
Non ci sono file associati a questo prodotto.
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
