In this paper we present a new evaluation resource for Italian aimed at assessing the role of textual connectives in the comprehension of the meaning of a sentence. The resource is arranged in two sections (acceptability assessment and cloze test), each one corresponding to a distinct challenge task conceived to test how subtle modifications involving connectives in real usage sentences influence the perceived acceptability of the sentence by native speakers and Neural Language Models (NLMs). Although the main focus is the presentation of the dataset, we also provide some preliminary data comparing human judgments and NLMs performance in the two tasks.
On the role of textual connectives in sentence comprehension: A new dataset for Italian
Miaschi A;Brunato D
2021
Abstract
In this paper we present a new evaluation resource for Italian aimed at assessing the role of textual connectives in the comprehension of the meaning of a sentence. The resource is arranged in two sections (acceptability assessment and cloze test), each one corresponding to a distinct challenge task conceived to test how subtle modifications involving connectives in real usage sentences influence the perceived acceptability of the sentence by native speakers and Neural Language Models (NLMs). Although the main focus is the presentation of the dataset, we also provide some preliminary data comparing human judgments and NLMs performance in the two tasks.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.anceserie | CEUR WORKSHOP PROCEEDINGS | - |
| dc.authority.anceserie | CEUR Workshop Proceedings | - |
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | - |
| dc.authority.people | Albertin G | it |
| dc.authority.people | Miaschi A | it |
| dc.authority.people | Brunato D | it |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.date.accessioned | 2024/02/21 03:34:11 | - |
| dc.date.available | 2024/02/21 03:34:11 | - |
| dc.date.issued | 2021 | - |
| dc.description.abstracteng | In this paper we present a new evaluation resource for Italian aimed at assessing the role of textual connectives in the comprehension of the meaning of a sentence. The resource is arranged in two sections (acceptability assessment and cloze test), each one corresponding to a distinct challenge task conceived to test how subtle modifications involving connectives in real usage sentences influence the perceived acceptability of the sentence by native speakers and Neural Language Models (NLMs). Although the main focus is the presentation of the dataset, we also provide some preliminary data comparing human judgments and NLMs performance in the two tasks. | - |
| dc.description.affiliations | University of Padova, University of Padova, , Italy; Department of Computer Science, University of Pisa, Department of Computer Science, University of Pisa, , Italy; Istituto di Linguistica Computazionale Antonio Zampolli (ILC-CNR), ItaliaNLP Lab, Istituto di Linguistica Computazionale "Antonio Zampolli" (ILC-CNR) ItaliaNLP Lab, | - |
| dc.description.allpeople | Albertin G.; Miaschi A.; Brunato D. | - |
| dc.description.allpeopleoriginal | Albertin G.; Miaschi A.; Brunato D. | - |
| dc.description.fulltext | none | en |
| dc.description.numberofauthors | 2 | - |
| dc.identifier.scopus | 2-s2.0-85121216473 | - |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/440996 | - |
| dc.identifier.url | http://ceur-ws.org/Vol-3033/paper16.pdf | - |
| dc.language.iso | eng | - |
| dc.miur.last.status.update | 2024-12-20T09:04:42Z | * |
| dc.relation.conferencedate | 26-28/01/2022 | - |
| dc.relation.conferencename | 8th Italian Conference on Computational Linguistics (CLIC-it 2021) | - |
| dc.relation.conferenceplace | Milano | - |
| dc.relation.volume | 3033 | - |
| dc.subject.keywords | neural language models | - |
| dc.subject.keywords | textual connectives | - |
| dc.subject.keywords | sentence acceptability | - |
| dc.subject.singlekeyword | neural language models | * |
| dc.subject.singlekeyword | textual connectives | * |
| dc.subject.singlekeyword | sentence acceptability | * |
| dc.title | On the role of textual connectives in sentence comprehension: A new dataset for Italian | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| dc.ugov.descaux1 | 465394 | - |
| iris.orcid.lastModifiedDate | 2024/03/15 08:56:08 | * |
| iris.orcid.lastModifiedMillisecond | 1710489368032 | * |
| iris.scopus.extIssued | 2021 | - |
| iris.scopus.extTitle | On the role of textual connectives in sentence comprehension: A new dataset for Italian | - |
| iris.sitodocente.maxattempts | 1 | - |
| scopus.authority.anceserie | CEUR WORKSHOP PROCEEDINGS###1613-0073 | * |
| scopus.category | 1700 | * |
| scopus.contributor.affiliation | University of Padova | - |
| scopus.contributor.affiliation | ItaliaNLP Lab | - |
| scopus.contributor.affiliation | ItaliaNLP Lab | - |
| scopus.contributor.afid | 60000481 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.auid | 59156252500 | - |
| scopus.contributor.auid | 57211678681 | - |
| scopus.contributor.auid | 55237740200 | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | - | |
| scopus.contributor.country | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | 114087935 | - |
| scopus.contributor.dptid | 114087935 | - |
| scopus.contributor.name | Giorgia | - |
| scopus.contributor.name | Alessio | - |
| scopus.contributor.name | Dominique | - |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale Antonio Zampolli (ILC-CNR); | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale Antonio Zampolli (ILC-CNR); | - |
| scopus.contributor.surname | Albertin | - |
| scopus.contributor.surname | Miaschi | - |
| scopus.contributor.surname | Brunato | - |
| scopus.date.issued | 2021 | * |
| scopus.description.abstracteng | In this paper we present a new evaluation resource for Italian aimed at assessing the role of textual connectives in the comprehension of the meaning of a sentence. The resource is arranged in two sections (acceptability assessment and cloze test), each one corresponding to a distinct challenge task conceived to test how subtle modifications involving connectives in real usage sentences influence the perceived acceptability of the sentence by native speakers and Neural Language Models (NLMs). Although the main focus is the presentation of the dataset, we also provide some preliminary data comparing human judgments and NLMs performance in the two tasks. | * |
| scopus.description.allpeopleoriginal | Albertin G.; Miaschi A.; Brunato D. | * |
| scopus.differences | scopus.relation.conferencename | * |
| scopus.differences | scopus.authority.anceserie | * |
| scopus.differences | scopus.publisher.name | * |
| scopus.differences | scopus.relation.conferencedate | * |
| scopus.differences | scopus.relation.conferenceplace | * |
| scopus.document.type | cp | * |
| scopus.document.types | cp | * |
| scopus.identifier.pui | 636650854 | * |
| scopus.identifier.scopus | 2-s2.0-85121216473 | * |
| scopus.journal.sourceid | 21100218356 | * |
| scopus.language.iso | eng | * |
| scopus.publisher.name | CEUR-WS | * |
| scopus.relation.conferencedate | 2022 | * |
| scopus.relation.conferencename | 8th Italian Conference on Computational Linguistics, CLiC-it 2021 | * |
| scopus.relation.conferenceplace | Universita degli Studi di Milano-Bicocca, ita | * |
| scopus.relation.volume | 3033 | * |
| scopus.title | On the role of textual connectives in sentence comprehension: A new dataset for Italian | * |
| scopus.titleeng | On the role of textual connectives in sentence comprehension: A new dataset for Italian | * |
| Appare nelle tipologie: | 04.01 Contributo in Atti di convegno | |
File in questo prodotto:
Non ci sono file associati a questo prodotto.
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
