In this study, we investigate the capability of a Neural Language Model (NLM) to distinguish between coherent and incoherent text, where the latter has been artificially created to gradually undermine local coherence within text. While previous research on coherence assessment using NLMs has primarily focused on English, we extend our investigation to multiple languages. We employ a consistent evaluation framework to compare the performance of monolingual and multilingual models in both in-domain and out-domain settings. Additionally, we explore the model's performance in a cross-language scenario.
Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages
Dominique Brunato;Felice Dell'Orletta;Irene Dini;Andrea Amelio Ravelli
2023
Abstract
In this study, we investigate the capability of a Neural Language Model (NLM) to distinguish between coherent and incoherent text, where the latter has been artificially created to gradually undermine local coherence within text. While previous research on coherence assessment using NLMs has primarily focused on English, we extend our investigation to multiple languages. We employ a consistent evaluation framework to compare the performance of monolingual and multilingual models in both in-domain and out-domain settings. Additionally, we explore the model's performance in a cross-language scenario.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | en |
| dc.authority.people | Dominique Brunato | en |
| dc.authority.people | Felice Dell'Orletta | en |
| dc.authority.people | Irene Dini | en |
| dc.authority.people | Andrea Amelio Ravelli | en |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.contributor.area | Non assegn | * |
| dc.contributor.area | Non assegn | * |
| dc.date.accessioned | 2024/02/20 18:10:57 | - |
| dc.date.available | 2024/02/20 18:10:57 | - |
| dc.date.firstsubmission | 2025/01/27 12:42:06 | * |
| dc.date.issued | 2023 | - |
| dc.date.submission | 2025/01/27 12:42:06 | * |
| dc.description.abstracteng | In this study, we investigate the capability of a Neural Language Model (NLM) to distinguish between coherent and incoherent text, where the latter has been artificially created to gradually undermine local coherence within text. While previous research on coherence assessment using NLMs has primarily focused on English, we extend our investigation to multiple languages. We employ a consistent evaluation framework to compare the performance of monolingual and multilingual models in both in-domain and out-domain settings. Additionally, we explore the model's performance in a cross-language scenario. | - |
| dc.description.affiliations | Istituto di Linguistica Computazionale "Antonio Zampolli", Pisa; Istituto di Linguistica Computazionale "Antonio Zampolli", Pisa; Istituto di Linguistica Computazionale "Antonio Zampolli", Pisa/ University of Pisa; Istituto di Linguistica Computazionale ILC-CNR / University of Bologna | - |
| dc.description.allpeople | Brunato, Dominique; Dell'Orletta, Felice; Dini, Irene; Ravelli, ANDREA AMELIO | - |
| dc.description.allpeopleoriginal | Dominique Brunato; Felice Dell'Orletta; Irene Dini; Andrea Amelio Ravelli | en |
| dc.description.fulltext | open | en |
| dc.description.numberofauthors | 4 | - |
| dc.identifier.doi | 10.18653/v1/2023.findings-acl.680 | en |
| dc.identifier.isbn | 978-1-959429-62-3 | en |
| dc.identifier.scopus | 2-s2.0-85175469428 | - |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/455142 | - |
| dc.identifier.url | https://aclanthology.org/2023.findings-acl.680 | en |
| dc.language.iso | eng | en |
| dc.miur.last.status.update | 2026-05-12T13:58:09Z | * |
| dc.publisher.country | USA | en |
| dc.publisher.name | Association for Computational Linguistics | en |
| dc.publisher.place | Stroudsburg | en |
| dc.relation.conferencedate | 9-14/07/2023 | en |
| dc.relation.conferencename | 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023) | en |
| dc.relation.conferenceplace | Toronto, Canada | en |
| dc.relation.firstpage | 10690 | en |
| dc.relation.ispartofbook | Findings of the Association for Computational Linguistics: ACL 2023 | en |
| dc.relation.lastpage | 10700 | en |
| dc.relation.numberofpages | 11 | en |
| dc.subject.keywords | text coherence | - |
| dc.subject.keywords | neural language models | - |
| dc.subject.keywords | multilingual corpora | - |
| dc.subject.singlekeyword | text coherence | * |
| dc.subject.singlekeyword | neural language models | * |
| dc.subject.singlekeyword | multilingual corpora | * |
| dc.title | Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages | en |
| dc.type.circulation | Internazionale | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| dc.type.referee | Esperti anonimi | en |
| dc.ugov.descaux1 | 491078 | - |
| iris.mediafilter.data | 2025/04/12 03:05:42 | * |
| iris.orcid.lastModifiedDate | 2025/02/05 10:20:21 | * |
| iris.orcid.lastModifiedMillisecond | 1738747221770 | * |
| iris.scopus.extIssued | 2023 | - |
| iris.scopus.extTitle | Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages | - |
| iris.sitodocente.maxattempts | 1 | - |
| iris.unpaywall.bestoaversion | publishedVersion | * |
| iris.unpaywall.doi | 10.18653/v1/2023.findings-acl.680 | * |
| iris.unpaywall.isoa | true | * |
| iris.unpaywall.journalisindoaj | false | * |
| iris.unpaywall.landingpage | http://dx.doi.org/10.18653/v1/2023.findings-acl.680 | * |
| iris.unpaywall.license | cc-by | * |
| iris.unpaywall.metadataCallLastModified | 13/05/2026 04:15:24 | - |
| iris.unpaywall.metadataCallLastModifiedMillisecond | 1778638524653 | - |
| iris.unpaywall.oastatus | gold | * |
| iris.unpaywall.pdfurl | https://aclanthology.org/2023.findings-acl.680.pdf | * |
| scopus.authority.anceserie | PROCEEDINGS OF THE CONFERENCE - ASSOCIATION FOR COMPUTATIONAL LINGUISTICS. MEETING###0736-587X | * |
| scopus.category | 1203 | * |
| scopus.category | 3310 | * |
| scopus.category | 1706 | * |
| scopus.contributor.affiliation | Pisa ItaliaNLP Lab | - |
| scopus.contributor.affiliation | Pisa ItaliaNLP Lab | - |
| scopus.contributor.affiliation | University of Pisa | - |
| scopus.contributor.affiliation | University of Bologna | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 60028868 | - |
| scopus.contributor.afid | 60028218 | - |
| scopus.contributor.auid | 55237740200 | - |
| scopus.contributor.auid | 57540567000 | - |
| scopus.contributor.auid | 57374317200 | - |
| scopus.contributor.auid | 57192943134 | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.name | Dominique | - |
| scopus.contributor.name | Felice | - |
| scopus.contributor.name | Irene | - |
| scopus.contributor.name | Andrea Amelio | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale “Antonio Zampolli”; | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale “Antonio Zampolli”; | - |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.surname | Brunato | - |
| scopus.contributor.surname | Dell'Orletta | - |
| scopus.contributor.surname | Dini | - |
| scopus.contributor.surname | Ravelli | - |
| scopus.date.issued | 2023 | * |
| scopus.description.abstracteng | In this study, we investigate the capability of a Neural Language Model (NLM) to distinguish between coherent and incoherent text, where the latter has been artificially created to gradually undermine local coherence within text. While previous research on coherence assessment using NLMs has primarily focused on English, we extend our investigation to multiple languages. We employ a consistent evaluation framework to compare the performance of monolingual and multilingual models in both in-domain and out-domain settings. Additionally, we explore the model's performance in a cross-language scenario. | * |
| scopus.description.allpeopleoriginal | Brunato D.; Dell'Orletta F.; Dini I.; Ravelli A.A. | * |
| scopus.differences | scopus.authority.anceserie | * |
| scopus.differences | scopus.publisher.name | * |
| scopus.differences | scopus.relation.conferencedate | * |
| scopus.differences | scopus.description.allpeopleoriginal | * |
| scopus.differences | scopus.relation.conferencename | * |
| scopus.differences | scopus.identifier.isbn | * |
| scopus.differences | scopus.relation.conferenceplace | * |
| scopus.document.type | cp | * |
| scopus.document.types | cp | * |
| scopus.identifier.doi | 10.18653/v1/2023.findings-acl.680 | * |
| scopus.identifier.isbn | 9781959429623 | * |
| scopus.identifier.pui | 642632199 | * |
| scopus.identifier.scopus | 2-s2.0-85175469428 | * |
| scopus.journal.sourceid | 21101138302 | * |
| scopus.language.iso | eng | * |
| scopus.publisher.name | Association for Computational Linguistics (ACL) | * |
| scopus.relation.conferencedate | 2023 | * |
| scopus.relation.conferencename | Findings of the Association for Computational Linguistics, ACL 2023 | * |
| scopus.relation.conferenceplace | can | * |
| scopus.relation.firstpage | 10690 | * |
| scopus.relation.lastpage | 10700 | * |
| scopus.title | Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages | * |
| scopus.titleeng | Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages | * |
| Appare nelle tipologie: | 04.01 Contributo in Atti di convegno | |
File in questo prodotto:
| File | Dimensione | Formato | |
|---|---|---|---|
|
prod_491078-doc_204685.pdf
accesso aperto
Descrizione: Coherent or Not? Stressing a Neural Language Model for Discourse Coherence in Multiple Languages
Tipologia:
Versione Editoriale (PDF)
Licenza:
Creative commons
Dimensione
288.06 kB
Formato
Adobe PDF
|
288.06 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
