This paper explores the relationship between Neural Language Model (NLM) perplexity and sentence readability. Starting from the evidence that NLMs implicitly acquire sophisticated linguistic knowledge from a huge amount of training data, our goal is to investigate whether perplexity is affected by linguistic features used to automatically assess sentence readability and if there is a correlation between the two metrics. Our findings suggest that this correlation is actually quite weak and the two metrics are affected by different linguistic phenomena.
Is Neural Language Model Perplexity Related to Readability?
Miaschi;Alessio;Alzetta;Chiara;Brunato;Dominique;Dell'Orletta;Felice;Venturi;Giulia
2020
Abstract
This paper explores the relationship between Neural Language Model (NLM) perplexity and sentence readability. Starting from the evidence that NLMs implicitly acquire sophisticated linguistic knowledge from a huge amount of training data, our goal is to investigate whether perplexity is affected by linguistic features used to automatically assess sentence readability and if there is a correlation between the two metrics. Our findings suggest that this correlation is actually quite weak and the two metrics are affected by different linguistic phenomena.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | en |
| dc.authority.people | Miaschi | en |
| dc.authority.people | Alessio | en |
| dc.authority.people | Alzetta | en |
| dc.authority.people | Chiara | en |
| dc.authority.people | Brunato | en |
| dc.authority.people | Dominique | en |
| dc.authority.people | Dell'Orletta | en |
| dc.authority.people | Felice | en |
| dc.authority.people | Venturi | en |
| dc.authority.people | Giulia | en |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.date.accessioned | 2024/02/21 06:03:26 | - |
| dc.date.available | 2024/02/21 06:03:26 | - |
| dc.date.firstsubmission | 2024/12/18 17:20:02 | * |
| dc.date.issued | 2020 | - |
| dc.date.submission | 2024/12/18 17:20:02 | * |
| dc.description.abstracteng | This paper explores the relationship between Neural Language Model (NLM) perplexity and sentence readability. Starting from the evidence that NLMs implicitly acquire sophisticated linguistic knowledge from a huge amount of training data, our goal is to investigate whether perplexity is affected by linguistic features used to automatically assess sentence readability and if there is a correlation between the two metrics. Our findings suggest that this correlation is actually quite weak and the two metrics are affected by different linguistic phenomena. | - |
| dc.description.affiliations | Università di Pisa; Università di Genova; Istituto di Linguistica Computazionale (ILC-CNR) | - |
| dc.description.allpeople | Miaschi, Alessio; Miaschi, Alessio; Alzetta, Chiara; Alzetta, Chiara; Brunato, DOMINIQUE PIERINA; Brunato, DOMINIQUE PIERINA; Dell'Orletta, Felice; Dell'Orletta, Felice; Venturi, Giulia; Venturi, Giulia | - |
| dc.description.allpeopleoriginal | Miaschi, Alessio and Alzetta, Chiara and Brunato, Dominique and Dell'Orletta, Felice and Venturi, Giulia | en |
| dc.description.fulltext | open | en |
| dc.description.numberofauthors | 10 | - |
| dc.identifier.isbn | 979-12-80136-28-2 | en |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/421767 | - |
| dc.identifier.url | http://ceur-ws.org/Vol-2769/paper_57.pdf | en |
| dc.language.iso | eng | en |
| dc.miur.last.status.update | 2024-12-19T15:42:07Z | * |
| dc.relation.conferencedate | 01-03/03/2021 | en |
| dc.relation.conferencename | Seventh Italian Conference on Computational Linguistics | en |
| dc.relation.ispartofbook | Proceedings of the Seventh Italian Conference on Computational Linguistics | en |
| dc.subject.keywords | nlp | - |
| dc.subject.keywords | neural language models | - |
| dc.subject.keywords | readability | - |
| dc.subject.singlekeyword | nlp | * |
| dc.subject.singlekeyword | neural language models | * |
| dc.subject.singlekeyword | readability | * |
| dc.title | Is Neural Language Model Perplexity Related to Readability? | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| dc.ugov.descaux1 | 442040 | - |
| iris.mediafilter.data | 2025/04/15 04:10:22 | * |
| iris.orcid.lastModifiedDate | 2024/12/19 16:45:04 | * |
| iris.orcid.lastModifiedMillisecond | 1734623104021 | * |
| iris.scopus.extIssued | 2020 | - |
| iris.scopus.extTitle | Is neural language model perplexity related to readability? | - |
| iris.sitodocente.maxattempts | 1 | - |
| Appare nelle tipologie: | 04.01 Contributo in Atti di convegno | |
File in questo prodotto:
| File | Dimensione | Formato | |
|---|---|---|---|
|
paper_57.pdf
accesso aperto
Licenza:
Creative commons
Dimensione
308.13 kB
Formato
Adobe PDF
|
308.13 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
