In this study, we present a preliminary analysis of the relationship between the linguistic profile of a text and the voice properties of the reader aiming to improve the speech-based emotion recognition systems. To this aim, we recorded the speech signals from a group of 32 healthy volunteers reading aloud neutral and affective texts and used the BioVoice toolbox to compute some of the main speech features. The selected texts were analyzed to quantify their lexical, morpho-syntactic, and syntactic content. Correlation and Support Vector Regressor analyses between linguistic and speech features have shown a significant modulation of some voice acoustic properties performed by the linguistic structure of the text. Particularly, a significant effect was shown on some specific speech features often used for the assessment of human emotional state (e.g., F0). This suggests that the lexical, morpho-syntactic, and syntactic properties could play an important role in the emotional dynamics of a person.

Analyzing the Interaction between the Reader's Voice and the Linguistic Structure of the Text: a Preliminary Study

Brunato D;Dell'Orletta F;
2021

Abstract

In this study, we present a preliminary analysis of the relationship between the linguistic profile of a text and the voice properties of the reader aiming to improve the speech-based emotion recognition systems. To this aim, we recorded the speech signals from a group of 32 healthy volunteers reading aloud neutral and affective texts and used the BioVoice toolbox to compute some of the main speech features. The selected texts were analyzed to quantify their lexical, morpho-syntactic, and syntactic content. Correlation and Support Vector Regressor analyses between linguistic and speech features have shown a significant modulation of some voice acoustic properties performed by the linguistic structure of the text. Particularly, a significant effect was shown on some specific speech features often used for the assessment of human emotional state (e.g., F0). This suggests that the lexical, morpho-syntactic, and syntactic properties could play an important role in the emotional dynamics of a person.
Campo DC Valore Lingua
dc.authority.orgunit Istituto di linguistica computazionale "Antonio Zampolli" - ILC -
dc.authority.people Iavarone B it
dc.authority.people Morelli M S it
dc.authority.people Brunato D it
dc.authority.people Ghiasi S it
dc.authority.people Scilingo E P it
dc.authority.people Vanello N it
dc.authority.people Dell'Orletta F it
dc.authority.people Greco A it
dc.collection.id.s 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d *
dc.collection.name 04.01 Contributo in Atti di convegno *
dc.contributor.appartenenza Istituto di linguistica computazionale "Antonio Zampolli" - ILC *
dc.contributor.appartenenza.mi 918 *
dc.date.accessioned 2024/02/19 11:09:38 -
dc.date.available 2024/02/19 11:09:38 -
dc.date.issued 2021 -
dc.description.abstracteng In this study, we present a preliminary analysis of the relationship between the linguistic profile of a text and the voice properties of the reader aiming to improve the speech-based emotion recognition systems. To this aim, we recorded the speech signals from a group of 32 healthy volunteers reading aloud neutral and affective texts and used the BioVoice toolbox to compute some of the main speech features. The selected texts were analyzed to quantify their lexical, morpho-syntactic, and syntactic content. Correlation and Support Vector Regressor analyses between linguistic and speech features have shown a significant modulation of some voice acoustic properties performed by the linguistic structure of the text. Particularly, a significant effect was shown on some specific speech features often used for the assessment of human emotional state (e.g., F0). This suggests that the lexical, morpho-syntactic, and syntactic properties could play an important role in the emotional dynamics of a person. -
dc.description.affiliations Scuola Normale Superiore, Pisa, Italy; Istituto di Linguistica Computazionale "Antonio Zampolli", Pisa, Italy; Fondazione Toscana Gabriele Monasterio, Pisa, Italy; Dipartimento di Ingegneria dell'Informazione, Research Center "E. Piaggio", University of Pisa, Pisa, Italy -
dc.description.allpeople Iavarone B.; Morelli M. S.; Brunato D.; Ghiasi S.; Scilingo E. P.; Vanello N.; Dell'Orletta F.; Greco A. -
dc.description.allpeopleoriginal Iavarone B., Morelli M. S., Brunato D., Ghiasi S., Scilingo E. P., Vanello N., Dell'Orletta F., Greco A. -
dc.description.fulltext none en
dc.description.numberofauthors 2 -
dc.identifier.doi 10.36253/978-88-5518-449-6 -
dc.identifier.isbn 978-88-5518-448-9 -
dc.identifier.uri https://hdl.handle.net/20.500.14243/445809 -
dc.language.iso cpe -
dc.relation.conferencedate 14-16/12/2021 -
dc.relation.conferencename 12th INTERNATIONAL WORKSHOP "MODELS AND ANALYSIS OF VOCAL EMISSIONS FOR BIOMEDICAL APPLICATIONS" -
dc.relation.conferenceplace Firenze, Italia -
dc.relation.ispartofbook Proceedings of 12th INTERNATIONAL WORKSHOP "MODELS AND ANALYSIS OF VOCAL EMISSIONS FOR BIOMEDICAL APPLICATIONS" -
dc.subject.keywords Natural Language Processing -
dc.subject.keywords Speech analysis -
dc.subject.keywords linguistic profile -
dc.subject.singlekeyword Natural Language Processing *
dc.subject.singlekeyword Speech analysis *
dc.subject.singlekeyword linguistic profile *
dc.title Analyzing the Interaction between the Reader's Voice and the Linguistic Structure of the Text: a Preliminary Study en
dc.type.driver info:eu-repo/semantics/conferenceObject -
dc.type.full 04 Contributo in convegno::04.01 Contributo in Atti di convegno it
dc.type.miur 273 -
dc.type.referee Sì, ma tipo non specificato -
dc.ugov.descaux1 472155 -
iris.orcid.lastModifiedDate 2024/03/01 18:46:27 *
iris.orcid.lastModifiedMillisecond 1709315187309 *
iris.sitodocente.maxattempts 1 -
iris.unpaywall.bestoahost publisher *
iris.unpaywall.bestoaversion publishedVersion *
iris.unpaywall.doi 10.36253/978-88-5518-449-6 *
iris.unpaywall.hosttype publisher *
iris.unpaywall.isoa true *
iris.unpaywall.journalisindoaj false *
iris.unpaywall.landingpage https://doi.org/10.36253/978-88-5518-449-6 *
iris.unpaywall.license cc-by *
iris.unpaywall.metadataCallLastModified 23/12/2025 04:35:35 -
iris.unpaywall.metadataCallLastModifiedMillisecond 1766460936012 -
iris.unpaywall.oastatus hybrid *
Appare nelle tipologie: 04.01 Contributo in Atti di convegno
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/445809
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact