In this paper, we explore the possibility of building a model of subject arousal by exploiting the acquisition and the analysis of speech and electrodermal activity (EDA). Several issues have to be addressed to reach this goal as the estimation of the relationship between arousal and behavioral measures and the reliability of EDA signal during speech production. To accomplish this task, we will investigate the relation among EDA, speech activity and subject arousal, during isolated affective word pronunciation. Our results show that significant information on subject arousal can be obtained by analyzing EDA during the processing of out-of-context words with an emotional content in a reading aloud task. Based on a sample of eighteen Italian participants, we observed a significant relation between EDA features and self-reported arousal scores. Quantitative models relating EDA andspeech-derived features are proposed and discussed. We found that increasing values of tonic and phasic components of EDA signals correspond to increasing self-assessed arousal scores; Mel-frequency cepstral analysis of speech was also shown to carry relevant information about subject arousal, with a significant inverse relation to self-assessed scores. Our results suggest how the analysis of concurrent acquisition of EDA and speech featuresmay offer a valid approach for the prediction of subject arousal during speech production, as well as a method for validating self-assessment ratings themselves.
Towards a model of arousal change after affective word pronunciation based on electrodermal activity and speech analysis
Marzi CPrimo
;
2021
Abstract
In this paper, we explore the possibility of building a model of subject arousal by exploiting the acquisition and the analysis of speech and electrodermal activity (EDA). Several issues have to be addressed to reach this goal as the estimation of the relationship between arousal and behavioral measures and the reliability of EDA signal during speech production. To accomplish this task, we will investigate the relation among EDA, speech activity and subject arousal, during isolated affective word pronunciation. Our results show that significant information on subject arousal can be obtained by analyzing EDA during the processing of out-of-context words with an emotional content in a reading aloud task. Based on a sample of eighteen Italian participants, we observed a significant relation between EDA features and self-reported arousal scores. Quantitative models relating EDA andspeech-derived features are proposed and discussed. We found that increasing values of tonic and phasic components of EDA signals correspond to increasing self-assessed arousal scores; Mel-frequency cepstral analysis of speech was also shown to carry relevant information about subject arousal, with a significant inverse relation to self-assessed scores. Our results suggest how the analysis of concurrent acquisition of EDA and speech featuresmay offer a valid approach for the prediction of subject arousal during speech production, as well as a method for validating self-assessment ratings themselves.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.ancejournal | BIOMEDICAL SIGNAL PROCESSING AND CONTROL | en |
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | en |
| dc.authority.people | Marzi C | en |
| dc.authority.people | Greco A | en |
| dc.authority.people | Scilingo EP | en |
| dc.authority.people | Vanello N | en |
| dc.collection.id.s | b3f88f24-048a-4e43-8ab1-6697b90e068e | * |
| dc.collection.name | 01.01 Articolo in rivista | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.date.accessioned | 2024/02/19 08:34:19 | - |
| dc.date.available | 2024/02/19 08:34:19 | - |
| dc.date.firstsubmission | 2024/09/25 17:04:12 | * |
| dc.date.issued | 2021 | - |
| dc.date.submission | 2024/09/25 17:04:12 | * |
| dc.description.abstracteng | In this paper, we explore the possibility of building a model of subject arousal by exploiting the acquisition and the analysis of speech and electrodermal activity (EDA). Several issues have to be addressed to reach this goal as the estimation of the relationship between arousal and behavioral measures and the reliability of EDA signal during speech production. To accomplish this task, we will investigate the relation among EDA, speech activity and subject arousal, during isolated affective word pronunciation. Our results show that significant information on subject arousal can be obtained by analyzing EDA during the processing of out-of-context words with an emotional content in a reading aloud task. Based on a sample of eighteen Italian participants, we observed a significant relation between EDA features and self-reported arousal scores. Quantitative models relating EDA andspeech-derived features are proposed and discussed. We found that increasing values of tonic and phasic components of EDA signals correspond to increasing self-assessed arousal scores; Mel-frequency cepstral analysis of speech was also shown to carry relevant information about subject arousal, with a significant inverse relation to self-assessed scores. Our results suggest how the analysis of concurrent acquisition of EDA and speech featuresmay offer a valid approach for the prediction of subject arousal during speech production, as well as a method for validating self-assessment ratings themselves. | - |
| dc.description.affiliations | Istituto di Linguistica Computazionale, CNR; Dipartimento di Ingegneria dell'informazione, UNIPI; Centro di Ricerca "Piaggio" | - |
| dc.description.allpeople | Marzi, C; Greco, A; Scilingo, Ep; Vanello, N | - |
| dc.description.allpeopleoriginal | Marzi C., Greco A., Scilingo E.P., Vanello N. | en |
| dc.description.fulltext | open | en |
| dc.description.numberofauthors | 4 | - |
| dc.identifier.doi | 10.1016/j.bspc.2021.102517 | en |
| dc.identifier.scopus | 2-s2.0-85102004105 | en |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/424727 | - |
| dc.identifier.url | http://www.elsevier.com/locate/bspc | en |
| dc.language.iso | eng | en |
| dc.miur.last.status.update | 2024-09-25T15:04:19Z | * |
| dc.relation.firstpage | 1 | en |
| dc.relation.issue | 102517 | en |
| dc.relation.lastpage | 8 | en |
| dc.relation.medium | ELETTRONICO | en |
| dc.relation.numberofpages | 8 | en |
| dc.relation.volume | 67 | en |
| dc.subject.keywordseng | speech | - |
| dc.subject.keywordseng | electrodermal activity | - |
| dc.subject.keywordseng | statistical models | - |
| dc.subject.keywordseng | arousal | - |
| dc.subject.keywordseng | word pronunciation | - |
| dc.subject.singlekeyword | speech | * |
| dc.subject.singlekeyword | electrodermal activity | * |
| dc.subject.singlekeyword | statistical models | * |
| dc.subject.singlekeyword | arousal | * |
| dc.subject.singlekeyword | word pronunciation | * |
| dc.title | Towards a model of arousal change after affective word pronunciation based on electrodermal activity and speech analysis | en |
| dc.type.circulation | Internazionale | en |
| dc.type.driver | info:eu-repo/semantics/article | - |
| dc.type.full | 01 Contributo su Rivista::01.01 Articolo in rivista | it |
| dc.type.miur | 262 | - |
| dc.type.referee | Sì, ma tipo non specificato | en |
| dc.ugov.descaux1 | 447049 | - |
| iris.mediafilter.data | 2025/04/16 03:56:07 | * |
| iris.orcid.lastModifiedDate | 2024/12/06 16:24:07 | * |
| iris.orcid.lastModifiedMillisecond | 1733498647948 | * |
| iris.scopus.extIssued | 2021 | - |
| iris.scopus.extTitle | Towards a model of arousal change after affective word pronunciation based on electrodermal activity and speech analysis | - |
| iris.scopus.ideLinkStatusDate | 2024/09/25 15:51:29 | * |
| iris.scopus.ideLinkStatusMillisecond | 1727272289291 | * |
| iris.sitodocente.maxattempts | 1 | - |
| iris.unpaywall.bestoahost | repository | * |
| iris.unpaywall.bestoaversion | submittedVersion | * |
| iris.unpaywall.doi | 10.1016/j.bspc.2021.102517 | * |
| iris.unpaywall.hosttype | repository | * |
| iris.unpaywall.isoa | true | * |
| iris.unpaywall.journalisindoaj | false | * |
| iris.unpaywall.landingpage | https://hdl.handle.net/11568/1096167 | * |
| iris.unpaywall.license | other-oa | * |
| iris.unpaywall.metadataCallLastModified | 10/12/2025 03:56:21 | - |
| iris.unpaywall.metadataCallLastModifiedMillisecond | 1765335381671 | - |
| iris.unpaywall.oastatus | green | * |
| scopus.authority.ancejournal | BIOMEDICAL SIGNAL PROCESSING AND CONTROL###1746-8094 | * |
| scopus.category | 1711 | * |
| scopus.category | 2718 | * |
| scopus.contributor.affiliation | National Research Council of Italy | - |
| scopus.contributor.affiliation | University of Pisa | - |
| scopus.contributor.affiliation | University of Pisa | - |
| scopus.contributor.affiliation | University of Pisa | - |
| scopus.contributor.afid | 60021199 | - |
| scopus.contributor.afid | 60028868 | - |
| scopus.contributor.afid | 60028868 | - |
| scopus.contributor.afid | 60028868 | - |
| scopus.contributor.auid | 36621334800 | - |
| scopus.contributor.auid | 56854902700 | - |
| scopus.contributor.auid | 6601971636 | - |
| scopus.contributor.auid | 6505734003 | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.dptid | 104078586 | - |
| scopus.contributor.dptid | 117058300 | - |
| scopus.contributor.dptid | 117058300 | - |
| scopus.contributor.dptid | 117058300 | - |
| scopus.contributor.name | Claudia | - |
| scopus.contributor.name | Alberto | - |
| scopus.contributor.name | Enzo Pasquale | - |
| scopus.contributor.name | Nicola | - |
| scopus.contributor.subaffiliation | Institute for Computational Linguistics; | - |
| scopus.contributor.subaffiliation | Dipartimento di Ingegneria dell'Informazione and Research Center “E. Piaggio”; | - |
| scopus.contributor.subaffiliation | Dipartimento di Ingegneria dell'Informazione and Research Center “E. Piaggio”; | - |
| scopus.contributor.subaffiliation | Dipartimento di Ingegneria dell'Informazione and Research Center “E. Piaggio”; | - |
| scopus.contributor.surname | Marzi | - |
| scopus.contributor.surname | Greco | - |
| scopus.contributor.surname | Scilingo | - |
| scopus.contributor.surname | Vanello | - |
| scopus.date.issued | 2021 | * |
| scopus.description.abstracteng | In this paper, we explore the possibility of building a model of subject arousal by exploiting the acquisition and the analysis of speech and electrodermal activity (EDA). Several issues have to be addressed to reach this goal as the estimation of the relationship between arousal and behavioral measures and the reliability of EDA signal during speech production. To accomplish this task, we will investigate the relation among EDA, speech activity and subject arousal, during isolated affective word pronunciation. Our results show that significant information on subject arousal can be obtained by analyzing EDA during the processing of out-of-context words with an emotional content in a reading aloud task. Based on a sample of eighteen Italian participants, we observed a significant relation between EDA features and self-reported arousal scores. Quantitative models relating EDA- and speech-derived features are proposed and discussed. We found that increasing values of tonic and phasic components of EDA signals correspond to increasing self-assessed arousal scores; Mel-frequency cepstral analysis of speech was also shown to carry relevant information about subject arousal, with a significant inverse relation to self-assessed scores. Our results suggest how the analysis of concurrent acquisition of EDA and speech features may offer a valid approach for the prediction of subject arousal during speech production, as well as a method for validating self-assessment ratings themselves. | * |
| scopus.description.allpeopleoriginal | Marzi C.; Greco A.; Scilingo E.P.; Vanello N. | * |
| scopus.differences | scopus.subject.keywords | * |
| scopus.differences | scopus.description.allpeopleoriginal | * |
| scopus.differences | scopus.description.abstracteng | * |
| scopus.document.type | ar | * |
| scopus.document.types | ar | * |
| scopus.funding.funders | 501100003407 - Ministero dell’Istruzione, dell’Università e della Ricerca; | * |
| scopus.identifier.doi | 10.1016/j.bspc.2021.102517 | * |
| scopus.identifier.eissn | 1746-8108 | * |
| scopus.identifier.pui | 2011240603 | * |
| scopus.identifier.scopus | 2-s2.0-85102004105 | * |
| scopus.journal.sourceid | 4700152237 | * |
| scopus.language.iso | eng | * |
| scopus.publisher.name | Elsevier Ltd | * |
| scopus.relation.article | 102517 | * |
| scopus.relation.volume | 67 | * |
| scopus.subject.keywords | Arousal; Electrodermal activity; Speech; Statistical models; Word pronunciation; | * |
| scopus.title | Towards a model of arousal change after affective word pronunciation based on electrodermal activity and speech analysis | * |
| scopus.titleeng | Towards a model of arousal change after affective word pronunciation based on electrodermal activity and speech analysis | * |
| Appare nelle tipologie: | 01.01 Articolo in rivista | |
| File | Dimensione | Formato | |
|---|---|---|---|
|
prod_447049-doc_160992.pdf
Open Access dal 06/09/2022
Descrizione: MAVEBA_2021
Tipologia:
Versione Editoriale (PDF)
Licenza:
Altro tipo di licenza
Dimensione
888.38 kB
Formato
Adobe PDF
|
888.38 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


