Background: Of late, the synergistic interaction of eye and hand movements in the exploration of a visual scene displayed on a computer touchscreen was shown to provide a congruent signature of the "attention maps" of subjects with autism spectrum disorders (ASD). A familiar context where this visual and tactile interaction is exploited is when children use the finger of their dominant hand to point the letters of written words as they are reading, particularly at early stages of their literacy development. In the present work, a dedicated app running on a common tablet is used to capture and analyse the finger-tracking behaviour of children with ASD while they are reading few episodes of a connected text on the tablet touchscreen. The reader's voice is also recorded through the tablet built-in microphone. The sliding movements of the finger across the tablet touchscreen are discretized into a series of densely distributed "touch events", which are then mapped onto the text lines in much the same way eye fixations are projected onto a sequence of words using an eye-tracker. Reading texts are linguistically annotated, to control for levels of reading difficulty, and finger-tracking times are associated with linguistic glosses.Objectives: Investigate patterns of finger-tracking as a potential non biological marker for identification of children with ASD .Methods: A preliminary analysis is offered of evidence of the finger-tracking behaviour of 20 Italian children with high functioning ASD, aged 7-11 years, while they are engaged in reading. A grade-matched control group of children with typical development was included. Patterns of finger-tracking are assessed in connection with three complementary aspects of reading behaviour: (1) word recognition, (2) pace of reading of multi-word intonation units, and (3) text comprehension, controlled by asking children a few multiple-choice questions on text content after each reading session.Results: Considerable variation in levels of reading ability was observed in the ASD sample, with a few children showing clear evidence of impaired reading comprehension. However, fluent readers with ASD exhibit the same correlation between accurate decoding (assessed by measuring per-word reading speed) and high levels of reading comprehension found in controls. Likewise, decoding rates were found to significantly increase with increasing grade levels, following the typical developmental pattern observed in controls. On a less local level of linguistic analysis, the reading pace of ASD readers fails to be modulated according to major syntactic structures, punctuation marks and direct speech turns, an effect concomitant with a flat prosodic intonation of oral reading.Conclusions: Preliminary findings confirm the heterogeneous nature of reading skills in children with ASD, showing that the use of a tablet screen as a tactile interface for visual perception analysis can offer a robust experimental protocol for large-scale, multimodal collection of naturalistic data for extensive assessment of readers with ASD.

Patterns of finger-tracking in Italian early readers with Autism Spectrum Disorder

Marzi C
Primo
;
Ferro M;Pirrelli V
Ultimo
2022

Abstract

Background: Of late, the synergistic interaction of eye and hand movements in the exploration of a visual scene displayed on a computer touchscreen was shown to provide a congruent signature of the "attention maps" of subjects with autism spectrum disorders (ASD). A familiar context where this visual and tactile interaction is exploited is when children use the finger of their dominant hand to point the letters of written words as they are reading, particularly at early stages of their literacy development. In the present work, a dedicated app running on a common tablet is used to capture and analyse the finger-tracking behaviour of children with ASD while they are reading few episodes of a connected text on the tablet touchscreen. The reader's voice is also recorded through the tablet built-in microphone. The sliding movements of the finger across the tablet touchscreen are discretized into a series of densely distributed "touch events", which are then mapped onto the text lines in much the same way eye fixations are projected onto a sequence of words using an eye-tracker. Reading texts are linguistically annotated, to control for levels of reading difficulty, and finger-tracking times are associated with linguistic glosses.Objectives: Investigate patterns of finger-tracking as a potential non biological marker for identification of children with ASD .Methods: A preliminary analysis is offered of evidence of the finger-tracking behaviour of 20 Italian children with high functioning ASD, aged 7-11 years, while they are engaged in reading. A grade-matched control group of children with typical development was included. Patterns of finger-tracking are assessed in connection with three complementary aspects of reading behaviour: (1) word recognition, (2) pace of reading of multi-word intonation units, and (3) text comprehension, controlled by asking children a few multiple-choice questions on text content after each reading session.Results: Considerable variation in levels of reading ability was observed in the ASD sample, with a few children showing clear evidence of impaired reading comprehension. However, fluent readers with ASD exhibit the same correlation between accurate decoding (assessed by measuring per-word reading speed) and high levels of reading comprehension found in controls. Likewise, decoding rates were found to significantly increase with increasing grade levels, following the typical developmental pattern observed in controls. On a less local level of linguistic analysis, the reading pace of ASD readers fails to be modulated according to major syntactic structures, punctuation marks and direct speech turns, an effect concomitant with a flat prosodic intonation of oral reading.Conclusions: Preliminary findings confirm the heterogeneous nature of reading skills in children with ASD, showing that the use of a tablet screen as a tactile interface for visual perception analysis can offer a robust experimental protocol for large-scale, multimodal collection of naturalistic data for extensive assessment of readers with ASD.
Campo DC Valore Lingua
dc.authority.orgunit Istituto di linguistica computazionale "Antonio Zampolli" - ILC en
dc.authority.people Marzi C en
dc.authority.people Narzisi A en
dc.authority.people Ferro M en
dc.authority.people Masi G en
dc.authority.people Milone A en
dc.authority.people Viglione V en
dc.authority.people Pelagatti S en
dc.authority.people Tomassini I en
dc.authority.people Pirrelli V en
dc.collection.id.s 69aaa6b3-f0f0-47c1-b9a1-040bae867ec3 *
dc.collection.name 04.02 Abstract in Atti di convegno *
dc.contributor.appartenenza Istituto di linguistica computazionale "Antonio Zampolli" - ILC *
dc.contributor.appartenenza.mi 918 *
dc.date.accessioned 2024/11/29 19:03:04 -
dc.date.available 2024/11/29 19:03:04 -
dc.date.firstsubmission 2024/09/26 19:05:08 *
dc.date.issued 2022 -
dc.date.submission 2024/09/26 19:05:08 *
dc.description.abstracteng Background: Of late, the synergistic interaction of eye and hand movements in the exploration of a visual scene displayed on a computer touchscreen was shown to provide a congruent signature of the "attention maps" of subjects with autism spectrum disorders (ASD). A familiar context where this visual and tactile interaction is exploited is when children use the finger of their dominant hand to point the letters of written words as they are reading, particularly at early stages of their literacy development. In the present work, a dedicated app running on a common tablet is used to capture and analyse the finger-tracking behaviour of children with ASD while they are reading few episodes of a connected text on the tablet touchscreen. The reader's voice is also recorded through the tablet built-in microphone. The sliding movements of the finger across the tablet touchscreen are discretized into a series of densely distributed "touch events", which are then mapped onto the text lines in much the same way eye fixations are projected onto a sequence of words using an eye-tracker. Reading texts are linguistically annotated, to control for levels of reading difficulty, and finger-tracking times are associated with linguistic glosses.Objectives: Investigate patterns of finger-tracking as a potential non biological marker for identification of children with ASD .Methods: A preliminary analysis is offered of evidence of the finger-tracking behaviour of 20 Italian children with high functioning ASD, aged 7-11 years, while they are engaged in reading. A grade-matched control group of children with typical development was included. Patterns of finger-tracking are assessed in connection with three complementary aspects of reading behaviour: (1) word recognition, (2) pace of reading of multi-word intonation units, and (3) text comprehension, controlled by asking children a few multiple-choice questions on text content after each reading session.Results: Considerable variation in levels of reading ability was observed in the ASD sample, with a few children showing clear evidence of impaired reading comprehension. However, fluent readers with ASD exhibit the same correlation between accurate decoding (assessed by measuring per-word reading speed) and high levels of reading comprehension found in controls. Likewise, decoding rates were found to significantly increase with increasing grade levels, following the typical developmental pattern observed in controls. On a less local level of linguistic analysis, the reading pace of ASD readers fails to be modulated according to major syntactic structures, punctuation marks and direct speech turns, an effect concomitant with a flat prosodic intonation of oral reading.Conclusions: Preliminary findings confirm the heterogeneous nature of reading skills in children with ASD, showing that the use of a tablet screen as a tactile interface for visual perception analysis can offer a robust experimental protocol for large-scale, multimodal collection of naturalistic data for extensive assessment of readers with ASD. -
dc.description.affiliations Istituto di Linguistica Computazionale, CNR; Fondazione Stella Maris; Università di Pisa en
dc.description.allpeople Marzi, C; Narzisi, A; Ferro, M; Masi, G; Milone, A; Viglione, V; Pelagatti, S; Tomassini, I; Pirrelli, V -
dc.description.allpeopleoriginal Marzi C., Narzisi A., Ferro M., Masi G., Milone A., Viglione V., Pelagatti S., Tomassini I., Pirrelli V. en
dc.description.fulltext open en
dc.description.numberofauthors 9 -
dc.identifier.uri https://hdl.handle.net/20.500.14243/413387 -
dc.identifier.url https://cdn.ymaws.com/www.autism-insar.org/resource/resmgr/files/insar_2022/2022_Abstract_Book.pdf en
dc.language.iso eng en
dc.relation.conferencedate 11-14/05/2022 en
dc.relation.conferencename INSAR en
dc.relation.conferenceplace Austin, Texas en
dc.relation.firstpage 192 en
dc.relation.ispartofbook 2022 annual meeting abstract book en
dc.relation.lastpage 192 en
dc.relation.medium ELETTRONICO en
dc.relation.numberofpages 1 en
dc.relation.volume 2022 en
dc.subject.keywordseng reading -
dc.subject.keywordseng autism -
dc.subject.keywordseng finger-tracking -
dc.subject.keywordseng developing readers -
dc.subject.keywordseng prediction-driven processing -
dc.subject.singlekeyword reading *
dc.subject.singlekeyword autism *
dc.subject.singlekeyword finger-tracking *
dc.subject.singlekeyword developing readers *
dc.subject.singlekeyword prediction-driven processing *
dc.title Patterns of finger-tracking in Italian early readers with Autism Spectrum Disorder en
dc.type.driver info:eu-repo/semantics/conferenceObject -
dc.type.full 04 Contributo in convegno::04.02 Abstract in Atti di convegno it
dc.type.invited contributo en
dc.type.miur 274 -
dc.type.referee Esperti anonimi en
dc.ugov.descaux1 471602 -
iris.mediafilter.data 2025/04/16 03:57:29 *
iris.orcid.lastModifiedDate 2024/12/06 16:19:39 *
iris.orcid.lastModifiedMillisecond 1733498379211 *
iris.sitodocente.maxattempts 1 -
Appare nelle tipologie: 04.02 Abstract in Atti di convegno
File in questo prodotto:
File Dimensione Formato  
prod_471602-doc_191636.pptx

accesso aperto

Descrizione: presentazione
Tipologia: Versione Editoriale (PDF)
Licenza: Altro tipo di licenza
Dimensione 952.27 kB
Formato Microsoft Powerpoint XML
952.27 kB Microsoft Powerpoint XML Visualizza/Apri
prod_471602-doc_191635_estratto.pdf

accesso aperto

Descrizione: estratto_book_of_abstract
Tipologia: Versione Editoriale (PDF)
Licenza: Altro tipo di licenza
Dimensione 806.41 kB
Formato Adobe PDF
806.41 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/413387
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact