2026-06-17T13:21:26Zhttps://iris.cnr.it/oai/request

oai:iris.cnr.it:20.500.14243/5704632026-03-04T01:27:48Zcom_20.500.14243_46com_20.500.14243_21col_20.500.14243_47ou_ou239

The Role of Eye-Tracking Data in Encoder-Based Models: an In-depth Linguistic Analysis Lucia Domenichelli Luca Dini Dominique Brunato Felice Dell'Orletta Domenichelli, Lucia Dini, Luca Brunato, Dominique Dell'Orletta, Felice Eye-tracking, Neural Attention, Multilingual models, Embedding space, Interpretability This paper falls within ongoing research aimed at enhancing the human interpretability of neural language models by incorporating physiological data. Specifically, we leverage eye-tracking data collected during reading to explore how such information can guide model behavior. We train a multilingual encoder model to predict eye-tracking features from the Multilingual Eye-tracking Corpus (MECO) and analyze the resulting shifts in model attention patterns, focusing on how attention redistributes across linguistically informed categories such as part of speech, word position, word length, and distance from the syntactic head after fine-tuning. Moreover, we test how this attention shift impacts the representation of the interested words in the embedding space. The study covers both Italian and English, enabling a cross-linguistic perspective on attention and representation shifts in multilingual encoders grounded in human reading behavior. 2025 info:eu-repo/semantics/conferenceObject https://hdl.handle.net/20.500.14243/570463 eng ispartofbook:Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), 24-26 September 2025, Cagliari, Italy. info:eu-repo/semantics/openAccess license:Creative commons license uri:http://creativecommons.org/licenses/by-nc-nd/4.0/