Automated accessibility evaluation systems increasingly leverage large language models (LLMs) to assess conformance with established standards like the Web Content Accessibility Guidelines (WCAG). However, a fundamental methodological tension exists between the probabilistic, generalization-based nature of LLM inference and the deterministic, precisely scoped requirements of normative accessibility standards. A trustworthy, transparent, and accountable accessibility validation framework must be grounded in three principles: normative anchoring of evaluation logic to official guideline definitions, deterministic and traceable execution of assessment checks, and the systematic production of verifiable evidential artifacts. To operationalize these principles, we propose a computationally lightweight first, hybrid methodological framework for accessibility validation. The framework enforces a logical structure indicating the use of AI components, including small language models (SLMs), small multimodal models (SMMs), vision models, graph representations, and web agents, when rule-based techniques are insufficient to reliably evaluate criteria requiring human-like judgment and contextual understanding. We demonstrate the utility of this methodology, highlighting how it ensures algorithmic transparency and auditability, through concrete case studies.

A hybrid light-AI-based framework for accessibility validation

Leonardi Nicola
;
Manca Marco;Paternò Fabio
2026

Abstract

Automated accessibility evaluation systems increasingly leverage large language models (LLMs) to assess conformance with established standards like the Web Content Accessibility Guidelines (WCAG). However, a fundamental methodological tension exists between the probabilistic, generalization-based nature of LLM inference and the deterministic, precisely scoped requirements of normative accessibility standards. A trustworthy, transparent, and accountable accessibility validation framework must be grounded in three principles: normative anchoring of evaluation logic to official guideline definitions, deterministic and traceable execution of assessment checks, and the systematic production of verifiable evidential artifacts. To operationalize these principles, we propose a computationally lightweight first, hybrid methodological framework for accessibility validation. The framework enforces a logical structure indicating the use of AI components, including small language models (SLMs), small multimodal models (SMMs), vision models, graph representations, and web agents, when rule-based techniques are insufficient to reliably evaluate criteria requiring human-like judgment and contextual understanding. We demonstrate the utility of this methodology, highlighting how it ensures algorithmic transparency and auditability, through concrete case studies.
2026
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
979-8-4007-2483-1
Accessibility, LLM, SLM, Web Agents
File in questo prodotto:
File Dimensione Formato  
GoodIT2026_published.pdf

accesso aperto

Descrizione: A Hybrid Light-AI-based Framework for Accessibility Validation
Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 723.81 kB
Formato Adobe PDF
723.81 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/603121
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact