The availability of extended reality (XR) devices has widened their adoption, yet authoring interactive experiences remains complex for non-programmers. We introduce Tell-XR, an intelligent agent leveraging large language models (LLMs) to guide end-users in defining the interaction in XR settings using automations described as Event-Condition-Action (ECA) rules. Through a formative study, we identified the key conversation stages to define and refine automations, which informed the design of the system architecture. The evaluation study in two scenarios (a VR museum and an AR smart home) demonstrates the effectiveness of Tell-XR across different XR interaction settings.
Tell-XR: conversational end-user development of XR automations
Manca M.;Santoro C.;Simeoli L.;
2025
Abstract
The availability of extended reality (XR) devices has widened their adoption, yet authoring interactive experiences remains complex for non-programmers. We introduce Tell-XR, an intelligent agent leveraging large language models (LLMs) to guide end-users in defining the interaction in XR settings using automations described as Event-Condition-Action (ECA) rules. Through a formative study, we identified the key conversation stages to define and refine automations, which informed the design of the system architecture. The evaluation study in two scenarios (a VR museum and an AR smart home) demonstrates the effectiveness of Tell-XR across different XR interaction settings.| File | Dimensione | Formato | |
|---|---|---|---|
|
PrePrint_TellXR_interact25a-sub1058-i5.pdf
accesso aperto
Descrizione: Tell-XR: Conversational End-User Development of XR Automations
Tipologia:
Documento in Pre-print
Licenza:
Altro tipo di licenza
Dimensione
4.36 MB
Formato
Adobe PDF
|
4.36 MB | Adobe PDF | Visualizza/Apri |
|
PrePrint_TellXR_materiale_aggiuntivo.pdf
accesso aperto
Descrizione: Tell-XR: Conversational End-User Development of XR Automations
Tipologia:
Documento in Pre-print
Licenza:
Altro tipo di licenza
Dimensione
705.94 kB
Formato
Adobe PDF
|
705.94 kB | Adobe PDF | Visualizza/Apri |
|
PostPrint_TellXR_interact25a-sub1058-i5.pdf
embargo fino al 16/09/2026
Descrizione: Tell-XR: Conversational End-User Development of XR Automations
Tipologia:
Documento in Post-print
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
4.59 MB
Formato
Adobe PDF
|
4.59 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
|
Published-978-3-032-04999-5_35.pdf
solo utenti autorizzati
Descrizione: Tell-XR: Conversational End-User Development of XR Automations
Tipologia:
Versione Editoriale (PDF)
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
1.49 MB
Formato
Adobe PDF
|
1.49 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


