Multimodal systems use integrated multiple interaction modalities (e.g. speech, sketch, handwriting, etc.) enabling users to benefit of a communication more similar to the human-human communication. To develop multimodal systems, several research questions have been addressed in the literature from the early 80s till the present day, such as multimodal fusion, recognition, dialogue interpretation and disambiguation, fission, context adaptation, etc. This paper investigates studies developed in the last decade, by analyzing the evolution of the approaches applied to face the main research questions related to multimodal fusion, interpretation, and context adaptation. As result, the paper provides a discussion on the reasons that led to shift attention from one methodology to another.

Multimodal Systems: An Excursus of the Main Research Questions

Maria Chiara Caschera;Arianna D'Ulizia;Fernando Ferri;Patrizia Grifoni
2015

Abstract

Multimodal systems use integrated multiple interaction modalities (e.g. speech, sketch, handwriting, etc.) enabling users to benefit of a communication more similar to the human-human communication. To develop multimodal systems, several research questions have been addressed in the literature from the early 80s till the present day, such as multimodal fusion, recognition, dialogue interpretation and disambiguation, fission, context adaptation, etc. This paper investigates studies developed in the last decade, by analyzing the evolution of the approaches applied to face the main research questions related to multimodal fusion, interpretation, and context adaptation. As result, the paper provides a discussion on the reasons that led to shift attention from one methodology to another.
2015
Istituto di Ricerche sulla Popolazione e le Politiche Sociali - IRPPS
978-3-319-26137-9
Multimodal systems · Multimodal fusion · Interpretation · Context adaptation
File in questo prodotto:
File Dimensione Formato  
prod_341735-doc_106889.pdf

solo utenti autorizzati

Descrizione: Multimodal Systems: An Excursus of the Main Research Questions
Tipologia: Versione Editoriale (PDF)
Dimensione 236.13 kB
Formato Adobe PDF
236.13 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/300322
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 4
social impact