Analyzing Multimodal Interaction

Human-to-human conversation remains such a significant part of our working activities because of its naturalness. Multimodal interaction systems combine visual information with voice, gestures, and other modalities to provide flexible and powerful dialogue approaches. The use of integrated multiple input modes enables users to benefit from the natural approach used in human communication. In this paper, after introducing some definitions and concepts related to multimodal environment, we describe the different approaches used in the multimodal interaction fields showing both theoretical research and multimodal systems implementation. In particular, we will address those approaches that use the new semantic technologies as well as the ones related to the Semantic Web fields.