CNR Institutional Research Information System

INTERFACE is a Matlab©.tool for simplifying and automating many of the operations needed for building a talking head. INTERFACE consists of set of processing tools, focusing on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer. The final aim of INTERFACE is that of building up the animation engine of LUCIA our emotive/expressive Italian talking head. LUCIA can be directly driven by an emotional XML tagged input text, thus realizing a true audio visual expressive synthesis. LUCIA's voice is based on an Italian version of FESTIVAL-MBROLA packages, modified for expressive synthesis by means of an appropriate APML/VSML tagged language. Moreover, by using INTERFACE, it is possible to copy a real human talking by recreating the correct WAV and FAP files needed for the animation by reproducing the movements of some markers positioned on his face and recorded by an optoelectronic device. In this work the latest improvements of INTERFACE will be described and few examples of their application to real cases will be illustrated.

Describing INTERFACE a Matlab Tool for Building Talking Heads

Cosi P;Tisato G
2008

Abstract

INTERFACE is a Matlab©.tool for simplifying and automating many of the operations needed for building a talking head. INTERFACE consists of set of processing tools, focusing on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer. The final aim of INTERFACE is that of building up the animation engine of LUCIA our emotive/expressive Italian talking head. LUCIA can be directly driven by an emotional XML tagged input text, thus realizing a true audio visual expressive synthesis. LUCIA's voice is based on an Italian version of FESTIVAL-MBROLA packages, modified for expressive synthesis by means of an appropriate APML/VSML tagged language. Moreover, by using INTERFACE, it is possible to copy a real human talking by recreating the correct WAV and FAP files needed for the animation by reproducing the movements of some markers positioned on his face and recorded by an optoelectronic device. In this work the latest improvements of INTERFACE will be described and few examples of their application to real cases will be illustrated.
2008
Istituto di Scienze e Tecnologie della Cognizione - ISTC
Istituto di Scienze e Tecnologie della Cognizione - ISTC
Inglese
Roland Gocke, Patric Lucey, Simon Lucey
Proceedings of International Conference on Auditory-Visual Speech Processing 2008
AVSP 2008 (ISCA Research and Tutorial Workshop on Auditory-Visual Speech Processing)
978-0-646-49503-3
http://www.isca-speech.org/archive_open/archive_papers/avsp08/av08_143.pdf
Causal Production Pty Ltd
Rundle Mall (PO Box 100)
AUSTRALIA
Sì, ma tipo non specificato
26-29 September 2008
Moreton Island, Australia
INTERFACE
Talking Head
Audio/Visual synthesis
Articulation
Emotions
Cosi P., Tisato G. Describing 'INTERFACE' a Matlab© Tool for Building Talking Heads CD Proceedings of AVSP 2008 ISCA Research and Tutorial Workshop on Auditory-Visual Speech Processing Moreton Island, Australia, 22-26 September 2008 143-146 ISBN Proceedings Book: 978-0-646-49503-3 ISBN Procedings CD ROM: 978-0-646-49504-0
2
none
Cosi, P; Tisato, G
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
04.01 Contributo in Atti di convegno
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/57878
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact