In this paper we present the implementation of a WebGL Talking Head for iOS mobile devices (Apple iPhone and iPad). It works on standard MPEG-4 Facial Animation Parameters (FAPs) and speaks with the Italian version of FESTIVAL TTS. It is totally based on true real human data. The 3D kinematics information are used to create lips articulatory model and to drive directly the talking face, generating human facial movements. In the last year we developed the WebGL version of the avatar. WebGL, which is 3D graphic for the web, is currently supported in the major web browsers for desktop computers. No official support has been given for mobile device main platforms yet, although the Firefox beta version enables it on android phones. Starting from iOS 5 WebGL is enabled only for the advertisement library class (which is intended for placing ad-banners in applications). We have been able to use this feature to visualize and animate our WebGL talking head.

A 3D talking head for mobile devices based on unofficial iOS WebGL support

Alberto Benin;Piero Cosi
2012

Abstract

In this paper we present the implementation of a WebGL Talking Head for iOS mobile devices (Apple iPhone and iPad). It works on standard MPEG-4 Facial Animation Parameters (FAPs) and speaks with the Italian version of FESTIVAL TTS. It is totally based on true real human data. The 3D kinematics information are used to create lips articulatory model and to drive directly the talking face, generating human facial movements. In the last year we developed the WebGL version of the avatar. WebGL, which is 3D graphic for the web, is currently supported in the major web browsers for desktop computers. No official support has been given for mobile device main platforms yet, although the Firefox beta version enables it on android phones. Starting from iOS 5 WebGL is enabled only for the advertisement library class (which is intended for placing ad-banners in applications). We have been able to use this feature to visualize and animate our WebGL talking head.
2012
Istituto di Scienze e Tecnologie della Cognizione - ISTC
Istituto di Scienze e Tecnologie della Cognizione - ISTC
Inglese
SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques
Web3D '12 Proceedings of the 17th International Conference on 3D Web Technology
Web3D '12 Proceedings of the 17th International Conference on 3D Web Technology
117
120
190
978-1-4503-1432-9
http://dl.acm.org/citation.cfm?id=2338734
ACM, Association for computing machinery
New York
STATI UNITI D'AMERICA
Sì, ma tipo non specificato
August 04-05, 2012
Los Angeles, CA - USA
WebGL
3D
Mobile
Talking Head
iOs
Title: Web3D '12 The 17th International Symposium on Web3D Technology Los Angeles, CA, USA -- August 04 - 05, 2012 Pages 190 Sponsor SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques Publisher ACM New York, NY, USA ISBN 978-1-4503-1432-9 Conference Web3D3D technologies for the World Wide Web Published in: Proceeding of Web3D '12 Proceedings of the 17th International Conference on 3D Web Technology Pages 117-120 ACM New York, NY, USA ©2012 table of contents ISBN: 978-1-4503-1432-9 doi>10.1145/2338714.2338734
3
none
Alberto Benin; G. Riccardo Leone; Piero Cosi
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/181656
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact