|
Title:
|
A WEBGL AVATAR WITH EMOTIONAL AUDIO VIDEO SYNTHESIS FOR MOBILE DEVICES |
|
Author(s):
|
G.Riccardo Leone, Piero Cosi |
|
ISBN:
|
978-972-8939-75-5 |
|
Editors:
|
Katherine Blashki |
|
Year:
|
2012 |
|
Edition:
|
Single |
|
Keywords:
|
Talking head, facial animation, mpeg4, affective computing, WebGL, iOS devices |
|
Type:
|
Short Paper |
|
First Page:
|
175 |
|
Last Page:
|
179 |
|
Language:
|
English |
|
Cover:
|
|
|
Full Contents:
|
click to dowload 
|
|
Paper Abstract:
|
In this work we present the reviewing of the activities focused on the development of the WebGL software version of LUCIA talking head, an open source facial animation framework developed at ISTC-CNR of Padua. LUCIA works on standard MPEG-4 Facial Animation Parameters and speaks with the Italian version of FESTIVAL TTS. LUCIA is totally based on true real human data collected by the use of ELITE, a fully automatic movement analyzer for 3D kinematics data acquisition. WebGL is the standard programming library to develop 3D computer graphics inside the web browsers. The overall system is a client-server application using the http protocol: we have a client( a browser or an app) and a web server. No software download and no plugin are required. All the software reside on the server and the visualization player is delivered inside the html pages that the client ask at the beginning of the connection. On the server side a software called AudioVideo Engine generates the phonemes and visemes information needed for the animation. The demo called Emotional Parrot show the ability to reproduce the same input in different emotional states. This is the first WebGL 3D talking head software running on iOS device ever. |
|
|
|
|
|
|
