Extending Visual Speech Synthesis for Polish with basic emotion model

• Autorzy: Bloch J.
• Języki publikacji: EN

Abstrakty

EN

Expressing emotions is a very important feature of Visual Speech Synthesis systems. In 1972 the first “basic emotions” list was introduced, by Paul Ekman. Since then few different classifications were published. Most famous “basic emotion” models are briefly described in this paper. In previous publication new Visual Speech Synthesis system for Polish was presented. The system was based on Xface toolkit and “Karol” face model. The aim of this paper is to add “basic emotion” model, according to Paul Ekman’s classification, into “Karol” face model. To achieve this goal new emotional keyframes were proposed. This new functionality of “Karol” face model, allows to generate talking human face animations, which express emotions. The subjective test of new functionality are also included in the paper. The results showed that more information about speakers emotions is read from human face expression than form human speech signal. People can more easily recognize speakers emotion when they see his face expression.

Słowa kluczowe

EN

Visual Speech Synthesis; emotion; Xface; Ekman

PL

wizualna synteza mowy; emocje; Xface; Ekman Paul

• Wydawca: Foundation for Young Scientists
• Czasopismo: Challenges of Modern Technology
• Rocznik: 2013
• Tom: Vol. 4, no. 2
• Strony: 19--22
• Opis fizyczny: Bibliogr. 9 poz., rys., fot.

Twórcy

autor

Bloch J.

• Division of Teletransmission Systems, Institute of Telecommunications, The Faculty of Electronics and Information Technology, Warsaw Universisty of Technology

Bibliografia

• [1] Artur Janicki, Jakub Bloch, Karol Taylor, Visual Speech Synthesis for Polish Using Keyframe Based Animation, ICSES 2010 Gliwice.
• [2] Singular Inversions Inc, FaceGen – 3D Human Faces, http://www.facegen.com.
• [3] I.S. Pandzic and R. Forchheimer, MPEG-4 Facial Animation: The Standard, Implementation and Applications, The Atrium, Southern Gate, Chichester, West SussexPO19 1UD, England: John Wiley & Sons Ltd, 2002.
• [4] K. Balci, Xface: MPEG-4 based open source toolkit for 3D facial animation, Proc. Advance Visual Interface 2004, pp. 399-402, 2004.
• [5] Robert Plutchik, The Nature of Emotion, American Scientist, volume 89 No 4, 2001.
• [6] Jeannette M. Haviland-Jones Michael Lewis, Psychologia emocji. Gdańsk, 2005.
• [7] Henryk Gasiul, Teorie emocji i motywacji. Warszawa, 2002.
• [8] Paul Ekman, Universals and Cultural Differences in Facial Expressions of Emotion, in Nebraska Symposium on Motivation, University of Nebraska Press, 1972.
• [9] Paul Ekman, Unmasking the Face, Englewood Cliff, New Jersey: PRENTICE-HALL INC., 1975.