Anatomy-based 3D facial modeling for expression animation

• Autorzy: Zhang Y. , Prakash E. C. , Sung E.
• Języki publikacji: EN

Abstrakty

EN

In this paper we propose a new hierarchical 3D facia model that conforms to the human facial anatomy for realistic facial expression animation. The facial model has a hierarchical biomechanical structure, incorporationg a physically-based approximation to facial skin tissue, a set of anatomicallymotivated facial muscle actuators and underlying skull structure. The deformable skin model has multilayer structure to approximate different types of soft tissue. It takes into account the nonlinear stress-strain relationship of the skin and the fact that soft tissue is almost incompressible. Different kinds of muscle models have been developed to simulate the distribution of the muscle force on the skin due to muscle contraction. By the presence of the skull model, our facial model takes advantage of both more accurate facial deformation and the consideration of facial anatomy during the interactive definition of facial muscles. Under the muscular force, the deformation of the facial skin is evaluated by solving the governing dynamic equation numerically. To improve computational efficiency, we use a localized, semi-implicit integration method which allows a larger time step to be taken in the simulation while retaining stability. The dynamic facial animation algorithm runs at an interactive rate with flexible and realistic facial expressions to be generated.

Słowa kluczowe

EN

facial animation; anatomy-based facial model; hierarchical structure; mass-springdamper system; semi-implicit integration method

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2002
• Tom: Vol. 11, No. 1
• Strony: 53--76
• Opis fizyczny: Bibliogr. 38 poz.

Twórcy

autor

Zhang Y.

• School of Electrical and Electronic Engineering, Nanyang Technology University, Singapore 639798

autor

Prakash E. C.

• School of Computer Engineering Nanyang Technological University, Singapore 639798

autor

Sung E.

• School of Electrical and Electronic Engineering, Nanyang Technology University, Singapore 639798

Bibliografia

• [1] Parke F. I.: Computer generated animation of face. Master's thesis, University of Utah, Salt Lake City. 1972.
• [2] Ekman P., Friesen W. V.: Facial Action Coding System. Consulting Psychologists Press Inc., Palo Alto, California. 1978.
• [3] Platt S., Badler N.: Animating facial expressions. Proc. SIGGRAPH'81, 15, 245-252. 1981.
• [4] Parke F. I.: Parameterized models for facial animation. IEEE CG&A, 2(9), 61-68. 1982.
• [5] Magnenat-Thalmann N., Minh H., deAngelis M., Thalmann D.: Design, transformation and animation of human face. The Visual Computer, 5, 32-39. 1989.
• [6] Williams P. L., Warwick R., Dyson M. Bannister L. H.: Gray's Anatomy, 37th Edition. Churchill Livingstone, London. 1989.
• [7] Terzopoulus D., Waters K.: Physically-based facial modeling, analysis and animation. J. of Visualization and Computer Animation, 1, 73-80. 1990.
• [8] Williams L.: Performance-driven facial animation. Proc. SIGGRAPF'90, 24, 235-242. 1990.
• [9] DiPaola S.: Extending the range of facial types. Journal of Visualization and Computer Animation, 2(4), 129-131. 1991.
• [10] Patel M., Willis P.: FACES: the facial animation, construction and editing system. Eurographics'91, 33-45. 1991.
• [11] Kalra P., Mangili A., Magnenat-Thalmann N., Thalmann D.: Simulaiton of facial muscle actions based on rational free form deformatios. Proc. EUROGRAPHICS'92, 59-69. 1992.
• [12] Fung Y.: Biomechanics: Mechanical Properties of Living Tissues. SV, NY. 1993.
• [13] Terzopoulus D. Waters K.: Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. PAMI, 15(6), 569-579. 1993.
• [14] Chang Seek Choi, Kiyobaru, Hiroshi Harashima, and Tsuyoshi Takebe: Analysis and synthesis of facial image sequences in model-based image coding. IEEE Trans. on Circuits and Systems for Video Technology, 4, 257-275. 1994.
• [15] Lee Y., Terzopoulis D., Waters K.: Realistic modeling for facial animation. Proc. SIGRAPH'95, 29, 55-62. 1995.
• [16] National Library of Medicine. The Visible Human Project. http://www.nlm.nih.gov/research/visible/visible_human.html. 1995.
• [17] DeCarlo D., Metaxas D.: The integration of optical flow and deformable models with applications to human face shape and motion estimation. Proc. CVPR'96, 231-238. 1996.
• [18] Keeve E., Girod S., Pfeifle P., Girod B.: Anatomy-based facial tissue modelling using the finite element method. Proc. IEEE Visualization'96, 21-28. 1996.
• [19] Koch R., Gross M., Carls F., Buren D., Fankhauser G., Parish Y.: Simulating facial surgery using finite element models. Proc. SIGGRAPH'96, 30, 421-428. 1996.
• [20] Parke F. I., Waters K.: Computer Facial Animation. AK Peters, Wellesley, MA. 1996.
• [21] Eisert P., Chaudhuri S., Girod B.: Speech driven synthesis of talking head sequences. 3D ImageAnalysis and Synthesis, 51-56. 1997.
• [22] Baraff D., Witkin A.: Large steps in cloth simulation. Proc. SIGGRAPH'98, 32, 43-54. 1998.
• [23] DeCarlo D., Metaxas D., Stone M.: An anthropometric face model ussing variational techniques. Proc. SIGGRAPH'98, 32, 67-74. 1998.
• [24] Guenter B., Grimm C., Wood D., Malvar H., Pighin F.: Making faces. Proc. SIGGRAPH'98, 32, 55-66. 1998.
• [25] Koch R. M., Gross M. H., Bosshard A. A.: Emotion editing using finite elements. COMPTER GRAPHICS Forum, 17(3), 295-302. 1998.
• [26] Ostermann J.: Animation of synthetic faces in MPEG-4. Proc. Computer Animation'98, 49-55. 1998.
• [27] Pighin F. , Hecker J., Lischinski D., Szeliski R., Salesin D. H.: Synthesizing realistic facial expressions from photographs. Proc. SIGGRAPH'98, 32, 75-84. 1998.
• [28] Tao H., Huang T. S.: Facial animation and video tracking. CAPTECH'98, 242-253. 1998.
• [29] Van Gelder A.: Approximate simulation of elastic membranes by triangulated spring meshes.J. of Graphics Tools, 3(2), 21-41. 1998.
• [30] Jianlin Zhong: Flexible face animation using MPEG-4/SNHC parameter streams. Proc. ICIP'98, 924-928. 1998.
• [31] Blanz V., Vetter T.: A morphable model for the synthesis of 3D faces. Proc. SIGGRAPH'99, 33, 187-194. 1999.
• [32] Desbrun M., Schroder P., Barr A.: Interactive animation of structured deformable objects. Proc. of Graphics Interface'99. 1999.
• [33] Goto T., Escher M., Zanardi C., Magnenat-Thalmann N.: MPEG-4 based an imation with face feature tracking. Proc. Erographics Workshop on Computer Animation and Simulation'99, 89-9. 1999.
• [34] Wu Y., Kalra P., Moccozet L., Thalmann N. M.: Simulating wrinkles and skin aging. The Visual Computer, 15(4), 183-198. 1999.
• [35] Wu Y., Beylot P., Thalmann N. M.: Skin aging estimation by facial simulation. Proc. Computer Animation'99, 210-219. 1999.
• [36] ISO/IEC, Overview of the MPEG-4 standard. http://www.cselt.it/mpeg/standards/mpeg-4/mpeg-4.htm.2000.
• [37] Rien-Lin Hsu, Jain A. K.: Face modeling for recognition. Proc. ICIP'2001. 2001.
• [38] Ming-Shing Su, Ming-Tat Ko, Kuo-Yong Cheng: Feature-point-driven facial animation using a hypothetical face. Computer Graphics Forum, 20(4), 179-188. 2001.