Generating personalized anatomy-based 3D facial models from scanned data

• Autorzy: Zhang Y. , Sim T. , Tan C. L.
• Języki publikacji: EN

Abstrakty

EN

This paper presents a new method for reconstructing animatable, anatomy-based human facial models from scanned range data. Our method adapts a prototype model that is suitable for physically-based animation to the geometry of a specific person's face with minimal user intervention. The prototype model has a known topology and incorporates a multi-layer structure of the skin, muscles, and skull. Based on the series of measurements between a subset of anthropometric landmarks specified on the prototype model and the scanned surface, an automated global alignment adapts the size, position, and orientation of the prototype model to align it with the scanned surface. In the skin layer adaptation, The generic skin mesh is represented as a dynamic deformable model which is subjected to internal force stemming from the elastic properties of the surface and external forces generated by the scanned data points and features. We automatically deform the underlying muscle layer consisting of three types of muscle models. A set of automatically generated skull feature points is then transformed based on the deformed external skin and muscle layers. The new positions of these feature points are used to drive volume morphing applied to the skull template for skull fitting. With the adapted multi-layer anatomical structure, the reconstructed model not only resembles the shape of the individual's face but can also be animated instantly using the muscle and jaw parameters.

Słowa kluczowe

EN

face reconstruction; facial animation; anatomy-based model; multi-layer skin structure; multi-layer muscle structure; multi-layer skull structure; scanned data; deformable model

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2005
• Tom: Vol. 14, No. 1
• Strony: 3--28
• Opis fizyczny: Bibliogr. 42 poz., rys., tab.

Twórcy

autor

Zhang Y.

• Departament of Computer Science, School of Computing, National University of Singapore, Singapore 117543

autor

Sim T.

• Departament of Computer Science, School of Computing, National University of Singapore, Singapore 117543

autor

Tan C. L.

• Departament of Computer Science, School of Computing, National University of Singapore, Singapore 117543

Bibliografia

• [1] Parke F. I.: Computer generated animation of faces. Master’s thesis, University of Utah, Salt Lake City, 1972.
• [2] Ekman P., Friesen W. V.: Facial Action Coding System. Consulting Psychologists Press Inc., California, 1978.
• [3] Parke F. I.: Parameterized models for facial animation. IEEE Computer Graphics and Application, 2(9), November, 61-68, 1982.
• [4] Jollifel. T.: Principal Component Analysis. Springer Verlag, New York, 1968.
• [5] Press W. H., Fannery B. P., Teukolsky S. A ., Verrerling W. T.: Numerical Recipes: The Art of Scientific Computing. Cambridge University Press, Cambridge, UK, 1986.
• [6] Magnenat-Thalmann N., Thalmann D.: The direction of synthetic actors in the film Rendez-vous a Montreal. IEEE Computer Graphics and Application, 7(12), 9-19, 1987.
• [7] Powell M. J. D.: Radial basis functions for multivariate interpolation: A review. Mason J. C. Cox M. G. (E ds.): Algorithms for Approximation, Clarendon Press, Oxford, 1987.
• [8] Kurihara T. Arai K.: A transformation method for Modeling and animation of the human face from photographs. Proc. Computer Animation’91, Springer-Verlag Tokyo, 45-58, 1991.
• [9] LeBlanc A., Kalar P., Magnenat-Thalmann N., Thalmann D.: Sculpting with the ‘ball and mouse’ metaphor. Proc. Graphics Interface’91, 152-159, 1991.
• [10] Turk M., Pentland A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3(1), 71-86, 1991.
• [11] Waters K., Terzopoulus D.: Modeling and animating faces using scanned data. Journal of Visualization and Computer Animation, 2, 123-128, 1991.
• [12] Akimoto T., Suenaga Y., Wallace R. S.: Automatic creation of 3D facial models. IEEE Computer Graphics and Application, 13(5), 16-22, September, 1993.
• [13] Lee Y., Terzopoulis D., Waters K.: Constructing physics-based facial models of individuals. Proc. Graphics Interface’93, May , 1-8, 1993.
• [14] Farkas L. G.: Anthropometry of the Head and Face. 2nd ed. Raven Press, 1994.
• [15] Pentland A., Moghaddam B., Starner T.: View-based and modular eigenspaces for face recognition. Proc. CVPR’94, 84-91, 1994.
• [16] Lee Y., Terzopoulis D., Waters K.: Realistic Modeling for facial animation. Proc. SIGGRAPH’95, August, 55-62, 1995.
• [17] Fang S., Raghavan R., Richtsmeier J. T.: Volume morphing methods for landmark based 3D image deformation. Proc. SPIE Int. Symp. on Medical Imaging, February, 404-415, 1996.
• [18] Horace H. S. Ip, Lijun Yin : Constructing a 3D individualized head model from two orthogonal views. The Visual Computer, 12, 254-266, 1996.
• [19] Parke F. I. Waters K.: Computer Facial Animation. A K Peters, Wellesley, MA, 1996 .
• [20] Fua P.: From multiple stereo views to multiple 3D surfaces. Int. Journal of Computer Vision, 24(1), 19-35, 1997.
• [21] Proesmans M., Gool L. V.: Reading between the lines - a method for extracting dynamic 3D with texture. Proc. VRST’97, 95-102, 1997.
• [22] Ulgen F.: A step toward universal facial animation via volume morphing. Proc. 6th IEEE Iriterantional Workshop on Robot and Human Communication, 358-363, 1997.
• [23] Cignoni P., Rocchini C., Scopigno R.: Metro: measuring error on simplified surfaces. Computer Graphics Forum, 17(2), 167-174, 1998.
• [24] Cootes T. F., Edwards G. J., Taylor C. J.: Active appearance models. Burkhardt H., Neumann B. (Eds.) : European Conf. on Computer Vision, Springer, vol. 2, 484-498, 1998.
• [25] DeCarlo D., Metaxas D., Stone M.: An anthropometric face model using variational techniques. Proc. SIGGRAPH’98, July, 67-74, 1998.
• [26] Pighin F., Hecker J., Lischinski D., Szeliski R., Salesin D. H.: Synthesizing realistic facial expressions from photographs. Proc. SIGGRAPH’98, July, 75-84, 1998.
• [27] Blanz V., Vetter T.: A morphable model for the synthesis of 3D faces. Proc. SIGGRAPH’99, 187-194, August, 1999.
• [28] Cootes T. F., Taylor C. J.: Statistical models of appearance for Computer vision. Tech. Rep, 1999.
• [29] Fua P., Miccio C.: Animated heads from ordinary images: A least squares approach. Computer Vision and Image Understanding, 75(3), 247-259, 1999.
• [30] Lee W. S., Escher M., Sannier G., Magnenat-Thalmann N.: MPEG-4 compatible faces from orthogonal photos. Proc. Computer Animation’99, May, 186-194, 1999.
• [31] Lee W. S., Magnenat-Thalmann N.: Fast head modeling for animation. Journal Image and Vision Computing, 18(4), March, 355-364, 2000.
• [32] Marschner S., Guenter B., Raghupathy S.: Modeling and rendering for realistic facial animation. Proc. 11th EG Workshop on Rendering, 231-242, 2000.
• [33] Carr J. C., Beatson, R. K., Cherrie J. B., Mitchell T. J., Fright W. R., Mccallum B. C., Evans T. R.: Reconstruction and representation of 3d objects with radial basis functions. Proc. SIGGRAPH 2001, 67-76, August, 2001.
• [34] Goto T., Kshirsagar S., Magnenat-Thalmann N.: Automatic face cloning and animation. IEEE Signal Processing Magazine, 18(3), May, 17-25, 2001.
• [35] Kahler K., Haber J., Seidel H.-P.: Geometry-based muscle Modeling for facial animation. Proc. Graphics Interface 2001 pp. 37-46, 2001.
• [36] Liu Z., Zhang Z., Jacobs C., Cohen M.: Rapid modeling of animated faces from video. Journal of Visualization and Computer Animation, 12(4), September, 227-240, 2001.
• [37] Jeong W.-K ., Kahler K., Haber J., Seidel H. P.: Automatic generation of subdivision surface head models from point cloud data. Proc. Graphics Interface, 181-188, 2002.
• [38] Kahler K., Haber J., Yamauchi H., Seidel H. P.: Head shop: Generating animated head models with anatomical structure. Proc. ACM SIGGRAPH Symposium on Computer Animation, 55-64, 2002.
• [39] Zhang Y., Prakash E. C., Sung E.: Anatomy-based 3D facial Modeling for expression animation. MG& V, 11(1),53-76, 2002.
• [40] Blanz V., Basso C., Poggio T., Vetter T.: Reanimating faces in images and video. Proc. EUROGRAPHICS’2003, 641-650, September, 2003.
• [41] Minolta VIVID-900, http://www.minolta-3d.com/products/ ; 2003.
• [42] Polygon Editing Tool, http://www.minolta-3d.com/ ; 2003.