EDFCES: A new example-driven 3D face construction and editing system

Zhang, Y.; Sung, E.

Artykuł - szczegóły

Tytuł artykułu

EDFCES: A new example-driven 3D face construction and editing system

Autorzy

Zhang Y. , Sung E.

Wybrane pełne teksty z tego czasopisma

https://mgv.sggw.edu.pl/

Identyfikatory

Warianty tytułu

Języki publikacji

Abstrakty

This paper presents an automatic runtime system for generating varied, realistic face models by synthesizing a global face shape and local facial features according to intuitive, high-level control parameters. Our method takes as examples 3D face scans in order to exploit the parameter-to-geometry correlations present in real faces. In order to establish the correspondences among the scanned models, we use a three-step model fitting approach to conform a generic head mesh onto each scanned model. We transform the obtained data sets of global face shapes and local feature shapes into vector space representations by applying a principal component analysis (PCA). We compute a set of face anthropometric measurements to parameterize the exemplary shapes in the measurement spaces. Using PCA coefficients as a compact shape representation, we approach the shape synthesis problem by forming scattered data interpolation functions designed to generate the desired face shape by taking anthropometric parameters as input. At runtime, the interpolation functions are evaluated for the input parameter values to produce new face geometries at an interactive rate. The correspondence among all exemplary face textures is obtained by parameterizing the 3D generic mesh over a 2D image domain. The new feature texture with the desired attributes is synthesized by interpolating the example textures. The resulting system is intuitive to control and fine-grained. We demonstrate our method by applying different parameters to generate a wide range of face models.

Słowa kluczowe

face modeling facial features anthropometry interpolation PCA model fitting 3D scanned data

Wydawca

Institute of Information Technology of the Warsaw University of Life Sciences – SGGW

Czasopismo

Machine Graphics and Vision

Rocznik

2008

Tom

Vol. 17, No. 3

Strony

313--346

Opis fizyczny

Bibliogr. 55 poz., rys., tab., wykr.

Twórcy

autor

Zhang Y.

autor

Sung E.

Department of Computer and Information Science, University of Pennsylvania, PA 19104-6389, USA

Bibliografia

[1] Gillenson M. L., Chandrasekaran B.: A heuristic strategy for developing human facial images on a CRT. Pattern Recognition, 7(4): 187-196, 1975.
[2] Parke F. I.: Parameterized models for facial animation. IEEE Computer Graphics and Application, 2(9): 61-68, November, 1982.
[3] Burt P. J., Adelson E. H. multiresolution spline with application to image mosaics. ACM Transactions on Graphics, 2(4): 217-236, October, 1983.
[4] Jollife I. T.: Principal component analysis. Springer Verlag, New York, 1986.
[5] Young A., Hay D.: Configurational information in face perception. Experimental Psychology Society, 1986.
[6] Farkas L. G.: Anthropometric facial proportions in medicine, Thomas Books, 1989.
[7] Lewis J. P.: Algorithms for solid noise synthesis. Proc. SIGGRAPH’89, pp. 263-270, 1989.
[8] Magnenat-Thalmann N., Minh H., deAngelis M., Thalmann D.: Design, transformation and animation of human faces. The Visual Computer, 5:32-39, 1989.
[9] DiPaola S.: Extending the range of facial types. Journal of Visualization and Computer Animation, 2(4): 129-131, 1991.
[10] Patel M., Willis P.: FACES: the facial animation, construction and editing system. Eurographics’91, pp. 33-45, 1991.
[11] Akimoto T., Suenaga Y., Wallace R. S.: Automatic creation of 3D facial models. IEEE Computer Graphics and Application, 13(5):16-22, September, 1993.
[12] Wu J. K., Ang Y. H., Lam . C., Moorthy S. K., Narasimhalu A. D.: Facial image retrieval, identification, and inference system. Proc. 1st ACM International Conference on Multimedia, pp. 47-55, 1993.
[13] Farkas L. G.: Anthropometry of the head and face, Raven Press, 1994.
[14] Cootes T. F., Taylor C. J., Cooper D. H., Graham J.: Active shape models: Their training and applications. Computer Vision and Image Understanding, 61(1):38-59, 1995.
[15] Lee Y., Terzopoulos D., Waters K.: Realistic modeling for facial animation. Proc. SIGGRAPH’95, pp. 55-62, August, 1995.
[16] Brunelli R., Mich O.: SpotIt! an interactive identikit system. Graphical Models and Image Processing, 58(5): 399-404,1996.
[17] Parke F. I., Waters K.: Computer Facial Animation. AK Peters, Wellesley, MA, 1996.
[18] Baker E., Seltzer M.: The mug-shot search problem. Proc. Vision Interface’98, pp. 65-67, 1998
[19] DeCarlo D., Metaxas D., Stone M.: An anthropometric face model using variational techniques. Proc. SIGGRAPH’98, pp. 67-74, July, 1998.
[20] Ostermann I., Chen L. S., Huang T.S.: Animated talking head with personalized 3D head model. Journal of VLSI SIGNAL PROCESIN SYSTEMS for Signal, Image, and Video Technology, 20:99-107, 1998.
[21] Pighin F., Hecker J., Lischinski D., Szeliski R., Salesin D. H. : Synthesizing realistic facial expressions from photographs. Proc. SIGGRAPH’98, pp. 75-84, July, 1998.
[22] Rose C., Cohen M., Bodenheimer B.: Verbs and adverbs: Multidimensional motion interpolation using RHF. IEEE Computer Graphics and Application, 18(5): 32-40, 1998.
[23] Blanz V., Vetter T.: A morphable model for the synthesis of 3D faces. Proc. SIGGRAPH’99, pp. 187-194, August, 1999.
[24] Enciso R., Li J., Fidaleo D., Kim T-Y., Noh J-Y., Neumann U.: Synthesis of 3D faces. International Workshop on Digital and Computational Video, December, 1999.
[25] Fua P., Miccio C.: Animated heads from ordinary images: A least-squares approach. Computer Vision and Image Understanding, 75(3): 47-259, 1999.
[26] Noh J. Y., Neumann U.: A survey of facial modeling and animation techniques. USC Technical Report 99-705, USC. Los Angeles, CA, 1999.
[27] Deffenbacher K. A.,. Johanson J., Vetter T., O’toole A. J.: The face typicality-recognizability relationship: encoding or retrieval locus? Memory and Cognition. 28(7): 1173-1182, 2000.
[28] Guskov I., Vidimce K., Sweldens W., Schrbder P.: Normal meshes. Proc. SIGGRAPH’00, pp. 95-102, 2000.
[29] Lee W. S., Magnenat-Thalmann N.: Fast head modeling for animation. Journal Image and Vision Computing, 1861): 355-364, March, 2000.
[30] Lewis J., Cordner M., Fong N.: Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. Proc. SIGGRAPH'00, pp. 165-172, July, 2000.
[31] Carr J. C., Beatson R. K., Cherrie J. B., Mitchell T. J., Fright W. R., Mccallum B. C., Evans T. R.: Reconstruction and representation of 3d objects with radial basis functions. Proc. SIGGRAPH 2001, pp. 67-76, August.
[32] Kähler K., Haber J., Seidel H.- P.: Geometry-based muscle modeling for facial animation. Proc.Graphics Interface”01, pp. 37-46, June, 2001.
[33] Liu Z., Zhang Z., Jacobs C., Cohen M.: Rapid modeling of animated faces from video. Journal of Visualization and Computer Animation, 12(4): 227-240, September, 2001.
[34] Sloan P.-P., Rose C. F., Cohen M. F.: Shape by example. Proc. ACM SIGGRAPH Symp. on Interactive 3D Graphics, pp. 135-143, 2001.
[35] Allen B., Curless B., Popovic Z.: Articulated body deformation from range scan data. Proc. SIGGRAPH’02, pp. 612-619, 2002.
[36] Kähler K., Haber J., Yamauchi H., Seidel H.-P.: Head shop: Generating animated head models with anatomical structure. Proc. ACM SIGGRAPH Symp. on Comput. Anim., pp. 55-64, 2002.
[37] Kuo C., Huang R., Lin T.: 3-D facial model estimation from single front-view facial image. IEEE Trans. on Circuits and Systems for Video Technology, 12(3): 183-192, March, 2002.
[38] Allen B., Curless B., Popovic Z.: The space of human body shapes: Reconstruction and parameterization from range scans. Proc. SIGGRAPH’03, pp. 587-594, 2003.
[39] Pérez P., Gangnet M., Blake A.: Poisson image editing. Proc. SIGGRAPH'03, pp. 313-318, 2003.
[40] Pyun H., Kim Y., Chae W., Kang H. W., Shin S. Y.: An example-based approach for facial expression cloning. Proc. ACM SIGGRAPH/Eurographics Symp. on Comput. Anim., pp. 167-176, 2003.
[41] Seo H., Magnenat-Thalmann N.: Automatic modeling of human bodies from sizing parameters. Proc. ACM SIGGRAPH Symp. on Interactive 3D Graphics, pp. 19-26, 2003.
[42] Chen T.-P. G., Fels S.: Exploring gradient-based face navigation interfaces. Proc. Graphics lnterface. Pp, 65-72, 2004.
[43] Levin A., Zomet A., Peleg S., Weiss Y.: Seamless image stitching in the gradient domain. Proc. European Conference on Computer Vision'04, pp. 377-389, May, 2004.
[44] Park I. K., Zhang H., Vezhnevets V., Choh H. K.: Image-based photorealistic 3D face modeling. Proc. IEEE Automatic Face and Gesture Recognition, pp. 49-54, 2004.
[45] Blanz V., Albrecht I., Haber J., Seidel H.-P.: Creating face models from vague mental images. Proc. Sketches and Applications of ACM SIGGRAPIT05, July, 2005.
[46] Vlasic D., Brand M., Pfister H., Popovic J.: Face transfer with multilinear models. Proc. SIGGRAPH'05, pp. 426-433, August.
[47] Golovinsky A., Matusik W., Pfister H., Rusinkiewicz S., Funkhouser T.: A statistical model for synthesis of detailed facial geometry. Proc. SIGGRAPH’06, pp. 1025-1O34, August, 2006.
[48] Zhang Y.: An efficient texture generation technique for human head cloning and morphing. Proc. International Conference on Computer Graphics Theory and Applications, pp. 85-92, February, 2006.
[49] Autodesk Maya, http://www.autodcsk.com/maya
[50] E-FIT ™ from Aspley Ltd., http://www.efit.co.uk
[51] FaceGen Modeller 3.0 from Singular Inversions Inc., http://www.FaceGen.com
[52] Identi-Kit.NET ™ from Smith XL Wesson™, https://www.identikit.net
[53] PROfit™ from ABM United Kingdom Ltd http://www.abm-uk.com/uk/products/profit.asp
[55] USF DARPA HumanID 3D Face Database, Courtesy of Prof. Sudeep Sarkar, University of South Florida, Tampa, FL.

Typ dokumentu

Bibliografia

Identyfikator YADDA

bwmeta1.element.baztech-article-BWA1-0036-0006