Raymond Yun Fu ‘s Website
M-Face: An Appearance-Based Photorealistic Model for Multiple Facial Attributes Rendering (This work was done when Yun Fu was a M.S. student in AI&R, XJTU, China.)
Abstract A novel framework for appearance-based photorealistic facial modeling, called Merging Face (M-Face), is presented and applied to generate emotional facial attributes in rotated views. Assuming that human faces belong to both the linear object class and the Lambertian object class, we span the face space and attribute space, respectively, by using groups of prototypes and merging ratio image (MRI). The MRI is defined as the seamless blend of individual expression ratio image, aging ratio image, and illumination ratio image (quotient image). The M-Face integrates the view space projection, shape caricaturing, and texture MRI-mapping techniques. Derived from the average face, the caricatured shape is reshaped to be more distinct by exaggerating individual distinctiveness, while the rerendered texture multiplies the MRI information during the caricaturing. Based on the M-Face model, the expression morphing, chronological aging or rejuvenating, and illumination variance can be merged seamlessly in a photorealistic style on desired view-rotated faces yielded by view morphing. This framework has the following advantages. First, 3-D reconstruction is avoided without weakening photorealistic effects. Second, the integration of shape caricaturing and texture MRI-mapping proves by experiments to be an efficient and computational inexpensive strategy for realistic face synthesis. Finally, the M-Face is a 2-D parameter-driven model, which highly simplifies user manipulations. The potential applications of M-Face are in various fields like virtual human face, speech-driven talking head, digital painting, film-making, and low-bit-rate communication.
Framework
Photorealistic Rendering	Realistic Expression
	Realistic Illumination
	Head Rotation
Aging & Rejuvenating		Aging Animation
Aging & Rejuvenating
References [1] Yun Fu and Nanning Zheng. “M-Face: An Appearance-Based Photorealistic Model for Multiple Facial Attributes Rendering”. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 16, No. 7, pp: 830-842, Jul. 2006. [2] Yun Fu. “Photorealistic Face Rendering Based on a Fusion Model of Linear and Lambertian Object Class”. M.S. Thesis, Pattern Recognition & Intelligent Systems, Institute of Artificial Intelligence & Robotics, Xi’an Jiaotong University, China, 2004. (Chinese Version) [3] Yun Fu. “Merging Ratio Images Based Realistic Object Class Re-Rendering”. 2004 IEEE International Conference on Image Processing (IEEE ICIP’04), Singapore, pp. 3523-3526, Oct. 2004. [4] Yun Fu and Nanning Zheng. “Image-Based Photorealistic Fusion Model of Multi Facial Object Class”, The Fifth National Conference on Computer Graphics (Chinagraph’ 04), Xi’an, China, pp.210-217, 2004. (Chinese Version)
Last Update: 09-06-2007, Copyright © 2004~2008, Raymond Yun Fu, All Rights Reserved Copyright Notice: This publication material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.