University of Illinois Urbana-Champaign

An Integrated Framework Enhanced with Appearance Model for Facial Motion Modeling, Analysis and Synthesis

Wen, Zhen

Content Files
An Integrated Framework Enhanced with Appearance Model for Facial Motion Modeling, Analysis and Synthesis.pdf

Permalink

https://hdl.handle.net/2142/10913

Description

Title
An Integrated Framework Enhanced with Appearance Model for Facial Motion Modeling, Analysis and Synthesis
Author(s)
Wen, Zhen
Issue Date
2004-07
Keyword(s)
  • human computer interaction
  • machine learning
Date of Ingest
2009-04-17T14:36:16Z
Abstract
Human faces provide important cues of human activities. Thus they are useful for human-human communication, human-computer interaction (HCI) and intelligent video surveillance. Computational models for face analysis and synthesis are useful for both basic research and practical applications. In this dissertation, we present a unified framework for 3D face motion modeling, analysis and synthesis. We first derive a compact geometric facial motion model from motion capture data. Then it is used for robust 3D non-rigid face tracking and face animation. One limitation of the geometric model is that it can not handle the motion details, which are important for both human perception and computer analysis. Therefore, we enhance our framework with appearance models. To adapt the appearance model to different illumination conditions and different people, we propose the following methods: (1) modeling illumination effects from one single face image; (2) reducing person-dependency using ratio-image technique; and (3) online appearance model transformation during tracking. We demonstrate the efficacy of this framework by experimental results on face recognition, expression recognition and face synthesis in varying conditions. We will also show the use of this framework in applications such as computer-aided learning and very low bit-rate face video coding.
Type of Resource
text
Genre of Resource
Technical Report
Permalink
http://hdl.handle.net/2142/10913
Copyright and License Information
You are granted permission for the non-commercial reproduction, distribution, display, and performance of this technical report in any format, BUT this permission is only for a period of 45 (forty-five) days from the most recent time that you verified that this technical report is still available from the University of Illinois at Urbana-Champaign Computer Science Department under terms that include this permission. All other rights are reserved by the author(s).

Owning Collections

Research and Tech Reports - Computer Science PRIMARY