Academia.eduAcademia.edu

Facial animation

Proceedings Computer Animation '96

Abstract

Department of Computer Science and Engineering 10 Facial Animation Facial models Propagation of deformation of the skin can be based on a simple distance-based model such that there is increasing attenuation with increasing distance. This can result in direct movement (a), attenuation based on linear distance (b), or distance and 10-36 Department of Computer Science and Engineering 10 Facial Animation Time Alignment of Triphone Videos Need to combine triphone videos Choose portion of overlapping triphones where lip shapes are close as possible Already done when computing D s 10-44 Department of Computer Science and Engineering 10 Facial Animation Data Capture •Actor's face digitized using a Cyberware scanner to get a base 3D mesh •Six calibrated video cameras capture actor's expressions Six camera views 10-54 Department of Computer Science and Engineering 10 Facial Animation Assigning Blend Coefficients Assign blend coefficients for a grid of 1400 evenly distributed points on face 10-73 Department of Computer Science and Engineering 10 Facial Animation Motion Vector Transfer Compute transformation between two coordinate systems Mapping determines the deformed source model motion vectors

Terzopolous, NYU

Starting with a structured facial mesh, an algorithms that automatically construct functional models of the heads of human subjects from laser-scanned range and reflectance data. These algorithms automatically insert contractile muscles at anatomically correct positions within a dynamic skin model and root them in an estimated skull structure with a hinged jaw. They also synthesize functional eyes, eyelids, teeth, and a neck and fit them to the final model. The constructed face may be animated via muscle actuations.

Audio Analysis

• Want to capture visual dynamics of speech

• Phonemes are not enough

• Consider coarticulation

• Lip shapes for many phonemes are modified based on phoneme's context (e.g. /T/ in "beet" vs. /T/ in "boot")

Remaining slides courtesy of Shahzad Malik