UBC Theses and Dissertations

UBC Theses Logo

UBC Theses and Dissertations

Dynamic facial appearance capture using six primaries Mahmud, Anika

Abstract

Facial appearance changes as people talk, move and, change expression. The key indication of this change is the skin color. In current appearance models skin color is reconstructed by considering the scattering and absorption of light within skin layers caused by melanin and hemoglobin in a three dimensional color space. Capturing dynamic facial appearance requires capturing both the temporal deformation of facial geometry and the temporal change of skin color by measuring the hemoglobin concentration change. Existing passive multi-stereo capture systems can capture high resolution temporal facial geometry. Integrating skin appearance capture with the existing passive capture system is challenging because to capture facial appearance the system requires precise color calibration and cross polarization, which are inheritably not required in a facial capture system. Integrating them in the existing system requires expensive hardware and constrained capture setup. In this thesis we present a novel method that can capture dynamic facial appearance without changing the existing passive capture system. We use a six dimensional color space to reconstruct the skin color, which can be adapted easily to any existing capture pipeline.

Item Media

Item Citations and Data

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International