Inverse Rendering with a Morphable Model: A Multilinear Approach

Oswald Aldrian, William Smith
2011 Procedings of the British Machine Vision Conference 2011  
Well known results in inverse rendering show that recovery of unconstrained illumination, texture and reflectance properties from a single image is ill-posed. On the other hand, in the domain of faces linear statistical models have been shown to efficiently characterise variations in face shape and texture. In this paper we show how the inverse rendering process can be constrained using a morphable model of face shape and texture. Starting with a shape estimate recovered using the statistical
more » ... ape model, we show that the image formation process leads to a system of equations which is multilinear in the unknowns. We are able to estimate diffuse texture, specular reflectance properties, the illumination environment and camera properties from a single image. Our approach uses relaxed assumptions and offers improved performance in comparison to the current state-of-the-art morphable model fitting algorithms.
doi:10.5244/c.25.88 dblp:conf/bmvc/AldrianS11 fatcat:rbretodjtfe4bdb6fxaf4ocvra