3-D studio production of animated actor models
IEE Proceedings - Vision Image and Signal Processing
This paper presents a framework for construction of detailed animated models of an actors shape and appearance from multiple view images. Multiple views of an actor are captured in a studio with controlled illumination and background. An initial low-resolution approximation of the persons shape is reconstructed by deformation of a generic humanoid model to fit the visual-hull using shape constrained optimisation to preserve the surface parameterisation for animation. Stereo reconstruction with
... ultiple view constraints is then used to reconstruct the detailed surface shape. High-resolution shape detail from stereo is represented in a structured format for animation by displacement mapping from the low-resolution model surface. A novel integration algorithm using displacement maps is introduced to combine overlapping stereo surface measurements from multiple views into a single displacement map representation of the high-resolution surface detail. Results of 3D actor modelling in a 14 camera studio demonstrate improved representation of detailed surface shape such as creases in clothing compared to previous model fitting approaches. Actor models can be animated and rendered from arbitrary views under different illumination to produce free-viewpoint video sequences. The proposed framework enables rapid transformation of captured multiple view images into a structured representation suitable for realistic animation.