COMBINING 2D FEATURE TRACKING AND VOLUME RECONSTRUCTION FOR ONLINE VIDEO-BASED HUMAN MOTION CAPTURE

CHRISTIAN THEOBALT, MARCUS A. MAGNOR, PASCAL SCHÜLER, HANS-PETER SEIDEL
2004 International Journal of Image and Graphics  
The acquisition of human motion data is of major importance for creating interactive virtual environments, intelligent user interfaces, and realistic computer animations. Today's performance of off-the-shelf computer hardware enables marker-free non-intrusive optical tracking of the human body. In addition, recent research shows that it is possible to efficiently acquire and render volumetric scene representations in real-time. This paper describes a system to capture human motion at
more » ... frame rates without the use of markers or scene-intruding devices. Instead, 2D computer vision and 3D volumetric scene reconstruction algorithms are applied directly to the image data. A person is recorded by multiple synchronized cameras, and a multilayer hierarchical kinematic skeleton is fitted to each frame in a two-stage process. We present results with a prototype system running on two PCs.
doi:10.1142/s0219467804001543 fatcat:bmymrrmg7ffxrhprl4kxhgseva