Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor

Chen Liu, Anna Wang, Chunguang Bu, Wenhui Wang, Haijing Sun
2021 Sensors  
High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture system combined with human priors and performance capture that only uses a single RGB-D sensor. To break the self-scanning constraint, we generated a complete mesh only using the front view input to
more » ... alize the geometric capture. In order to construct a correct warping field, most previous methods initialize their systems in a strict way. To maintain high fidelity while increasing the easiness of the system, we updated the model while capturing motion. Additionally, we blended in human priors in order to improve the reliability of model warping. Extensive experiments demonstrated that our method can be used more comfortably while maintaining credible geometric warping and remaining free of self-scanning constraints.
doi:10.3390/s21093029 pmid:33925847 fatcat:wgzlbubwhnczphvpsqc3rc2gzm