3D Pose Detection of Closely Interactive Humans Using Multi-View Cameras

Xiu Li, Zhen Fan, Yebin Liu, Yipeng Li, Qionghai Dai
2019 Sensors  
We propose a method to automatically detect 3D poses of closely interactive humans from sparse multi-view images at one time instance. It is a challenging problem due to the strong partial occlusion and truncation between humans and no tracking process to provide priori poses information. To solve this problem, we first obtain 2D joints in every image using OpenPose and human semantic segmentation results from Mask R-CNN. With the 3D joints triangulated from multi-view 2D joints, a two-stage
more » ... embling method is proposed to select the correct 3D pose from thousands of pose seeds combined by joint semantic meanings. We further present a novel approach to minimize the interpenetration between human shapes with close interactions. Finally, we test our method on multi-view human-human interaction (MHHI) datasets. Experimental results demonstrate that our method achieves high visualized correct rate and outperforms the existing method in accuracy and real-time capability.
doi:10.3390/s19122831 pmid:31242651 pmcid:PMC6631029 fatcat:msi6lhob3bfhtc74qjou4fqh6e