Learning Body Shape and Pose from Dense Correspondences

Yusuke Yoshiyasu, Lucas Gamez
2020 Annual Conference of the European Association for Computer Graphics  
In this paper, we address the problem of learning 3D human pose and body shape from 2D image dataset, without having to use 3D supervisions (body shape and pose) which are in practice difficult to obtain. The idea is to use dense correspondences between image points and a body surface, which can be annotated on in-the-wild 2D images, to extract, aggregate and learn 3D information such as body shape and pose from them. To do so, we propose a training strategy called "deform-and-learn" where we
more » ... ternate deformable surface registration and training of deep convolutional neural networks (ConvNets). Experimental results showed that our method is comparable to previous semi-supervised techniques that use 3D supervision.
doi:10.2312/egs.20201012 dblp:conf/eurographics/YoshiyasuG20 fatcat:ffbrncstkvauzj4clmyi76paem