Trust your Model: Light Field Depth Estimation with Inline Occlusion Handling

Hendrik Schilling, Maximilian Diebold, Carsten Rother, Bernd Jahne
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
We address the problem of depth estimation from lightfield images. Our main contribution is a new way to handle occlusions which improves general accuracy and quality of object borders. In contrast to all prior work we work with a model which directly incorporates both depth and occlusion, using a local optimization scheme based on the PatchMatch algorithm. The key benefit of this joint approach is that we utilize all available data, and not erroneously discard valuable information in
more » ... sing steps. We see the benefit of our approach not only at improved object boundaries, but also at smooth surface reconstruction, where we outperform even methods which focus on good surface regularization. We have evaluated our method on a public light-field dataset, where we achieve state-of-the-art results in nine out of twelve error metrics, with a close tie for the remaining three.
doi:10.1109/cvpr.2018.00476 dblp:conf/cvpr/SchillingDRJ18 fatcat:q6h3ymaxi5hnxktxis5p3sdvce