Globally Consistent Multi-label Assignment on the Ray Space of 4D Light Fields

Sven Wanner, Christoph Straehle, Bastian Goldluecke
2013 2013 IEEE Conference on Computer Vision and Pattern Recognition  
We present the first variational framework for multi-label segmentation on the ray space of 4D light fields. For traditional segmentation of single images, features need to be extracted from the 2D projection of a three-dimensional scene. The associated loss of geometry information can cause severe problems, for example if different objects have a very similar visual appearance. In this work, we show that using a light field instead of an image not only enables to train classifiers which can
more » ... rcome many of these problems, but also provides an optimal data structure for label optimization by implicitly providing scene geometry information. It is thus possible to consistently optimize label assignment over all views simultaneously. As a further contribution, we make all light fields available online with complete depth and segmentation ground truth data where available, and thus establish the first benchmark data set for light field analysis to facilitate competitive further development of algorithms.
doi:10.1109/cvpr.2013.135 dblp:conf/cvpr/WannerSG13 fatcat:g5gklntkxjbsllt64ceei5eymi