Automatic video segmentation using spatiotemporal T-junctions

N. Apostoloff, A. W. Fitzgibbon
2006 Procedings of the British Machine Vision Conference 2006  
The problem of figure-ground segmentation is of great importance in both video editing and visual perception tasks. Classical video segmentation algorithms approach the problem from one of two perspectives. At one extreme, global approaches constrain the camera motion to simplify the image structure. At the other extreme, local approaches estimate motion in small image regions over a small number of frames and tend to produce noisy signals that are difficult to segment. With recent advances in
more » ... mage segmentation showing that sparse information is often sufficient for figureground segmentation it seems surprising then that with the extra temporal information of video, an unconstrained automatic figure-ground segmentation algorithm still eludes the research community. In this paper we present an automatic video segmentation algorithm that is intermediate between these two extremes and uses spatiotemporal features to regularize the segmentation. Detecting spatiotemporal T-junctions that indicate occlusion edges, we learn an occlusion edge model that is used within a colour contrast sensitive MRF to segment individual frames of a video sequence. T-junctions are learnt and classified using a support vector machine and a Gaussian mixture model is fitted to the (foreground, background) pixel pairs sampled from the detected T-junctions. Graph cut is then used to segment each frame of the video showing that sparse occlusion edge information can automatically initialize the video segmentation problem.
doi:10.5244/c.20.111 dblp:conf/bmvc/ApostoloffF06 fatcat:fayefoebejaf7fle2ziooeb7h4