Interactive viewpoint video textures

Philippe Levieux, James Tompkin, Jan Kautz
2012 Proceedings of the 9th European Conference on Visual Media Production - CVMP '12  
Figure 1 : We enable the viewer to spatially explore a temporally coherent dynamic scene. In this example, captured discontinuously with a single camera, the viewer changes the rotation of the figurine while it coherently waves the scarf above its head. The waving motion continues even when the viewer stops rotating the figurine at novel viewpoints. ABSTRACT We propose an approach to interactively explore video textures from different viewpoints. Scenes can be played back continuously and in a
more » ... tinuously and in a temporally coherent fashion from any camera location along a path. Our algorithm takes as input short videos from a set of discrete camera locations, and does not require contemporaneous capture -data is acquired by moving a single camera. We analyze this data to find optimal transitions within each video (equivalent to video textures) and to find good transition points between spatially distinct videos. We propose a spatio-temporal view synthesis approach that dynamically creates intermediate frames to maintain temporal coherence. We demonstrate our approach on a variety of scenes with stochastic or repetitive motions, and we analyze the limits of our approach and failure-case artifacts.
doi:10.1145/2414688.2414690 dblp:conf/cvmp/LevieuxTK12 fatcat:elqrqugxrrhv5npe2hxbnowbpu