Optimal rate allocation for view synthesis along a continuous viewpoint location in multiview imaging

Vladan Velisavljevic, Gene Cheung, Jacob Chakareski
2010 28th Picture Coding Symposium  
We consider the scenario of view synthesis via depth-image based rendering in multi-view imaging. We formulate a resource allocation problem of jointly assigning an optimal number of bits to compressed texture and depth images such that the maximum distortion of a synthesized view over a continuum of viewpoints between two encoded reference views is minimized, for a given bit budget. We construct simple yet accurate image models that characterize the pixel values at similar depths as
more » ... epths as first-order Gaussian auto-regressive processes. Based on our models, we derive an optimization procedure that numerically solves the formulated min-max problem using Lagrange relaxation. Through simulations we show that, for two captured views scenario, our optimization provides a significant gain (up to 2dB) in quality of the synthesized views for the same overall bit rate over a heuristic quantization that selects only two quantizers -one for the encoded texture images and the other for the depth images.
doi:10.1109/pcs.2010.5702542 dblp:conf/pcs/VelisavljevicCC10 fatcat:4vism5dfyjaphmofdvghvokthe