Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding

PoLin Lai, Antonio Ortega, Camilo C. Dorea, Peng Yin, Cristina Gomila, Majid Rabbani, Robert L. Stevenson
2009 Visual Communications and Image Processing 2009  
We consider the effect of depth-image compression artifacts on the quality of virtual views rendered using neighboring views. Such view rendering processes are utilized in new video applications such as 3D television (3DTV) and free viewpoint video (FVV). We first analyze how compression artifacts in compressed depth-images result in distortions in rendered views. We show that the rendering position error is a monotonic function of the coding error. For the scenario in which cameras are
more » ... cameras are arranged with parallel optical axes , we further demonstrate specific properties of rendering position error. Exploiting special characteristics of depth-images, namely smooth regions separated by sharp edges, we investigate a possible solution to suppress compression artifacts by encoding depth-images with a recently published sparsity-based in-loop de-artifacting filter. Simulation results show that applying such techniques not only provides significantly higher coding efficiency for depth-image coding, but, more importantly, also improves the quality of rendered views in terms of PSNR and subjective quality. Keywords: Depth compression, multiview video plus depth, de-artifact filter, view rendering * While a particular view-warping algorithm may not follow exactly the procedure described here, the equations (3) (4) are the basic principles that most of the view-warping methods based on. † These parameters are all provided along with the MVD data set used in this paper.
doi:10.1117/12.810546 fatcat:mx5p4ifte5gcrfmdkwzubtqmji