An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding

Jiangbo Lu, Hua Cai, Jian-Guang Lou, Jiang Li
2007 IEEE transactions on circuits and systems for video technology (Print)  
Effectively coding multiview visual content is an indispensable research topic because multiview image and video that provide greatly enhanced viewing experiences often contain huge amounts of data. Generally, conventional hybrid predictive-coding methodologies are adopted to address the compression by exploiting the temporal and interviewpoint redundancy existing in a multiview image or video sequences. However, their key yet time-consuming component, motion estimation (ME), is usually not
more » ... cient in interviewpoint prediction or disparity estimation (DE), because interviewpoint disparity is completely different from temporal motion existing in the conventional video. Targeting a generic fast DE framework for interviewpoint prediction, we propose a novel DE technique in this paper to accelerate the disparity search by employing epipolar geometry. Theoretical analysis, optimal disparity vector distribution histograms, and experimental results show that the proposed epipolar geometry-based DE can greatly reduce search region and effectively track large and irregular disparity, which is typical in convergent multiview camera setups. Compared with the existing state-of-the-art fast ME approaches, our proposed DE can obtain a similar coding efficiency while achieving a significant speedup for interviewpoint prediction and coding. Moreover, a robustness study shows that the proposed DE algorithm is insensitive to the epipolar geometry estimation noise. Hence, its wide application for multiview image and video coding is promising. Index Terms-Disparity estimation (DE), epipolar geometry, fast motion estimation (ME), H.264/AVC, multiview image, multiview image compression, multiview video, multiview video compression, video coding. video, Portrait video, and Watercolor video, which are suitable to very low-bandwidth networks. He released Microsoft Portrait, the first video communication software prototype on Pocket PC and Smartphone. He is now leading the Media Communication Group in the research of mobile video communication, multiparty conferencing, multiview video, and peer-to-peer streaming. Before joining Microsoft, he was an Associate Professor with the Physics Department, Zhejiang University.
doi:10.1109/tcsvt.2007.896659 fatcat:74txwqux7zho7i7ckod6njcpfy