Image completion with structure propagation

Jian Sun, Lu Yuan, Jiaya Jia, Heung-Yeung Shum
2005 ACM SIGGRAPH 2005 Papers on - SIGGRAPH '05  
Figure 1: Image completion with structure propagation. (a) Input image, (b) unknown region (blue) after removing the pumpkin, with two intersecting lines (green) specified by the user, (c) intermediate result after propagating structure and texture information along the user-specified lines, and (d) final result after filling in the remaining unknown regions by texture propagation. Abstract In this paper, we introduce a novel approach to image completion, which we call structure propagation. In
more » ... our system, the user manually specifies important missing structure information by extending a few curves or line segments from the known to the unknown regions. Our approach synthesizes image patches along these user-specified curves in the unknown region using patches selected around the curves in the known region. Structure propagation is formulated as a global optimization problem by enforcing structure and consistency constraints. If only a single curve is specified, structure propagation is solved using Dynamic Programming. When multiple intersecting curves are specified, we adopt the Belief Propagation algorithm to find the optimal patches. After completing structure propagation, we fill in the remaining unknown regions using patch-based texture synthesis. We show that our approach works well on a number of examples that are challenging to state-of-the-art techniques.
doi:10.1145/1186822.1073274 fatcat:ae5aeg6dt5djfiqdcxksajvjiu