Understanding and improving the realism of image composites

Su Xue, Aseem Agarwala, Julie Dorsey, Holly Rushmeier
2012 ACM Transactions on Graphics  
Figure 1 : Our method can automatically adjust the appearance of a foreground region to better match the background of a composite. Given the proposed foreground and background on the left, we show the compositing results of unadjusted cut-and-paste, Adobe Photoshop's Match Color, the method of Lalonde and Efros [2007], and our method. Abstract Compositing is one of the most commonly performed operations in computer graphics. A realistic composite requires adjusting the appearance of the
more » ... rance of the foreground and background so that they appear compatible; unfortunately, this task is challenging and poorly understood. We use statistical and visual perception experiments to study the realism of image composites. First, we evaluate a number of standard 2D image statistical measures, and identify those that are most significant in determining the realism of a composite. Then, we perform a human subjects experiment to determine how the changes in these key statistics influence human judgements of composite realism. Finally, we describe a data-driven algorithm that automatically adjusts these statistical measures in a foreground to make it more compatible with its background in a composite. We show a number of compositing results, and evaluate the performance of both our algorithm and previous work with a human subjects study.
doi:10.1145/2185520.2185580 fatcat:msra7wo3h5gpbehjyj6rqrcjta