13 Hits in 2.2 sec

Illumination decomposition for material recoloring with consistent interreflections

Robert Carroll, Ravi Ramamoorthi, Maneesh Agrawala
2011 ACM Transactions on Graphics  
Our user-assisted decomposition ( Figure 2 ) lets us modify indirect illumination to match the modified shirt color (c), leading to a much more consistent and natural looking recoloring.  ...  We demonstrate our approach on a number of examples, where we consistently edit material colors and the associated interreflections.  ...  We also thank Michael Lustig for helpful discussions regarding optimization, and reviewers for their feedback.  ... 
doi:10.1145/2010324.1964938 fatcat:pd3ljtkafvddjbmz3rx4ansjuu

Illumination decomposition for material recoloring with consistent interreflections

Robert Carroll, Ravi Ramamoorthi, Maneesh Agrawala
2011 ACM SIGGRAPH 2011 papers on - SIGGRAPH '11  
illumination -Applying diffuse interreflection in reflectance color • Matching modified reflectance color -Manipulating illumination to consistent shading in scene • Decomposing illumination -Direct lighting  ...  and indirect diffuse illumination from each material 2 / 37  ...  Accounting for indirect illumination when recoloring leads to much more consistent results than the approach of modifying only reflectance (c).  ... 
doi:10.1145/1964921.1964938 fatcat:iiupdlqkkjet7fpocwranddm4i

Measurement-based editing of diffuse albedo with consistent interreflections

Bo Dong, Yue Dong, Xin Tong, Pieter Peers
2015 ACM Transactions on Graphics  
Figure 1 : Changing the diffuse albedo with consistent interreflections for a decorative table centerpiece and a bathroom scene.  ...  One possible strategy for physically-accurate editing of surface albedo and corresponding interreflections is to employ an inverse rendering approach to infer material properties, geometry, and lighting  ...  Acknowledgements We wish to thank the reviewers for their constuctive feedback, and Victoria Cooper and Kathleen Moore for proofreading.  ... 
doi:10.1145/2766979 fatcat:ojnifcvixfcvdakyd4vup3kk6a

Object recoloring based on intrinsic image estimation

Shida Beigpour, Joost van de Weijer
2011 2011 International Conference on Computer Vision  
Application of these methods to real-world scenes lit by colored illuminants, multiple illuminants, or interreflections, results in unrealistic recoloring of objects.  ...  We show that this permits us to perform realistic recoloring of objects lit by colored lights, and multiple illuminants. Moreover, the model allows for more realistic scene relighting.  ...  Fig 1 provides an example of reflectance decomposition as well as object and illuminant recoloring.  ... 
doi:10.1109/iccv.2011.6126259 dblp:conf/iccv/BeigpourW11 fatcat:brqnseo5x5fdnbjn7sm4vhpe5e

LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing [article]

Sharon Lin, Matthew Fisher, Angela Dai, Pat Hanrahan
2017 arXiv   pre-print
However, allowing for interactive recoloring while preserving smooth color blends in the image remains a challenging problem.  ...  We demonstrate our algorithm on recoloring a variety of images and videos, and show its overall effectiveness in recoloring quality and time complexity compared to previous approaches.  ...  Carroll and colleagues aim to recolor objects in photographs while updating their interreflections with other objects consistently [CRA11].  ... 
arXiv:1701.03754v2 fatcat:zqmwmuiauzg37gebd53i4dowfu

Interactive intrinsic video editing

Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
2014 ACM Transactions on Graphics  
We also show how these decompositions can be used for a number of video editing applications including recoloring, retexturing, illumination editing, and lighting-aware compositing.  ...  a) Input video (b) Intrinsic decomposition (c) Editing the reflectance only Figure 1: A video sequence (a) is interactively decomposed into temporally consistent components for reflectance (b, top) and  ...  Acknowledgements We thank the SIGGRAPH reviewers for their feedback. This work was partially supported by NSF grants CGV-1111415, IIS-1110955, OIA-1125087, and LIMA -Région Rhône-Alpes.  ... 
doi:10.1145/2661229.2661253 fatcat:mbzg2zekgjdy3l4mvzxyr4fbkq

Interreflections in Computer Vision: A Survey and an Introduction to Spectral Infinite-Bounce Model

Rada Deeb, Damien Muselet, Mathieu Hebert, Alain Tremeau
2017 Journal of Mathematical Imaging and Vision  
Due to this fact, modeling interreflections is important for many vision applications.  ...  Interreflections are observed on concave objects or when multiple objects are located closely. In a vision system, interreflections can largely affect color values captured by the camera.  ...  They demonstrate that it is possible to use three basis functions for surfaces and illumination with no need for more than three sensor classes.  ... 
doi:10.1007/s10851-017-0781-x fatcat:kxp7orf5i5gibgsxrjljb3ldkm

Intrinsic Decomposition of Image Sequences from Local Temporal Variations

Pierre-Yves Laffont, Jean-Charles Bazin
2015 2015 IEEE International Conference on Computer Vision (ICCV)  
with consistent shading changes.  ...  We present a method for intrinsic image decomposition, which aims to decompose images into reflectance and shading layers.  ...  The authors thank Kalyan Sunkavalli, Jean-François Lalonde, YiChang Shih, and the authors of concurrent methods for sharing their results.  ... 
doi:10.1109/iccv.2015.57 dblp:conf/iccv/LaffontB15 fatcat:qrkhuphzw5hyhji7jj6ixs2fam

LIME: Live Intrinsic Material Estimation [article]

Abhimitra Meka, Maxim Maximov, Michael Zollhoefer, Avishek Chatterjee, Hans-Peter Seidel, Christian Richardt, Christian Theobalt
2018 arXiv   pre-print
We present the first end to end approach for real time material estimation for general object shapes with uniform material that only requires a single color image as input.  ...  The estimation of material parameters at real time frame rates enables exciting mixed reality applications, such as seamless illumination consistent integration of virtual objects into real world scenes  ...  Illumination ings of the International Conference on Computer Vision and decomposition for material recoloring with consistent Pattern Recognition (CVPR), pages 5967–5976  ... 
arXiv:1801.01075v2 fatcat:bxvrwkxkgnhq5owufhqwzgrfre

Learning Non-Lambertian Object Intrinsics Across ShapeNet Categories

Jian Shi, Yue Dong, Hao Su, Stella X. Yu
2017 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
Our analysis shows that feature learning at the encoder stage is more crucial for developing a universal representation across categories.  ...  Benchmarked on our ShapeNet and MIT intrinsics datasets, our model consistently outperforms the state-of-the-art by a large margin. We train and test our CNN on different object categories.  ...  For the shading component, we replace materials with pure diffuse white for rendering. For the specular, we set the diffuse to 0 and keep the specular for rendering.  ... 
doi:10.1109/cvpr.2017.619 dblp:conf/cvpr/ShiDSY17 fatcat:v7jfasg62zdancavcwfd35ypqe

Accurate Normal and Reflectance Recovery Using Energy Optimization

Tao Luo, Jianbing Shen, Xuelong Li
2015 IEEE transactions on circuits and systems for video technology (Print)  
As for intrinsic image decomposition, results on the real and synthetic scenes show that the proposed approach outperforms previous ones.  ...  To formulate inter-image constraints, shading information is added to the Lambertian model to account for shadows.  ...  Fig. 11 shows the comparison results with their approaches. Results of the other two methods are directly copied from the supplementary material of [27] with unknown laboratory illumination.  ... 
doi:10.1109/tcsvt.2014.2333991 fatcat:dvosen3x2rf6xf6b5bbnh2rz5u

ShadingNet: Image Intrinsics by Fine-Grained Shading Decomposition [article]

Anil S. Baslamisli, Partha Das, Hoang-An Le, Sezer Karaoglu, Theo Gevers
2021 arXiv   pre-print
Therefore, in this paper, we propose to decompose the shading component into direct (illumination) and indirect shading (ambient light and shadows) subcomponents.  ...  In general, intrinsic image decomposition algorithms interpret shading as one unified component including all photometric effects.  ...  They are also preferred by computational photography applications for plausible photo editing tasks such as recoloring, material editing and retexturing (Meka et al., 2016) .  ... 
arXiv:1912.04023v3 fatcat:c2q6t3spczgy7pi4i3ud3bgtzi

Single Image Portrait Relighting [article]

Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul Debevec, Ravi Ramamoorthi
2019 pre-print
To this end, we present a system for portrait relighting: a neural network that takes as input a single RGB image of a portrait taken with a standard cellphone camera in an unconstrained environment, and  ...  illuminations, or accurate models of geometry and reflectance.  ...  Thanks to Zhixin Shu and Yichang Shih for the help on baseline algorithms, to Jean-François Lalonde for providing the indoor lighting dataset, to Peter Denny for coordinating dataset capture, and to all  ... 
doi:10.1145/3306346.3323008 arXiv:1905.00824v1 fatcat:n7y72ijz2bh5dook67mzf4ne5a