Filters








367 Hits in 3.5 sec

Face relighting with radiance environment maps

Zhen Wen, Zicheng Liu, T.S. Huang
2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.  
In order to use this technique for human face relighting, we have developed a technique that uses spherical harmonics to approximate the radiance environment map for any given image of a face.  ...  A radiance environment map pre-integrates a constant surface reflectance with the lighting environment. It has been used to generate photo-realistic rendering at interactive speed.  ...  Thanks Brian Guenter for the face albedo map.  ... 
doi:10.1109/cvpr.2003.1211466 dblp:conf/cvpr/WenLH03 fatcat:2begmztdufgixom6qcvxit6f4e

NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting [article]

Tiancheng Sun, Kai-En Lin, Sai Bi, Zexiang Xu, Ravi Ramamoorthi
2021 arXiv   pre-print
Light-transport Field (NeLF) produce a portrait from a new camera view under a new environmental lighting.  ...  We can easily imagine how the face will look like in another setup, but computer algorithms still fail on this problem given limited observations.  ...  The light-transport is a vector whose dotproduct with the global environment map produces the outgoing radiance at the 3D point.  ... 
arXiv:2107.12351v1 fatcat:c3riri2ujvcmlayhrvpsx52ybi

A Neural Rendering Framework for Free-Viewpoint Relighting [article]

Zhang Chen, Anpei Chen, Guli Zhang, Chengyuan Wang, Yu Ji, Kiriakos N. Kutulakos, Jingyi Yu
2020 arXiv   pre-print
RNR instead models image formation in terms of environment lighting, object intrinsic attributes, and light transport function (LTF), each corresponding to a learnable component.  ...  We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs.  ...  We assume that background pixels lie faraway, so we establish the image-to-panorama mapping and fill in the environment map with image pixels.  ... 
arXiv:1911.11530v2 fatcat:s5lv6nmdxja2jncm5kv4ysasde

Face Image Relighting using Locally Constrained Global Optimization [chapter]

Jiansheng Chen, Guangda Su, Jinping He, Shenglan Ben
2010 Lecture Notes in Computer Science  
A face image relighting method using locally constrained global optimization is presented in this paper.  ...  Based on the empirical fact that common radiance environments are locally homogeneous, we propose to use an optimization based solution in which local linear adjustments are performed on overlapping windows  ...  The radiance environment map was adopted by Wen et. al. in face relighting under rotating lighting environments [12] .  ... 
doi:10.1007/978-3-642-15561-1_4 fatcat:x4upnuukuvczjbkxm3yrczcxce

NeRF for Outdoor Scene Relighting [article]

Viktor Rudnev and Mohamed Elgharib and William Smith and Lingjie Liu and Vladislav Golyanik and Christian Theobalt
2022 arXiv   pre-print
., the first approach for outdoor scene relighting based on neural radiance fields.  ...  For each time, a 360 degree environment map is captured together with a colour-calibration chequerboard to allow accurate numerical evaluations on real data against ground truth.  ...  We thank Christen Millerdurai for the help with the dataset recording. This work was supported by the ERC Consolidator Grant 4DRepLy (770784). NeRF-OSR  ... 
arXiv:2112.05140v2 fatcat:eq62v3bl4nf3jlr5cxvba4sghq

VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting [article]

Feitong Tan, Sean Fanello, Abhimitra Meka, Sergio Orts-Escolano, Danhang Tang, Rohit Pandey, Jonathan Taylor, Ping Tan, Yinda Zhang
2022 arXiv   pre-print
We propose VoLux-GAN, a generative framework to synthesize 3D-aware faces with convincing relighting.  ...  Our main contribution is a volumetric HDRI relighting method that can efficiently accumulate albedo, diffuse and specular lighting contributions along each 3D ray for any desired HDR environmental map.  ...  contributions from the HDR environment map.  ... 
arXiv:2201.04873v1 fatcat:hkxwjzghvzanhgtw7vardumrqe

Classification of Illumination Methods for Mixed Reality [article]

Katrien Jacobs, Céline Loscos
2004 Eurographics State of the Art Reports  
In this report a classification of the illumination methods for MR is given based on their input requirements: the amount of geometry and radiance known from the real environment.  ...  Three different illumination methods can be identified: common illumination, relighting and methods based on inverse illumination.  ...  center of the environment map [Che95] .  ... 
doi:10.2312/egst.20041027 fatcat:lt7rdchbvvbrhlpquwuattbj6y

Relighting4D: Neural Relightable Human from Videos [article]

Zhaoxi Chen, Ziwei Liu
2022 arXiv   pre-print
Extensive experiments on both real and synthetic datasets demonstrate that our framework is capable of relighting dynamic human actors with free-viewpoints.  ...  Human relighting is a highly desirable yet challenging task.  ...  However, none of them is applicable to relight dynamic humans with space-time varying features. Relighting of human face, avatar and body has wide-range applications [31, 39, 44, 51, 64] .  ... 
arXiv:2207.07104v1 fatcat:zm23ewo3o5di7ixjl5vnsql2pm

Image based relighting using room lighting basis

Antoine Toisoul, Abhijeet Ghosh
2015 ACM SIGGRAPH 2015 Posters on - SIGGRAPH '15  
Finally we optimize the projection of a desired lighting environment on to our room lighting basis to get a close approximation of the environment with our sparse lighting basis.  ...  We believe our approach can be applied for practical relighting applications with general studio lighting.  ...  RELIGHTING Environment map partition Regular image-based relighting is a three steps algorithm.  ... 
doi:10.1145/2787626.2792618 dblp:conf/siggraph/ToisoulG15 fatcat:77qyehd2cndqhkb2dk72xdza3m

Image-Based Relighting using Room Lighting Basis

Antoine Toisoul, Abhijeet Ghosh
2016 Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016) - CVMP 2016  
Finally we optimize the projection of a desired lighting environment on to our room lighting basis to get a close approximation of the environment with our sparse lighting basis.  ...  We believe our approach can be applied for practical relighting applications with general studio lighting.  ...  RELIGHTING Environment map partition Regular image-based relighting is a three steps algorithm.  ... 
doi:10.1145/2998559.2998567 dblp:conf/cvmp/ToisoulG16 fatcat:5zogyxeodjhibmmkdxycwyz7qq

All-frequency shadows using non-linear wavelet lighting approximation

Ren Ng, Ravi Ramamoorthi, Pat Hanrahan
2003 ACM Transactions on Graphics  
Our main contribution is to approximate the environment map in a wavelet basis, keeping only the largest terms (this is known as a non-linear approximation).  ...  We present a method, based on pre-computed light transport, for real-time rendering of objects under all-frequency, time-varying illumination represented as a high-resolution environment map.  ...  , Kekoa Proudfoot and Eric Chan for help with writing and code; and Peter Schröder and Gene Golub for advice.  ... 
doi:10.1145/882262.882280 fatcat:td7n6zwl2rg5zlsd5pdtqf3isy

Classification of Illumination Methods for Mixed Reality

Katrien Jacobs, Celine Loscos
2006 Computer graphics forum (Print)  
In this paper a classification of the illumination methods for MR is given based on their input requirements: the amount of geometry and radiance known of the real environment.  ...  Three different illumination methods can be identified: common illumination, relighting and methods based on inverse illumination.  ...  center of the environment map [50] .  ... 
doi:10.1111/j.1467-8659.2006.00816.x fatcat:mcc4xiwf2jdeblcgn4t36kjbhe

All-frequency shadows using non-linear wavelet lighting approximation

Ren Ng, Ravi Ramamoorthi, Pat Hanrahan
2003 ACM SIGGRAPH 2003 Papers on - SIGGRAPH '03  
Our main contribution is to approximate the environment map in a wavelet basis, keeping only the largest terms (this is known as a non-linear approximation).  ...  We present a method, based on pre-computed light transport, for real-time rendering of objects under all-frequency, time-varying illumination represented as a high-resolution environment map.  ...  , Kekoa Proudfoot and Eric Chan for help with writing and code; and Peter Schröder and Gene Golub for advice.  ... 
doi:10.1145/1201775.882280 fatcat:onagab3hnfgmffpnh3xrybcxlu

Geometry-aware Single-image Full-body Human Relighting [article]

Chaonan Ji, Tao Yu, Kaiwen Guo, Jingxin Liu, Yebin Liu
2022 arXiv   pre-print
shadows (including hard cast shadows) from the ray-traced shading maps.  ...  Single-image human relighting aims to relight a target human under new lighting conditions by decomposing the input image into albedo, shape and lighting.  ...  We allocate 4600 HDR environment maps for training and 200 HDR environment maps for testing.  ... 
arXiv:2207.04750v2 fatcat:popn7vodlvf4jbqzjevbowbebq

Precomputation-Based Rendering

Ravi Ramamoorthi
2007 Foundations and Trends in Computer Graphics and Vision  
Precomputationbased relighting and radiance transfer has a long history with a spurt of renewed interest, including adoption in commercial video games, due to recent mathematical developments and hardware  ...  In these cases, the final image or rendering is a linear combination of basis images or radiance distributions due to individual lights.  ...  collaborators on the PRT research projects below have included a number of graduate students: Aner Ben-Artzi and Kevin Egan (BRDF editing), Nolan Goodnight (4D transport compression), Charles Han (normal map  ... 
doi:10.1561/0600000021 fatcat:lruiwpvi75bevf5ietum5cn33q
« Previous Showing results 1 — 15 out of 367 results