Filters








2,189 Hits in 4.5 sec

Specular-to-Diffuse Translation for Multi-View Reconstruction [article]

Shihao Wu, Hui Huang, Tiziano Portenier, Matan Sela, Danny Cohen-Or, Ron Kimmel, Matthias Zwicker
2018 arXiv   pre-print
Our network extends unsupervised image-to-image translation to multi-view "specular to diffuse" translation.  ...  To alleviate this restriction, we introduce S2Dnet, a generative adversarial network for transferring multiple views of objects with specular reflection into diffuse ones, so that multi-view reconstruction  ...  Acknowledgement We thank the anonymous reviewers for their constructive comments. This work was supported in parts by Swiss National Science Foundation (169151)  ... 
arXiv:1807.05439v3 fatcat:hfrty3axrbea7bucrsm4q4zrpm

Specular-to-Diffuse Translation for Multi-view Reconstruction [chapter]

Shihao Wu, Hui Huang, Tiziano Portenier, Matan Sela, Daniel Cohen-Or, Ron Kimmel, Matthias Zwicker
2018 Lecture Notes in Computer Science  
To alleviate this restriction, we introduce S2Dnet, a generative adversarial network for transferring multiple views of objects with specular reflection into diffuse ones, so that multi-view reconstruction  ...  Our network extends unsupervised image-to-image translation to multiview "specular to diffuse" translation.  ...  Acknowledgement We thank the anonymous reviewers for their constructive comments. This work was supported in parts by Swiss National Science Foundation  ... 
doi:10.1007/978-3-030-01225-0_12 fatcat:e2afhfno3zeedpvbqkseq2hioy

Removal of Specular Reflection Component Using Multi-view Images and 3D Object Model [chapter]

Shu-Kam Chow, Kwok-Leung Chan
2009 Lecture Notes in Computer Science  
Image-based 3D model reconstruction method can use the same multi-view image sequence of the object for the generation of both the geometry model and texture map.  ...  For each triangle patch, the projected colors on all visible views are found. The specular chromaticity is replaced by the corresponding diffuse chromaticity.  ...  Specular-to-Diffuse Transformation To remove the specular reflection component, we first estimate the illumination color which is used for normalizing and renormalizing the whole set of multi-view images  ... 
doi:10.1007/978-3-540-92957-4_87 fatcat:tcguxyxfwvf7jdxa35miymbgzm

Non-Lambertian Surface Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field [article]

Mingyuan Zhou, Yu Ji, Yuqi Ding, Jinwei Ye, S. Susan Young, Jingyi Yu
2019 arXiv   pre-print
We further show that such concentric camera/light setting results in a unique pattern of specular changes across views that enables robust depth estimation.  ...  Coupled with a multi-spectral ring light, we are able to sample viewpoint and lighting variations in a single shot via spectral multiplexing.  ...  The diffuse coefficients are all set to 0.7 and specular coefficients for each material are respectively set to 0, 0.3, and 0.5. The roughness for the specular sphere is set to 8.  ... 
arXiv:1904.04875v2 fatcat:ernwvyykwja6jjqonsfowgm7cm

AvatarMe: Realistically Renderable 3D Facial Reconstruction "In-the-Wild"

Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis, Vasileios Triantafyllou, Abhijeet Ghosh, Stefanos Zafeiriou
2020 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
Input image; Predicted reflectance (diffuse albedo, diffuse normals, specular albedo and specular normals); Rendered reconstruction in different environments, with detailed reflections; Rendered result  ...  [15] extended polarized spherical gradient illumination for multi-view facial acquisition by employing two orthogonal spherical polarization patterns.  ...  Using the LED sphere, we can also employ the colorspace analysis from unpolarised LEDs [22] for diffusespecular separation and the multi-view facial capture method of [24] to acquire unwrapped textures  ... 
doi:10.1109/cvpr42600.2020.00084 dblp:conf/cvpr/LattasMGPTGZ20 fatcat:yqcuelo6sbaalgzl2w22muydiy

AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild" [article]

Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis, Vasileios Triantafyllou, Abhijeet Ghosh, Stefanos Zafeiriou
2020 arXiv   pre-print
the per-pixel diffuse and specular components that are required for realistic rendering.  ...  In this paper, we introduce AvatarMe, the first method that is able to reconstruct photorealistic 3D faces from a single "in-the-wild" image with an increasing level of detail.  ...  [15] extended polarized spherical gradient illumination for multi-view facial acquisition by employing two orthogonal spherical polarization patterns.  ... 
arXiv:2003.13845v1 fatcat:5qzhuo4qb5a4nni42fqzm6vyby

Full-field 3D shape measurement of specular object having discontinuous surfaces

Zonghua Zhang, Shujun Huang, Nan Gao, Feng Gao, Xiangqian Jiang, Anand K. Asundi
2017 Fifth International Conference on Optical and Photonics Engineering  
The verification tests are given to evaluate the effectiveness of the developed system. 3D (Three-Dimensional) shapes of a concave mirror and a monolithic multi-mirror array having multiple specular surfaces  ...  Based on the model, a hardware measuring system has been set up, which consists of a precise translating stage, a projector, a diffuser and a camera.  ...  A zonal wave-front reconstruction algorithm is implemented to realize three-dimensional, highly reflected and specular surface reconstruction [14] .  ... 
doi:10.1117/12.2270172 fatcat:5uo62kyxjza7fdv6n4t3axocpi

Recovering Facial Reflectance and Geometry from Multi-view Images [article]

Guoxian Song, Jianmin Zheng, Jianfei Cai, Tat-Jen Cham
2019 arXiv   pre-print
Our system processes video streams from two views of a subject, and outputs two reflectance maps for diffuse and specular albedos, as well as a vector map of surface normals.  ...  It has the advantage of requiring only a simple setup with two video streams, and is able to exploit the interaction between the diffuse and specular reflections across multiple views as well as time frames  ...  ACKNOWLEDGMENTS We would like to thank Yudong Guo and Juyong Zhang from University of Science and Technology of China for providing comparison result.  ... 
arXiv:1911.11999v1 fatcat:7k2jhce4z5gfhaw2vpzdadrgra

Seeing the World in a Bag of Chips

Jeong Joon Park, Aleksander Holynski, Steven M. Seitz
2020 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
Note the reconstruction of fine details (c) such as a human figure and trees with fall colors through the window. We use the recovered environment for novel view rendering. †  ...  ) that closely resembles the real environment (b, bottom), entirely from the specular reflections.  ...  In contrast, our method operates with a hand-held camera for a wide-range of multi-object scenes, and is designed to support specularity.  ... 
doi:10.1109/cvpr42600.2020.00149 dblp:conf/cvpr/ParkHS20 fatcat:2doltplz5nebplcux34c4gogtq

AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANs

Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Abhijeet Ghosh, Stefanos P Zafeiriou
2021 IEEE Transactions on Pattern Analysis and Machine Intelligence  
With this, we train a network that disentangles the facial diffuse and specular BRDF components from a shape and texture with baked illumination, reconstructed with a state-of-the-art 3DMM fitting method  ...  We define a fast facial photorealistic differentiable rendering methodology with accurate facial skin diffuse and specular reflection, self-occlusion and subsurface scattering approximation.  ...  [65] and multi-view stereo [66] .  ... 
doi:10.1109/tpami.2021.3125598 pmid:34748477 fatcat:uczq5uykbbelfmfpxjl3e4ruia

Mesh-based Multi-view Normal Integration with Energy Minimization Using Surface Reflectance Properties

Wichayut Eaksarayut, Pitchaya Sitthi-amorn, Borom Tunwattanapong, Nuttapong Chentanez
2018 Journal of WSCG  
Our core optimization framework uses multi-view normal integration, which can recovers water-tight surface of the object iteratively in a coarse to fine manner.  ...  We propose a technique to reconstruct a general 3D object using surface reflectance information from multiple viewpoints.  ...  From left to right, diffuse albedo, diffuse reflection, specular albedo, specular reflection, and mask information for our optimization framework.  ... 
doi:10.24132/jwscg.2018.26.2.3 fatcat:gy4vpyjc4bgsfmvpk42imi4tcq

Facial Geometric Detail Recovery via Implicit Representation [article]

Xingyu Ren, Alexandros Lattas, Baris Gecer, Jiankang Deng, Chao Ma, Xiaokang Yang, Stefanos Zafeiriou
2022 arXiv   pre-print
In order to estimate the detailed geometry, we define an implicit signed distance function and employ a physically-based implicit renderer to reconstruct fine geometric details from the generated multi-view  ...  Initially, we inpaint occluded facial parts, generate complete textures, and build an accurate multi-view dataset of the same subject.  ...  [33] use image-to-image translation networks to learn diffuse and specular reflectance using light-stage data. Feng et al.  ... 
arXiv:2203.09692v1 fatcat:wpijnit2ybb3xmgjclryrfgm7q

Shape and Reflectance Reconstruction in Uncontrolled Environments by Differentiable Rendering [article]

Rui Li, Guangmin Zang, Miao Qi, Wolfgang Heidrich
2022 arXiv   pre-print
In this paper, we propose an efficient method to reconstruct the scene's 3D geometry and reflectance from multi-view photography using conventional hand-held cameras.  ...  With the optimal scene parameters evaluated, photo-realistic novel views for various viewing angles and distances can then be generated by our approach.  ...  Fig. (3) shows the reconstruction results of diffuse and specular reflectance, novel views, generated depth, and surface normal. Figure 3 . 3 Figure 3. Reconstruction Results.  ... 
arXiv:2110.12975v2 fatcat:uosmgsv5ivhbbkuejz44xsn2oa

PASMVS: A perfectly accurate, synthetic, path-traced dataset featuring specular material properties for multi-view stereopsis training and reconstruction applications

André Broekman, Petrus Johannes Gräbe
2020 Data in Brief  
The combination of highly specular and diffuse material properties increases the reconstruction ambiguity and complexity for MVS reconstruction algorithms and pipelines, and more recently, state-of-the-art  ...  The material properties are primarily specular, with a selection of more diffuse materials for reference.  ...  Acknowledgments 4Tel Pty is gratefully acknowledged for sponsoring the Chair in Railway Engineering in the Department of Civil Engineering at the University of Pretoria .  ... 
doi:10.1016/j.dib.2020.106219 pmid:32923541 pmcid:PMC7474405 fatcat:yqi5tqgyyfeazk7za6yjr32q4e

Seeing the World in a Bag of Chips [article]

Jeong Joon Park and Aleksander Holynski and Steve Seitz
2020 arXiv   pre-print
Our contributions include 1) modeling highly specular objects, 2) modeling inter-reflections and Fresnel effects, and 3) enabling surface light field reconstruction with the same input needed to reconstruct  ...  We address the dual problems of novel view synthesis and environment reconstruction from hand-held RGBD sensors.  ...  In contrast, our method operates with a hand-held camera for a wide-range of multi-object scenes, and is designed to support specularity.  ... 
arXiv:2001.04642v2 fatcat:o5hhhvi64fbbvifryo3hsjz6wu
« Previous Showing results 1 — 15 out of 2,189 results