Filters








111,683 Hits in 6.2 sec

Geometry-aware Deep Network for Single-Image Novel View Synthesis [article]

Miaomiao Liu, Xuming He, Mathieu Salzmann
2018 arXiv   pre-print
This paper tackles the problem of novel view synthesis from a single image.  ...  Modern, learning-based approaches mostly focus on appearance to synthesize novel views and thus tend to generate predictions that are inconsistent with the underlying scene structure.  ...  Acknowledgments This work was done when the first author was working in Data61, CSIRO, Australia.The Titan X used for this research was donated by the NVIDIA Corporation.  ... 
arXiv:1804.06008v1 fatcat:wrz7dz75hffwvpbhlpqow2m474

View Extrapolation of Human Body from a Single Image [article]

Hao Zhu, Hao Su, Peng Wang, Xun Cao, Ruigang Yang
2018 arXiv   pre-print
We study how to synthesize novel views of human body from a single image.  ...  The core step of existing methods is to fit a map from the observable views to novel views by CNNs; however, the rich articulation modes of human body make it rather challenging for CNNs to memorize and  ...  Method We propose an appearance -shape -flow strategy for synthesizing novel views of pose-varying objects.  ... 
arXiv:1804.04213v1 fatcat:ejpgnr6bsfd25fadeh6lx3a5xa

View Extrapolation of Human Body from a Single Image

Hao Zhu, Hao Su, Peng Wang, Xun Cao, Ruigang Yang
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
We study how to synthesize novel views of human body from a single image.  ...  The core step of existing methods is to fit a map from the observable views to novel views by CNNs; however, the rich articulation modes of human body make it rather challenging for CNNs to memorize and  ...  Method We propose an appearance -shape -flow strategy for synthesizing novel views of pose-varying objects.  ... 
doi:10.1109/cvpr.2018.00468 dblp:conf/cvpr/0004SWCY18 fatcat:lmzfymnbqfe6xjvaxumdvtx7oy

Transformation-Grounded Image Generation Network for Novel 3D View Synthesis

Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alexander C. Berg
2017 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
We present a transformation-grounded image generation network for novel 3D view synthesis from a single image.  ...  Our approach first explicitly infers the parts of the geometry visible both in the input and novel views and then casts the remaining synthesis problem as image completion.  ...  We would like to thank Weilin Sun, Guilin Liu, True Price, and Dinghuang Ji for helpful discussions. We thank NVIDIA for providing GPUs and acknowledge support from NSF 1452851, 1526367.  ... 
doi:10.1109/cvpr.2017.82 dblp:conf/cvpr/ParkYYCB17 fatcat:ltj2uqgrvje65lpo7h2fozbdze

Transformation-Grounded Image Generation Network for Novel 3D View Synthesis [article]

Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alexander C. Berg
2017 arXiv   pre-print
We present a transformation-grounded image generation network for novel 3D view synthesis from a single image.  ...  Instead of taking a 'blank slate' approach, we first explicitly infer the parts of the geometry visible both in the input and novel views and then re-cast the remaining synthesis problem as image completion  ...  We would like to thank Weilin Sun, Guilin Liu, True Price, and Dinghuang Ji for helpful discussions. We thank NVIDIA for providing GPUs and acknowledge support from NSF 1452851, 1526367.  ... 
arXiv:1703.02921v1 fatcat:acvd3262zrg7ra7rwajo3tg65q

Geometry-Aware Deep Network for Single-Image Novel View Synthesis

Miaomiao Liu, Xuming He, Mathieu Salzmann
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
This paper tackles the problem of novel view synthesis from a single image.  ...  Modern, learning-based approaches mostly focus on appearance to synthesize novel views and thus tend to generate predictions that are inconsistent with the underlying scene structure.  ...  The Titan X used for this research was donated by the NVIDIA Corporation.  ... 
doi:10.1109/cvpr.2018.00485 dblp:conf/cvpr/LiuHS18 fatcat:x4ss6im5zbfjnjkx2csx3oxite

Novel View Synthesis from Single Images via Point Cloud Transformation [article]

Hoang-An Le, Thomas Mensink, Partha Das, Theo Gevers
2020 arXiv   pre-print
The benefit of using point clouds as an explicit 3D shape for novel view synthesis is experimentally validated on the 3D ShapeNet benchmark.  ...  In this paper the argument is made that for true novel view synthesis of objects, where the object can be synthesized from any viewpoint, an explicit 3D shape representation isdesired.  ...  Introduction Novel view synthesis aims to infer the appearance of an object from unobserved points of view.  ... 
arXiv:2009.08321v2 fatcat:s4lwx2vsobbxnbuwdiizw32vvm

Dynamic View Synthesis from Dynamic Monocular Video [article]

Chen Gao, Ayush Saraf, Johannes Kopf, Jia-Bin Huang
2021 arXiv   pre-print
We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene.  ...  We show extensive quantitative and qualitative results of dynamic view synthesis from casually captured videos.  ...  Several methods tackle novel view synthesis from one single input image.  ... 
arXiv:2105.06468v1 fatcat:fvwki3byd5fu3fclqvjyun5yoe

Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes [article]

Zhengqi Li, Simon Niklaus, Noah Snavely, Oliver Wang
2021 arXiv   pre-print
We present a method to perform novel view and time synthesis of dynamic scenes, requiring only a monocular video with known camera poses as input.  ...  To do this, we introduce Neural Scene Flow Fields, a new representation that models the dynamic scene as a time-variant continuous function of appearance, geometry, and 3D scene motion.  ...  Novel view and time synthesis.  ... 
arXiv:2011.13084v3 fatcat:obseifvswzbzxonqo74siddgbe

Space-time Neural Irradiance Fields for Free-Viewpoint Video [article]

Wenqi Xian, Jia-Bin Huang, Johannes Kopf, Changil Kim
2021 arXiv   pre-print
The 3D geometry of a scene can be legitimately represented in numerous ways since varying geometry (motion) can be explained with varying appearance and vice versa.  ...  We present a method that learns a spatiotemporal neural irradiance field for dynamic scenes from a single video. Our learned representation enables free-viewpoint rendering of the input video.  ...  We thank Ayush Saraf for his help with distributed training. All photos of individuals in this paper are used with permission.  ... 
arXiv:2011.12950v2 fatcat:rq65vtccazgmfmovp756vqa7du

Learning Dynamic View Synthesis With Few RGBD Cameras [article]

Shengze Wang, YoungJoong Kwon, Yuan Shen, Qian Zhang, Andrei State, Jia-Bin Huang, Henry Fuchs
2022 arXiv   pre-print
There have been significant advancements in dynamic novel view synthesis in recent years.  ...  We introduce a simple Regional Depth-Inpainting module that adaptively inpaints missing depth values to render complete novel views.  ...  Dynamic Novel View Synthesis Dynamic Novel View Synthesis of General Scenes Dynamic novel view synthesis is the task of performing novel view synthesis for dynamic scenes.  ... 
arXiv:2204.10477v2 fatcat:tfortvxrwrcthkcrnbxjdslf7y

Deep 3D-Zoom Net: Unsupervised Learning of Photo-Realistic 3D-Zoom [article]

Juan Luis Gonzalez Bello, Munchurl Kim
2019 arXiv   pre-print
Even though there is no baseline to fairly compare our results, our method outperforms previous novel view synthesis research in terms of realistic appearance on large camera baselines.  ...  We present a novel unsupervised framework to learn how to generate arbitrarily 3D-zoomed versions of a single image, not requiring a 3D-zoom ground truth, called the Deep 3D-Zoom Net.  ...  In contrast with other novel view synthesis techniques like [3, 21, 10] , which estimate a fixed novel view depending on the input views, our network architecture allows for novel view generation with  ... 
arXiv:1909.09349v2 fatcat:wipuhls5fjexbj7tpftnz7yrp4

Multi-view to Novel View: Synthesizing Novel Views With Self-learned Confidence [chapter]

Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, Joseph J. Lim
2018 Lecture Notes in Computer Science  
Keywords: Novel view synthesis, multi-view novel view synthesis Code is available on our website https://shaohua0116.github.io/Multiview2Novelview  ...  In this paper, we address the task of multi-view novel view synthesis, where we are interested in synthesizing a target image with an arbitrary camera pose from given source images.  ...  The authors are grateful to Youngwoon Lee and Hyeonwoo Noh for helpful discussions about this work.  ... 
doi:10.1007/978-3-030-01219-9_10 fatcat:x54uve2m4zdnrgcvlnczfjp67i

3D Moments from Near-Duplicate Photos [article]

Qianqian Wang, Zhengqi Li, David Salesin, Noah Snavely, Brian Curless, Janne Kontkanen
2022 arXiv   pre-print
To achieve this effect, we represent the scene as a pair of feature-based layered depth images augmented with scene flow.  ...  Our system produces photorealistic space-time videos with motion parallax and scene dynamics, while plausibly recovering regions occluded in the original views.  ...  We thank Richard Tucker, Tianfan Xue, Andrew Liu, Jamie Aspinall, Fitsum Reda and Forrester Cole for help, discussion and support.  ... 
arXiv:2205.06255v1 fatcat:ckszn3gvfreaxpstyb443taboi

High-Quality Video Generation from Static Structural Annotations

Lu Sheng, Junting Pan, Jiaming Guo, Jing Shao, Chen Change Loy
2020 International Journal of Computer Vision  
We employ a cycle-consistent flow-based conditioned variational autoencoder to capture the long-term motion distributions, by which the learned bi-directional flows ensure the physical reliability of the  ...  This paper proposes a novel unsupervised video generation that is conditioned on a single structural annotation map, which in contrast to prior conditioned video generation approaches, provides a good  ...  flow (Liu et al. 2017) , gaze direction detection (Ganin et al. 2016 ) and novel view synthesis (Zhou et al. 2016) .  ... 
doi:10.1007/s11263-020-01334-x fatcat:yedge4qmcbd2jpyz6bo3n5fbqe
« Previous Showing results 1 — 15 out of 111,683 results