11 Hits in 10.4 sec

Room Layout Estimation with Object and Material Attributes Information Using a Spherical Camera

Hansung Kim, Teofilo de Campos, Adrian Hilton
2016 2016 Fourth International Conference on 3D Vision (3DV)  
Cubic projection images of the spherical RGB and estimated depth are used for object and material attribute detection.  ...  A spherical stereo alignment algorithm is proposed to align two spherical images to the global world coordinate system. Depth information of the scene is estimated by stereo matching between images.  ...  The authors would like to thank Sam Fowler for his contribution to the ground-truth data generation.  ... 
doi:10.1109/3dv.2016.83 dblp:conf/3dim/KimCH16 fatcat:xn6jec6zqbgfjnzwlxtzps2dcm

Review on Panoramic Imaging and Its Applications in Scene Understanding [article]

Shaohua Gao, Kailun Yang, Hao Shi, Kaiwei Wang, Jian Bai
2022 arXiv   pre-print
We further offer a detailed analysis of applications of panoramic imaging in scene understanding for autonomous driving and robotics, spanning panoramic semantic image segmentation, panoramic depth estimation  ...  Finally, we cast a perspective on future potential and research directions for panoramic imaging instruments.  ...  Further, stereo omnidirectional cameras have been put use in [305] , [306] .  ... 
arXiv:2205.05570v1 fatcat:p77fuqtz2re7zna7kapypcwv5i


V. V. Gribova, V. O. Strekalev
2020 Vestnik komp iuternykh i informatsionnykh tekhnologii  
An overview of existing solutions such as tools for the development and reproduction of virtual simulators is considered.  ...  The architecture of the instrumental complex for the creation and reproduction of immersive virtual simulators using biological feedback is proposed.  ...  There are many more monocular depth cues than stereo, which explains why we are able to infer so much depth information from a single photograph. Figure 6 .1 shows an example.  ... 
doi:10.14489/vkit.2020.08.pp.019-028 fatcat:nyet4p3qkvecliahuktcjbkwbu

Roadmap on 3D Integral Imaging: Sensing, Processing, andDisplay

Bahram Javidi, Artur Carnicer, Jun Arai, Toshiaki Fujii, Hong Hua, Hongen Liao, Manuel Martinez-Corral, Filiberto Pla, Adrian Stern, Laura Waller, Qiong-Hua Wang, Gordon Wetzstein (+2 others)
2020 Optics Express  
The paper consists of a series of 15 sections from the experts presenting various aspects of the field on sensing, processing, displays, augmented reality, microscopy, object recognition, and other applications  ...  Here too, the duality of light field imaging and display is important, although light field camera systems for VR/AR are primarily used to capture omnidirectional stereo panoramas (e.g., [102, 103] ).  ...  Such an approach to cinematic VR allows immersive events to be captured and later replayed in VR while providing stereoscopic depth cues for 360 • viewing experiences.  ... 
doi:10.1364/oe.402193 pmid:33114917 fatcat:hcht47xbr5fyfed5b6fjpu2h44

OmniSyn: Synthesizing 360 Videos with Wide-baseline Panoramas [article]

David Li, Yinda Zhang, Christian Häne, Danhang Tang, Amitabh Varshney, Ruofei Du
OmniSyn predicts omnidirectional depth maps using a spherical cost volume and a monocular skip connection, renders meshes in 360° images, and synthesizes intermediate views with a fusion network.  ...  We envision our work may inspire future research for this unheeded real-world task and eventually produce a smoother experience for navigating immersive maps.  ...  [22] develop Casual 3D photography, an algorithm which creates 5-DoF 360 • scenes from 180 • fisheye cameras.  ... 
doi:10.48550/arxiv.2202.08752 fatcat:phdiwtjqhffnbjwb3dzuvuxfhu

A Tiny Diagnostic Dataset and Diverse Modules for Learning-Based Optical Flow Estimation [article]

Shuang Xie, University, My, University, My
Compared with the original model, the model with the deformable module clearly reduces boundary blur and achieves a large improvement on the MPI sintel dataset, an omni-directional stereo (ODS) and a novel  ...  In this case, real-time stereo estimation is necessary for livestreaming of VR content with 6 DoF.  ...  The depth map can be combined with a color panorama to produce a 3D mesh thus providing full 6 DoF viewing. In this case, the extract video is able to live-streaming the VR content with 6 DoF.  ... 
doi:10.20381/ruor-23877 fatcat:qntlgyg3drdo7jlb352fmoxozu

Steered mixture-of-experts for image and light field representation, processing, and coding

Ruben Verhack, Technische Universität Berlin, Peter Lambert, Thomas Sikora
Virtual reality for camera-recorded scenes is fundamentally different from the VR experience of, for example, computer games.  ...  Currently, 360-degree video is the primary form of immersive experience of camera-recorded images (CC-VR), but it is not yet sufficient for a full VR experience.  ...  Towards 6-Degrees-of-Freedom CC-VR In standardization, industry and academia, efforts are made in order to accommodate 6-DoF CC-VR.  ... 
doi:10.14279/depositonce-10270 fatcat:m2gs3scxorexvoid5plvgf5k5m

Active robot vision: from state estimation to motion planning

Zichao Zhang
This work was supported by the Swedish Foundation for Strategic Research (Semantic Mapping and Visual Navigation for Smart Robots), the Chalmers AI Research Centre (CHAIR) (VisLocLearn), the National Centre  ...  We thank Mihai Dusmanu and Martin Humenberger for contributing the D2-Net and R2D2 results, respectively.  ...  To overcome this drawback, we proposed a dedicated map representation for 6 DoF perception-aware planning.  ... 
doi:10.5167/uzh-191571 fatcat:ghln7gn2vfasdn5o6643sfazva

User experience with the technology of virtual reality in the context of training and learning in vocational education [article]

Qi Guo, Universität Stuttgart
The virtual reality (VR) technology, with its features of simulation, interaction, and gamification, as well as the various technical aspects of input and output for movements and feedback, provides learners  ...  Based on the literature review, the empirical studies, as well as practical experience in the development of the VR training and learning environments, the recommendations for the design, development,  ...  Several new VR technology systems with stand-alone glasses and 6-DoF freedom have been on the market in 2020.  ... 
doi:10.18419/opus-11795 fatcat:q6tkgnyaabfynfxjjzkgcrayfe

Interactive Fiction in Cinematic Virtual Reality: Epistemology, Creation and Evaluation [article]

In order to set the foundations for the creation of interactive VR fiction films, I dissect the IFcVR by investigating the aesthetics, narratological and interactive notions that converge and diverge in  ...  it, proposing a medium-conscious narratology for this kind of artefact.  ...  VR looks not only for a verisimilar representation of an environment that augments the feeling of immersion, but for the possibility to physically interact with such VE.  ... 
doi:10.15167/reyes-redondo-maria-cecilia_phd2019-05-30 fatcat:whgzwepdujhvvkhrtaxfbktttm

Compression and visual quality assessment for light field contents

Irene Viola
Thank you for always believing in me, for encouraging my dreams, for supporting my every decision, no matter how far away it was bringing me from you.  ...  Finally, I would like to thank my family, for the endless support they provided during these years.  ...  Touradj Ebrahimi for supporting my PhD studies. I am beyond grateful for the endless opportunities he provided to help me grow and flourish as a researcher.  ... 
doi:10.5075/epfl-thesis-7185 fatcat:kbuoddkzwzexvgixeinz3z4yc4