Filters








18,037 Hits in 9.1 sec

Real-time pose and shape reconstruction of two interacting hands with a single depth camera

Franziska Mueller, Micah Davis, Florian Bernard, Oleksandr Sotnychenko, Mickeal Verschoor, Miguel A. Otaduy, Dan Casas, Christian Theobalt
2019 ACM Transactions on Graphics  
We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands.  ...  Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less, uses a single consumer-level depth camera, runs in real time, handles  ...  ACKNOWLEDGMENTS The authors would like to thank all participants of the live recordings. The work was supported by the ERC Consolidator Grants 4DRepLy (770784) and TouchDesign (772738).  ... 
doi:10.1145/3306346.3322958 fatcat:no6xzoth3bclhiwgsya7p4ajqy

RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video [article]

Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, Christian Theobalt
2021 arXiv   pre-print
In contrast, in this work we present the first real-time method for motion capture of skeletal pose and 3D surface geometry of hands from a single RGB camera that explicitly considers close interactions  ...  Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR,  ...  ACKNOWLEDGMENTS The work was supported by the ERC Consolidator Grants 4DRepLy (770784) and TouchDesign (772738) and Spanish Ministry of Science (RTI2018-098694-B-I00 VizLearning).  ... 
arXiv:2106.11725v1 fatcat:esmiakdncjco3cb6uhdzaqosoq

Survey on depth and RGB image-based 3D hand shape and pose estimation

Lin Huang, Boshen Zhang, Zhilin Guo, Yang Xiao, Zhiguo Cao, Junsong Yuan
2021 Virtual Reality & Intelligent Hardware  
In this study, we present a comprehensive survey of state-of-the-art 3D hand shape and pose estimation approaches using RGB-D cameras.  ...  hand shape and pose estimation.  ...  SynHand5M [91] is a synthetic dataset that focuses on hand shape and pose reconstruction, and it provides depth hand data that are abundantly diverse in shapes and poses, more so than some existing real  ... 
doi:10.1016/j.vrih.2021.05.002 fatcat:4tbhftt3ira6fporaqlscqhsse

KinectFusion

Shahram Izadi, Andrew Davison, Andrew Fitzgibbon, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman
2011 Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11  
Only the depth data from Kinect is used to track the 3D pose of the sensor and reconstruct, geometrically precise, 3D models of the physical scene in real-time.  ...  Figure 1 : KinectFusion enables real-time detailed 3D reconstructions of indoor scenes using only the depth data from a standard Kinect camera. A) user points Kinect at coffee table scene.  ...  To achieve this, our system continually tracks the 6DOF pose of the camera and fuses live depth data from the camera into a single global 3D model in real-time.  ... 
doi:10.1145/2047196.2047270 dblp:conf/uist/IzadiKHMNKSHFDF11 fatcat:lynzj77d4zamzfqhchahrdvleu

Local and Global Point Cloud Reconstruction for 3D Hand Pose Estimation [article]

Ziwei Yu, Linlin Yang, Shicheng Chen, Angela Yao
2021 arXiv   pre-print
This paper addresses the 3D point cloud reconstruction and 3D pose estimation of the human hand from a single RGB image.  ...  To that end, we present a novel pipeline for local and global point cloud reconstruction using a 3D hand template while learning a latent representation for pose estimation.  ...  Real-time pose and shape reconstruction of two interacting hands with a single depth camera.  ... 
arXiv:2112.06389v1 fatcat:n6zujacknrfqllnld4vaulia5m

DoubleFusion: Real-Time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor

Tao Yu, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Qionghai Dai, Hao Li, Gerard Pons-Moll, Yebin Liu
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
inner human body shape from a single depth camera.  ...  We propose DoubleFusion, a new real-time system that combines volumetric dynamic reconstruction with datadriven template fitting to simultaneously reconstruct detailed geometry, non-rigid motion and the  ...  [41] considered the case of multiple Kinects input. Ye et al. [42] adopted a similar skinned model to estimate shape and pose parameters using a single-view depth camera in real-time.  ... 
doi:10.1109/cvpr.2018.00761 dblp:conf/cvpr/YuZGZDLPL18 fatcat:udcyrt6tqnewffcxofiskcpn3e

DoubleFusion: Real-time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor [article]

Tao Yu, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Qionghai Dai, Hao Li, Gerard Pons-Moll, Yebin Liu
2018 arXiv   pre-print
inner human body shape from a single depth camera.  ...  We propose DoubleFusion, a new real-time system that combines volumetric dynamic reconstruction with data-driven template fitting to simultaneously reconstruct detailed geometry, non-rigid motion and the  ...  [41] considered the case of multiple Kinects input. Ye et al. [42] adopted a similar skinned model to estimate shape and pose parameters using a single-view depth camera in real-time.  ... 
arXiv:1804.06023v1 fatcat:qhxsifv575h5lcc7of6l4h2myq

STAR3D: Simultaneous Tracking and Reconstruction of 3D Objects Using RGB-D Data

Carl Yuheng Ren, Victor Prisacariu, David Murray, Ian Reid
2013 2013 IEEE International Conference on Computer Vision  
The framework is initialized with a simple shape primitive model (e.g. a sphere or a cube), and the real 3D object shape is tracked and reconstructed online.  ...  We introduce a probabilistic framework for simultaneous tracking and reconstruction of 3D rigid objects using an RGB-D camera.  ...  With a single hand-held Kinect device, KinectFusion can incrementally reconstruct the surface of the physical world that the camera sees, in real-time.  ... 
doi:10.1109/iccv.2013.197 dblp:conf/iccv/RenPMR13 fatcat:3dywhvyb4zg5tg2afkxzvjfgw4

Real-time non-rigid reconstruction using an RGB-D camera

Michael Zollhöfer, Christian Theobalt, Marc Stamminger, Matthias Nießner, Shahram Izadi, Christoph Rehmann, Christopher Zach, Matthew Fisher, Chenglei Wu, Andrew Fitzgibbon, Charles Loop
2014 ACM Transactions on Graphics  
Figure 1 : Our system enables the real-time capture of general shapes undergoing non-rigid deformations using a single depth camera.  ...  Abstract We present a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time.  ...  Acknowledgements We would like to thank Angela Dai for the video voice over, Frank Bauer for help with renderings, and Hao Li for comparison data.  ... 
doi:10.1145/2601097.2601165 fatcat:73cjsla3njfwpnuyle4a36lavq

Performance Capture of Interacting Characters with Handheld Kinects [chapter]

Genzhi Ye, Yebin Liu, Nils Hasler, Xiangyang Ji, Qionghai Dai, Christian Theobalt
2012 Lecture Notes in Computer Science  
Our method reconstructs human skeletal poses, deforming surface geometry and camera poses for every time step of the depth video.  ...  Skeletal configurations and camera poses are found by solving a joint energy minimization problem which optimizes the alignment of RGBZ data from all cameras, as well as the alignment of human shape templates  ...  Estimation of complex poses from a single video stream is still a very challenging task, in particular if interactive or real-time frame rates are the goal [6] .  ... 
doi:10.1007/978-3-642-33709-3_59 fatcat:5wpw5e6mpbaqhdx7wlv34hh5s4

Neural Hand Reconstruction Using A Single RGB Image

Mengcheng Li, Liang An, Tao Yu, Yangang Wang, Feng Chen, Yebin Liu
2020 Virtual Reality & Intelligent Hardware  
This study presents a neural hand reconstruction method for monocular 3D hand pose and shape estimation.  ...  Methods Alternate to directly representing hand with 3D data, a novel UV position map is used to represent a hand pose and shape with 2D data that maps 3D hand surface points to 2D image space.  ...  Hand pose and shape from single image Hand pose and shape estimation from an image is an ill-posed problem, wherein the main challenges are depth ambiguity and occlusion (such as self-occlusion and object  ... 
doi:10.1016/j.vrih.2020.05.001 fatcat:t5pla5dkufgvxeqrxbwoen4fq4

Learning Joint Reconstruction of Hands and Manipulated Objects

Yana Hasson, Gul Varol, Dimitrios Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, Cordelia Schmid
2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
Previous work has made significant progress towards reconstruction of hand poses and object shapes in isolation.  ...  In this work, we regularize the joint reconstruction of hands and objects with manipulation constraints.  ...  MJB has received research gift funds from Intel, Nvidia, Adobe, Facebook, and Amazon. While MJB is a part-time employee of Amazon, his research was performed solely at, and funded solely by, MPI.  ... 
doi:10.1109/cvpr.2019.01208 dblp:conf/cvpr/HassonVTKBLS19 fatcat:qoqkxbnpd5gx5n4swel34ytup4

Learning joint reconstruction of hands and manipulated objects [article]

Yana Hasson, Gül Varol, Dimitrios Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, Cordelia Schmid
2019 arXiv   pre-print
Previous work has made significant progress towards reconstruction of hand poses and object shapes in isolation.  ...  In this work, we regularize the joint reconstruction of hands and objects with manipulation constraints.  ...  MJB has received research gift funds from Intel, Nvidia, Adobe, Facebook, and Amazon. While MJB is a part-time employee of Amazon, his research was performed solely at, and funded solely by, MPI.  ... 
arXiv:1904.05767v1 fatcat:mzkmscajc5ab5byjdowqywu4zm

EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Stream [article]

Viktor Rudnev and Vladislav Golyanik and Jiayi Wang and Hans-Peter Seidel and Franziska Mueller and Mohamed Elgharib and Christian Theobalt
2021 arXiv   pre-print
Our EventHands approach has characteristics previously not demonstrated with a single RGB or depth camera such as high temporal resolution at low data throughputs and real-time performance at 1000 Hz.  ...  Experiments show that EventHands outperforms recent monocular methods using a colour (or depth) camera in terms of accuracy and its ability to capture hand motions of unprecedented speed.  ...  We thank Jalees Nehvi and Navami Kairanda for help with comparisons.  ... 
arXiv:2012.06475v3 fatcat:fx5frkvw75botn7sjurvruwpgu

Single-Shot 3D Multi-Person Shape Reconstruction from a Single RGB Image

Seong Hyun Kim, Ju Yong Chang
2020 Entropy  
Although the performance of the 3D human shape reconstruction method has improved considerably in recent years, most methods focus on a single person, reconstruct a root-relative 3D shape, and rely on  ...  The proposed network can be learned in an end-to-end manner and process images at about 37 fps to perform the 3D multi-person shape reconstruction task in real time.  ...  Conflicts of Interest: The authors declare no conflict of interest.  ... 
doi:10.3390/e22080806 pmid:33286577 pmcid:PMC7517376 fatcat:hous76lq7rdttkcxlp7rue5gee
« Previous Showing results 1 — 15 out of 18,037 results