Monocular real-time 3D articulated hand pose estimation

Javier Romero, Hedvig Kjellstrom, Danica Kragic
2009 2009 9th IEEE-RAS International Conference on Humanoid Robots  
Markerless, vision based estimation of human hand pose over time is a prerequisite for a number of robotics applications, such as Learning by Demonstration (LbD), health monitoring, teleoperation, human-robot interaction. It has special interest in humanoid platforms, where the number of degrees of freedom makes conventional programming challenging. Our primary application is LbD in natural environments where the humanoid robot learns how to grasp and manipulate objects by observing a human
more » ... orming a task. This paper presents a method for continuous vision based estimation of human hand pose. The method is non-parametric, performing a nearest neighbor search in a large database (100000 entries) of hand pose examples. The main contribution is a real time system, robust to partial occlusions and segmentation errors, that provides full hand pose recognition from markerless data. An additional contribution is the modeling of constraints based on temporal consistency in hand pose, without explicitly tracking the hand in the high dimensional pose space. The pose representation is rich enough to enable a descriptive humanto-robot mapping. Experiments show the pose estimation to be more robust and accurate than a non-parametric method without temporal constraints.
doi:10.1109/ichr.2009.5379596 dblp:conf/humanoids/RomeroKK09 fatcat:f62oywjbm5a2hh3pdtdlr3ud5m