Spatio-temporal ToF data enhancement by fusion

Frederic Garcia, Djamila Aouada, Bruno Mirbach, Bjorn Ottersten
2012 2012 19th IEEE International Conference on Image Processing  
We propose an extension of our previous work on spatial domain Time-of-Flight (ToF) data enhancement to the temporal domain. Our goal is to generate enhanced depth maps at the same frame rate of the 2-D camera that, coupled with a ToF camera, constitutes a hybrid ToF multi-camera rig. To that end, we first estimate the motion between consecutive 2-D frames, and then use it to predict their corresponding depth maps. The enhanced depth maps result from the fusion between the recorded 2-D frames
more » ... d the predicted depth maps by using our previous contribution on ToF data enhancement. The experimental results show that the proposed approach overcomes the ToF camera drawbacks; namely, low resolution in space and time and high level of noise within depth measurements, providing enhanced depth maps at video frame rate. Index Terms-Time of Flight, spatio-temporal data enhancement, sensor fusion, multimodal sensors.
doi:10.1109/icip.2012.6467026 dblp:conf/icip/GarciaAMO12 fatcat:kyyehygebbemtmzppb7hblf6nq