Real-time probabilistic fusion of sparse 3D LIDAR and dense stereo

Will Maddern, Paul Newman
2016 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)  
Real-time 3D perception is critical for localisation, mapping, path planning and obstacle avoidance for mobile robots and autonomous vehicles. For outdoor operation in real-world environments, 3D perception is often provided by sparse 3D LIDAR scanners, which provide accurate but lowdensity depth maps, and dense stereo approaches, which require significant computational resources for accurate results. Here, taking advantage of the complementary error characteristics of LIDAR range sensing and
more » ... range sensing and dense stereo, we present a probabilistic method for fusing sparse 3D LIDAR data with stereo images to provide accurate dense depth maps and uncertainty estimates in real-time. We evaluate the method on data collected from a small urban autonomous vehicle and the KITTI dataset, providing accuracy results competitive with state-of-the-art stereo approaches and credible uncertainty estimates that do not misrepresent the true errors, and demonstrate real-time operation on a range of low-power GPU systems.
doi:10.1109/iros.2016.7759342 dblp:conf/iros/MaddernN16 fatcat:lf2t5g7bxfczjorxvtkdc2nqbi