Multimodal detection and tracking of pedestrians in urban environments with explicit ground plane extraction

L. Spinello, R. Triebel, R. Siegwart
2008 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems  
This paper presents a novel people detection and tracking method based on a combined multimodal sensor approach that utilizes 2D and 3D laser range and camera data. Laser data points are clustered and classified with a set of geometrical features using an SVM AdaBoost method. The clusters define a region of interest in the image that is adjusted using the ground plane information extracted from the 3D laser. In this areas a novel vision based people detector based on Implicit Shape Model (ISM)
more » ... s applied. Each detected person is tracked using a greedy data association technique and multiple Extended Kalman Filters that use different motion models. This way, the filter can cope with a variety of different motion patterns. The tracker is asynchronously updated by the detections from the laser and the camera data. Experiments conducted in real-world outdoor scenarios with crowds of pedestrians demonstrate the usefulness of our approach.
doi:10.1109/iros.2008.4651109 dblp:conf/iros/SpinelloTS08 fatcat:fqtinh4yrnfpjchgurc24xoj7m