Learning multi-planar scene models in multi-camera videos

Fei Yin, Tim Ellis, Sergio A. Velastin, Dimitrios Makris
2015 IET Computer Vision  
Many man-made environments are constructed with multiple levels where people walk, joined by stairs, ramps and overpasses. This paper proposes a novel method to learn the geometry of a scene containing more than a single ground plane by tracking pedestrians and combining information from multiple views. The method estimates a scene model with multiple planes by measuring the variation of pedestrian heights across each camera's field of view. It segments the image into separate plane regions,
more » ... imating the relative depth and altitude for each image pixel, building a 3D reconstruction of the scene. By estimating the multiple planes, the method enables tracking algorithms to follow objects (pedestrians and/or vehicles) that are moving on different ground planes in the scene. We also introduce what we believe is the first public dataset with pedestrian traffic on multiple planes to encourage other researchers to compare their work in this field.
doi:10.1049/iet-cvi.2013.0261 fatcat:65pfilnd3rhkzb77podgn5g2am