Visible-Thermal Pedestrian Detection via Unsupervised Transfer Learning

Chengjin Lyu, Patrick Heyer, Asad Munir, Ljiljana Platisa, Christian Micheloni, Bart Goossens, Wilfried Philips
2021 2021 the 5th International Conference on Innovation in Artificial Intelligence  
Recently, pedestrian detection using visible-thermal pairs plays a key role in around-the-clock applications, such as public surveillance and autonomous driving. However, the performance of a well-trained pedestrian detector may drop significantly when it is applied to a new scenario. Normally, to achieve a good performance on the new scenario, manual annotation of the dataset is necessary, while it is costly and unscalable. In this work, an unsupervised transfer learning framework is proposed
more » ... or visible-thermal pedestrian detection tasks. Given well-trained detectors from a source dataset, the proposed framework utilizes an iterative process to generate and fuse training labels automatically, with the help of two auxiliary single-modality detectors (visible and thermal). To achieve label fusion, the knowledge of daytime and nighttime is adopted to assign priorities to labels according to their illumination, which improves the quality of generated training labels. After each iteration, the existing detectors are updated using new training labels. Experimental results demonstrate that the proposed method obtains state-of-the-art performance without any manual training labels on the target dataset.
doi:10.1145/3461353.3461369 fatcat:qwvzmqd5cjd2dhso3z3cvc7fyq