Hybrid Person Detection and Tracking in H.264/AVC Video Streams

Philipp Wojaczek, Marcus Laumer, Peter Amon, Andreas Hutter, André Kaup
2015 Proceedings of the 10th International Conference on Computer Vision Theory and Applications  
In this paper we present a new hybrid framework for detecting and tracking persons in surveillance video streams compressed according to the H.264/AVC video coding standard. The framework consists of three stages and operates in both the compressed and the pixel domain of the video. The combination of compressed and pixel domain represents the hybrid character. Its main objective is to significantly reduce the amount of computation required, in particular for frames and image regions with few
more » ... ople present. In its first stage the proposed framework evaluates the header information for each compressed frame in the video sequence, namely the macroblock type information. This results in a coarse binary mask segmenting the frame into foreground and background. Only the foreground regions are processed further in the second stage that searches for persons in the image pixel domain by applying a person detector based on the Implicit Shape Model. The third stage segments each detected person further with a newly developed method that fuses information from the first two stages. This helps obtaining a finer segmentation for calculating a color histogram suitable for tracking the person using the mean shift algorithm. The proposed framework was experimentally evaluated on a publicly available test set. The results demonstrate that the proposed framework reliably separates frames with and without persons such that the computational load is significantly reduced while the detection performance is kept. RELATED WORK There exists a large number of approaches to fulfill the task of person detection. For instance, among different possibilities for representing objects, like rectangular or elliptical patches or silhouettes, (Yilmaz et al., 2006 ) present a survey on object detection, seg-478 Wojaczek P., Laumer M., Amon P., Hutter A. and Kaup A.. Hybrid Person Detection and Tracking in H.264/AVC Video Streams.
doi:10.5220/0005296704780485 dblp:conf/visapp/WojaczekLAHK15 fatcat:flxx7ddw7fg5nhzdg4js7fuqv4