Learning Fully Convolutional Network for Visual Tracking with Multi-layer Feature Fusion

Yangliu Kuai, Gongjian Wen, Dongdong Li
<span title="">2019</span> <i title="Institute of Electrical and Electronics Engineers (IEEE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/q7qi7j4ckfac7ehf3mjbso4hne" style="color: black;">IEEE Access</a> </i> &nbsp;
Convolutional neural networks are powerful models that yield hierarchies of features. In the paper, we present a new approach for general object tracking based on the fully convolutional network with multi-layer feature fusion. The designed network combines semantic information from deep, coarse layers, and appearance information from shallow, fine layers to make accurate pixel-wise objectness prediction. The network is first pretrained offline using a large set of videos with annotated heatmap
more &raquo; ... groundtruths to obtain a general notion of foreground objects, and later fine-tuned using the first frame to adapt to the particular object instance. In online tracking, the location corresponding to the maximum target objectness in the search image is determined as the new target location, and the scale estimation is handled by incorporating a correlation filter branch into the network. An efficient updating strategy is proposed to further improve tracking performance. The extensive experiments performed on the widely used tracking benchmark OTB100 show that the proposed algorithm outperforms many other state-of-the-art trackers. INDEX TERMS FCN, feature fusion, pixel-wise objectness, two-step training, updating strategy.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/access.2019.2899023">doi:10.1109/access.2019.2899023</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/b2xsb57ph5g5jmuflklxctadqm">fatcat:b2xsb57ph5g5jmuflklxctadqm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210428204424/https://ieeexplore.ieee.org/ielx7/6287639/8600701/08643772.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5d/03/5d037cebe5aba86c390fa933f9f3ef3aacce4f0f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/access.2019.2899023"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> ieee.com </button> </a>