Deep Image Retrieval: Learning global representations for image search [article]

Albert Gordo, Jon Almazan, Jerome Revaud, Diane Larlus
<span title="2016-07-28">2016</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
We propose a novel approach for instance-level image retrieval. It produces a global and compact fixed-length representation for each image by aggregating many region-wise descriptors. In contrast to previous works employing pre-trained deep networks as a black box to produce features, our method leverages a deep architecture trained for the specific task of image retrieval. Our contribution is twofold: (i) we leverage a ranking framework to learn convolution and projection weights that are
more &raquo; ... to build the region features; and (ii) we employ a region proposal network to learn which regions should be pooled to form the final global descriptor. We show that using clean training data is key to the success of our approach. To that aim, we use a large scale but noisy landmark dataset and develop an automatic cleaning approach. The proposed architecture produces a global image representation in a single forward pass. Our approach significantly outperforms previous approaches based on global descriptors on standard datasets. It even surpasses most prior works based on costly local descriptor indexing and spatial verification. Additional material is available at www.xrce.xerox.com/Deep-Image-Retrieval.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1604.01325v2">arXiv:1604.01325v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/neulmvop7beinpegiirexv3zcq">fatcat:neulmvop7beinpegiirexv3zcq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200913135702/https://arxiv.org/pdf/1604.01325v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/c5/06/c50630e485d3c7785ea9e1f3bff35ea00e926a56.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1604.01325v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>