Parallax‐based second‐order mixed attention for stereo image super‐resolution

Chenyang Duan, Nanfeng Xiao
<span title="2021-06-19">2021</span> <i title="Institution of Engineering and Technology (IET)"> <a target="_blank" rel="noopener" href="" style="color: black;">IET Computer Vision</a> </i> &nbsp;
Stereo image pairs can effectively enhance the performance of super-resolution (SR) since both intra-view and cross-view information can be used. However, exploiting cross-view information accurately is extremely challenging. Most recent methods use the attention mechanism to get stereo correspondence. But these methods ignore the high-frequency information since they only utilise first-order statistics, which leads to reducing the discriminative ability of the network. To address this issue,
more &raquo; ... this work, a parallax-based second-order mixed attention stereo SR network (PSMASSRnet) is proposed to integrate the cross-view information from a stereo image pair for SR. Specifically, a novel parallaxbased second-order mixed attention module (PSMAM) is developed to combine secondorder channel features and spatial features to obtain more discriminative representations. Furthermore, a dense cross-atrous spatial pyramid pooling (ASPP) module is also presented, which can effectively explore the local and the multi-scale features with different dilation rates to extract more discriminative features with fewer parameters and less execution. The extensive experiments on the KITTI2012, KITTI2015 and Middlebury datasets have demonstrated the superiority of the proposed PSMASSRnet over the stateof-the-art methods in the aspects of both the quantitative metrics and the visual quality.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="">doi:10.1049/cvi2.12063</a> <a target="_blank" rel="external noopener" href="">fatcat:mghofhx75zdu3cawc5wxlw3ufy</a> </span>
<a target="_blank" rel="noopener" href="" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href=""> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / </button> </a>