An Iterative and Cooperative Top-Down and Bottom-Up Inference Network for Salient Object Detection

Wenguan Wang, Jianbing Shen, Ming-Ming Cheng, Ling Shao
2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
This paper presents a salient object detection method that integrates both top-down and bottom-up saliency inference in an iterative and cooperative manner. The topdown process is used for coarse-to-fine saliency estimation, where high-level saliency is gradually integrated with finer lower-layer features to obtain a fine-grained result. The bottom-up process infers the high-level, but rough saliency through gradually using upper-layer, semantically-richer features. These two processes are
more » ... natively performed, where the bottom-up process uses the fine-grained saliency obtained from the top-down process to yield enhanced highlevel saliency estimate, and the top-down process, in turn, is further benefited from the improved high-level information. The network layers in the bottom-up/top-down processes are equipped with recurrent mechanisms for layerwise, step-by-step optimization. Thus, saliency information is effectively encouraged to flow in a bottom-up, top-down and intra-layer manner. We show that most other saliency models based on fully convolutional networks (FCNs) are essentially variants of our model. Extensive experiments on several famous benchmarks clearly demonstrate the superior performance, good generalization, and powerful learning ability of our proposed saliency inference framework.
doi:10.1109/cvpr.2019.00612 dblp:conf/cvpr/WangSC019 fatcat:vj4ramkxtvgnbjymjf7w4e4uii