Multi Information Fusion Network for Saliency Quality Assessment

Kai TAN, Qingbo WU, Fanman MENG, Linfeng XU
2019 IEICE transactions on information and systems  
Saliency quality assessment aims at estimating the objective quality of a saliency map without access to the ground-truth. Existing works typically evaluate saliency quality by utilizing information from saliency maps to assess its compactness and closedness while ignoring the information from image content which can be used to assess the consistence and completeness of foreground. In this letter, we propose a novel multi-information fusion network to capture the information from both the
more » ... cy map and image content. The key idea is to introduce a siamese module to collect information from foreground and background, aiming to assess the consistence and completeness of foreground and the difference between foreground and background. Experiments demonstrate that by incorporating image content information, the performance of the proposed method is significantly boosted. Furthermore, we validate our method on two applications: saliency detection and segmentation. Our method is utilized to choose optimal saliency map from a set of candidate saliency maps, and the selected saliency map is feeded into an segmentation algorithm to generate a segmentation map. Experimental results verify the effectiveness of our method. key words: saliency quality assessment, multi information, deep convolutional neural network, image content
doi:10.1587/transinf.2019edl8002 fatcat:axlnf3kevnb23ksbb4wfvke7du