SPSIM: A Superpixel-Based Similarity Index for Full-Reference Image Quality Assessment

Wen Sun, Qingmin Liao, Jing-Hao Xue, Fei Zhou
2018 IEEE Transactions on Image Processing  
Full-reference image quality assessment algorithms usually perform comparisons of features extracted from square patches. These patches do not have any visual meanings. On the contrary, a superpixel is a set of image pixels that share similar visual characteristics and is thus perceptually meaningful. Features from superpixels may improve the performance of image quality assessment. Inspired by this, we propose a new superpixel-based similarity index (SPSIM) by extracting perceptually
more » ... features and revising similarity measures. The proposed method evaluates image quality on the basis of three measurements, namely, superpixel luminance similarity, superpixel chrominance similarity, and pixel gradient similarity. The first two measurements assess the overall visual impression on local images. The third measurement quantifies structural variations. The impact of superpixel-based regional gradient consistency on image quality is also analyzed. Distorted images showing high regional gradient consistency with the corresponding reference images are visually appreciated. Therefore, the three measurements are further revised by incorporating regional gradient consistency into their computations. A weighting function that indicates superpixelbased texture complexity is utilized in the pooling stage to obtain the final quality score. Experiments on several benchmark databases demonstrate that the proposed method is competitive with state-of-the-art metrics.
doi:10.1109/tip.2018.2837341 pmid:29870344 fatcat:m64lo63uafdhja2k3m2kqrd2py