3D No-reference Image Quality Assessment via Transfer Learning and Saliency-guided Feature Consolidation

Xu Xiaogang, Bufan Shi, Zijin Gu, Ruizhe Deng, Xiaodong Chen, Andrey S. Krylov, Yong Ding
2019 IEEE Access  
Motivated by the success of convolutional neural networks (CNNs) in image-related applications, in this paper, we design an effective method for no-reference 3D image quality assessment (3D IQA) through CNN-based feature extraction and consolidation strategy. In the first and most vital stage, qualityaware features, which reflect the inherent quality of images, are extracted by a fine-tuned CNN model exploiting the concept of transfer learning. This fine-tuning strategy solves the large-scale
more » ... aining data dependence existing in current deep-learning-based IQA algorithms. In the second stage, features from the left and right view are consolidated by linear weighted fusion where the weight for each image is obtained from its saliency map. In addition, the statistical characteristics of the disparity map are also considered in a multi-scale manner as additional features. In the final stage of quality mapping, the objective score for each stereoscopic pair is gained by support vector regression. The experimental results on the public databases show that our approach outperforms many existing no-reference and even full-reference methods. INDEX TERMS No-reference 3D image quality assessment, deep neural network, transfer learning.
doi:10.1109/access.2019.2925084 fatcat:hmh2qz5tqfhbpfmbs4wx6r7ykm