Blind Image Quality Metric for Color Images Based on Human Vision System and Deep CNN
Abstract
References
S. Bosse, D. Maniry, K. R. Müller, T. Wiegand, and W. Samek, “Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment,†IEEE Transactions on Image Processing, vol. 27, no. 1, pp. 206–219, 2018, doi: 10.1109/TIP.2017.2760518.
N. Tajbakhsh et al., “Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?,†IEEE Trans Med Imaging, vol. 35, no. 5, pp. 1299–1312, May 2016, doi: 10.1109/TMI.2016.2535302.
L. Ma, S. Li, F. Zhang, and K. N. Ngan, “Reduced-reference image quality assessment using reorganized DCT-based image representation,†IEEE Trans Multimedia, vol. 13, no. 4, pp. 824–829, 2011, doi: 10.1109/TMM.2011.2109701.
M. Khosravy, N. Patel, N. Gupta, and I. K. Sethi, “Image Quality Assessment: A Review to Full Reference Indexes,†in Recent Trends in Communication, Computing, and Electronics, A. Khare, U. S. Tiwary, I. K. Sethi, and N. Singh, Eds., Singapore: Springer Singapore, 2019, pp. 279–288.
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,†IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004, doi: 10.1109/TIP.2003.819861.
Z. Wang and A. C. Bovik, “A Universal Image Quality Index,†IEEE Signal Process Lett, vol. 9, no. 3, pp. 81–84, Mar. 2002, doi: 10.1109/97.995823.
A. K. Moorthy and A. C. Bovik, “A two-stage framework for blind image quality assessment,†Proceedings - International Conference on Image Processing, ICIP, vol. 17, no. 5, pp. 2481–2484, 2010, doi: 10.1109/ICIP.2010.5651745.
N. Venkatanath, D. Praneeth, B. H. Maruthi Chandrasekhar, S. S. Channappayya, and S. S. Medasani, “Blind image quality evaluation using perception based features,†2015 21st National Conference on Communications, NCC 2015, pp. 1–6, 2015, doi: 10.1109/NCC.2015.7084843.
T. Sun, X. Zhu, J. S. Pan, J. Wen, and F. Meng, “No-reference image quality assessment in spatial domain,†Advances in Intelligent Systems and Computing, vol. 329, no. 12, pp. 381–388, 2015, doi: 10.1007/978-3-319-12286-1_39.
X. Jiang, L. Shen, L. Yu, M. Jiang, and G. Feng, “No-reference screen content image quality assessment based on multi-region features,†Neurocomputing, vol. 386, pp. 30–41, Apr. 2020, doi: 10.1016/j.neucom.2019.12.027.
X. Jiang, L. Shen, Q. Ding, L. Zheng, and P. An, “Screen content image quality assessment based on convolutional neural networks,†J Vis Commun Image Represent, vol. 67, Feb. 2020, doi: 10.1016/j.jvcir.2019.102745.
Z. Wang, L. Shen, Z. Wang, Y. Lin, and Y. Jin, “Generation-based Joint Luminance-Chrominance Learning for Underwater Image Quality Assessment,†IEEE Transactions on Circuits and Systems for Video Technology, Mar. 2022, doi: 10.1109/TCSVT.2022.3212788.
K. Zhang, W. Zuo, Y. Chen, D. Meng, and L. Zhang, “Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising,†IEEE Transactions on Image Processing, vol. 26, no. 7, pp. 3142–3155, 2017, doi: 10.1109/TIP.2017.2662206.
S. Toprak and Y. Yalman, “A new full-reference image quality metric based on just noticeable difference,†Comput Stand Interfaces, vol. 50, no. June 2016, pp. 18–25, 2017, doi: 10.1016/j.csi.2016.08.003.
Y. Yalman and I. Ertürk, “A new color image quality measure based on YUV transformation and PSNR for human vision system,†Turkish Journal of Electrical Engineering and Computer Sciences, vol. 21, no. 2, pp. 603–612, 2013, doi: 10.3906/elk-1111-11.
X. Li, G. Zhang, K. Li, and W. Zheng, “Chapter 4 - Deep Learning and Its Parallelization,†in Big Data, R. Buyya, R. N. Calheiros, and A. V. Dastjerdi, Eds., Morgan Kaufmann, 2016, pp. 95–118. doi: https://doi.org/10.1016/B978-0-12-805394-2.00004-0.
B. Moons, D. Bankman, and M. Verhelst, Embedded Deep Learning. 2019. doi: 10.1007/978-3-319-99223-5.
S. N. Narayanan, K. Khanna, B. K. Panigrahi, and A. Joshi, “Chapter 11 - Security in Smart Cyber-Physical Systems: A Case Study on Smart Grids and Smart Cars,†in Smart Cities Cybersecurity and Privacy, D. B. Rawat and K. Z. Ghafoor, Eds., Elsevier, 2019, pp. 147–163. doi: https://doi.org/10.1016/B978-0-12-815032-0.00011-1.
X. Jiang, L. Shen, G. Feng, L. Yu, and P. An, “An optimized CNN-based quality assessment model for screen content image,†Signal Process Image Commun, vol. 94, May 2021, doi: 10.1016/j.image.2021.116181.
K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,†3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, pp. 1–14, 2015.
Z. Wang and A. C. Bovik, “Error : Love It or Leave It ?,†no. January, pp. 98–117, 2009.
D. R. I. M. Setiadi, “PSNR vs SSIM: imperceptibility quality assessment for image steganography,†Multimed Tools Appl, vol. 80, no. 6, pp. 8423–8444, 2021, doi: 10.1007/s11042-020-10035-z.
H. R. Sheikh and A. C. Bovik, “Image information and visual quality,†IEEE Transactions on Image Processing, vol. 15, no. 2, pp. 430–444, 2006, doi: 10.1109/TIP.2005.859378.
M. Tkalcic and J. F. Tasic, “Colour spaces: perceptual, historical and applicational background,†in The IEEE Region 8 EUROCON 2003. Computer as a Tool., 2003, pp. 304–308 vol.1. doi: 10.1109/EURCON.2003.1248032.
Y. Yalman, “Histogram based perceptual quality assessment method for color images,†Comput Stand Interfaces, vol. 36, no. 6, pp. 899–908, 2014, doi: 10.1016/j.csi.2014.04.002.
S. Naveen and V. A. Aiswarya, “Image Denoising by Fourier Block Processing and Wiener Filtering,†Procedia Comput Sci, vol. 58, pp. 683–690, 2015, doi: 10.1016/j.procs.2015.08.088.
Z. Xiong, M. T. Orchard, and Y. Q. Zhang, “A deblocking algorithm for JPEG compressed images using overcomplete wavelet representations,†IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 2, pp. 433–437, 1997, doi: 10.1109/76.564123.
H. C. Burger, C. J. Schuler, and S. Harmeling, “Image denoising: Can plain neural networks compete with BM3D?,†Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2392–2399, 2012, doi: 10.1109/CVPR.2012.6247952.
C. Chen, Z. Xiong, X. Tian, Z. J. Zha, and F. Wu, “Real-World Image Denoising with Deep Boosting,†IEEE Trans Pattern Anal Mach Intell, vol. 42, no. 12, pp. 3071–3087, 2020, doi: 10.1109/TPAMI.2019.2921548.
J. Guérin, S. Thiery, E. Nyiri, O. Gibaru, and B. Boots, “Combining pretrained CNN feature extractors to enhance clustering of complex natural images,†Neurocomputing, vol. 423, pp. 551–571, 2021, doi: https://doi.org/10.1016/j.neucom.2020.10.068.
D. Martin, C. Fowlkes, D. Tal, and J. Malik, “A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics,†in Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, 2001, pp. 416–423 vol.2. doi: 10.1109/ICCV.2001.937655.
H. R. Sheikh, A. C. Bovik, L. Cormack, and Z. Wang, “Laboratory for Image and Video Engineering - The University of Texas at Austin.†https://live.ece.utexas.edu/research/quality/ (accessed May 24, 2021).
D. M. Chandler, “Most apparent distortion: full-reference image quality assessment and the role of strategy,†J Electron Imaging, vol. 19, no. 1, p. 011006, Jan. 2010, doi: 10.1117/1.3267105.
N. Ponomarenko et al., “Image database TID2013: Peculiarities, results and perspectives,†Signal Process Image Commun, vol. 30, pp. 57–77, Jan. 2015, doi: 10.1016/j.image.2014.10.009.
N. Ponomarenko et al., “TID2008-A Database for Evaluation of Full-Reference Visual Quality Assessment Metrics.â€
A. Zaric et al., “VCL@FER Image Quality Assessment Database,†2011.
A. K. Moorthy and A. C. Bovik, “Blind image quality assessment: From natural scene statistics to perceptual quality,†IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3350–3364, Dec. 2011, doi: 10.1109/TIP.2011.2147325.
M. A. Saad, A. C. Bovik, and C. Charrier, “Blind image quality assessment: A natural scene statistics approach in the DCT domain,†IEEE Transactions on Image Processing, vol. 21, no. 8, pp. 3339–3352, 2012, doi: 10.1109/TIP.2012.2191563.
A. Mittal, R. Soundararajan, and A. C. Bovik, “Making a ‘completely blind’ image quality analyzer,†IEEE Signal Process Lett, vol. 20, no. 3, pp. 209–212, 2013, doi: 10.1109/LSP.2012.2227726.
L. Zhang, L. Zhang, and A. C. Bovik, “A Feature-Enriched Completely Blind Image Quality Evaluator,†2015. [Online]. Available: www.comp.polyu.edu.hk/
P. Ye, J. Kumar, L. Kang, and D. Doermann, “Unsupervised feature learning framework for no-reference image quality assessment,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2012, pp. 1098–1105. doi: 10.1109/CVPR.2012.6247789.
W. Xue, X. Mou, L. Zhang, A. C. Bovik, and X. Feng, “Blind image quality assessment using joint statistics of gradient magnitude and laplacian features,†IEEE Transactions on Image Processing, vol. 23, no. 11, pp. 4850–4862, Nov. 2014, doi: 10.1109/TIP.2014.2355716.
K. Gu, G. Zhai, X. Yang, and W. Zhang, “Using Free Energy Principle for Blind Image Quality Assessment,†IEEE Trans Multimedia, vol. 17, no. 1, pp. 50–63, Jan. 2015, doi: 10.1109/TMM.2014.2373812.
D. Ghadiyaram and A. C. Bovik, “Perceptual quality prediction on authentically distorted images using a bag of features approach,†J Vis, vol. 17, no. 1, 2017, doi: 10.1167/17.1.32.
Q. Li, W. Lin, K. Gu, Y. Zhang, and Y. Fang, “Blind image quality assessment based on joint log-contrast statistics,†Neurocomputing, vol. 331, pp. 189–198, Feb. 2019, doi: 10.1016/j.neucom.2018.11.015.
J. Xu, P. Ye, Q. Li, H. Du, Y. Liu, and D. Doermann, “Blind image quality assessment based on high order statistics aggregation,†IEEE Transactions on Image Processing, vol. 25, no. 9, pp. 4444–4457, Sep. 2016, doi: 10.1109/TIP.2016.2585880.
J. Kim and S. Lee, “Fully Deep Blind Image Quality Predictor,†IEEE Journal on Selected Topics in Signal Processing, vol. 11, no. 1, pp. 206–220, Feb. 2017, doi: 10.1109/JSTSP.2016.2639328.
W. Zhang, K. Ma, J. Yan, D. Deng, and Z. Wang, “Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network,†Jul. 2019, doi: 10.1109/TCSVT.2018.2886771.
W. Xue, L. Zhang, and X. Mou, “Learning without human scores for blind image quality assessment,†in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2013, pp. 995–1002. doi: 10.1109/CVPR.2013.133.
W. Zhang, K. Ma, G. Zhai, and X. Yang, “Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild,†May 2020, doi: 10.1109/TIP.2021.3061932.
K. Ma, X. Liu, Y. Fang, and E. P. Simoncelli, “Blind Image Quality Assessment by Learning from Multiple Annotators,†in 2019 IEEE International Conference on Image Processing (ICIP), 2019, pp. 2344–2348. doi: 10.1109/ICIP.2019.8803390.
ITU-R BT.601-7, Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios, International Telecommunication Union, Geneva, Switzerland, Mar. 2011.