No-reference VMAF : a deep neural network-based approach to blind video quality assessment
- Author
- Axel De Decker (UGent) , Jan De Cock, Peter Lambert (UGent) and Glenn Van Wallendael (UGent)
- Organization
- Abstract
- As the demand for high-quality video content continues to rise, accurately assessing the visual quality of digital videos has become more crucial than ever before. However, evaluating the perceptual quality of an impaired video in the absence of the original reference signal remains a significant challenge. To address this problem, we propose a novel No-Reference (NR) video quality metric called NR-VMAF. Our method is designed to replicate the popular Full-Reference (FR) metric VMAF in scenarios where the reference signal is unavailable or impractical to obtain. Like its FR counterpart, NR-VMAF is tailored specifically for measuring video quality in the presence of compression and scaling artifacts. The proposed model utilizes a deep convolutional neural network to extract quality-aware features from the pixel information of the distorted video, thereby eliminating the need for manual feature engineering. By adopting a patch-based approach, we are able to process high-resolution video data without any information loss. While the current model is trained solely on H.265/HEVC videos, its performance is verified on subjective datasets containing mainly H.264/AVC content. We demonstrate that NR-VMAF outperforms current state-of-the-art NR metrics while achieving a prediction accuracy that is comparable to VMAF and other FR metrics. Based on this strong performance, we believe that NR-VMAF is a viable approach to efficient and reliable No-Reference video quality assessment.
- Keywords
- STATISTICS, Measurement, Streaming media, Visualization, Feature extraction, Quality assessment, Video recording, Accuracy, Video quality assessment, no reference, compression & scaling artifacts, convolutional neural networks, patch-based processing
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 4.65 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01J2K0R281P1TQBS559YVRNRT8
- MLA
- De Decker, Axel, et al. “No-Reference VMAF : A Deep Neural Network-Based Approach to Blind Video Quality Assessment.” IEEE TRANSACTIONS ON BROADCASTING, vol. 70, no. 3, 2024, pp. 844–61, doi:10.1109/TBC.2024.3399479.
- APA
- De Decker, A., De Cock, J., Lambert, P., & Van Wallendael, G. (2024). No-reference VMAF : a deep neural network-based approach to blind video quality assessment. IEEE TRANSACTIONS ON BROADCASTING, 70(3), 844–861. https://doi.org/10.1109/TBC.2024.3399479
- Chicago author-date
- De Decker, Axel, Jan De Cock, Peter Lambert, and Glenn Van Wallendael. 2024. “No-Reference VMAF : A Deep Neural Network-Based Approach to Blind Video Quality Assessment.” IEEE TRANSACTIONS ON BROADCASTING 70 (3): 844–61. https://doi.org/10.1109/TBC.2024.3399479.
- Chicago author-date (all authors)
- De Decker, Axel, Jan De Cock, Peter Lambert, and Glenn Van Wallendael. 2024. “No-Reference VMAF : A Deep Neural Network-Based Approach to Blind Video Quality Assessment.” IEEE TRANSACTIONS ON BROADCASTING 70 (3): 844–861. doi:10.1109/TBC.2024.3399479.
- Vancouver
- 1.De Decker A, De Cock J, Lambert P, Van Wallendael G. No-reference VMAF : a deep neural network-based approach to blind video quality assessment. IEEE TRANSACTIONS ON BROADCASTING. 2024;70(3):844–61.
- IEEE
- [1]A. De Decker, J. De Cock, P. Lambert, and G. Van Wallendael, “No-reference VMAF : a deep neural network-based approach to blind video quality assessment,” IEEE TRANSACTIONS ON BROADCASTING, vol. 70, no. 3, pp. 844–861, 2024.
@article{01J2K0R281P1TQBS559YVRNRT8,
abstract = {{As the demand for high-quality video content continues to rise, accurately assessing the visual quality of digital videos has become more crucial than ever before. However, evaluating the perceptual quality of an impaired video in the absence of the original reference signal remains a significant challenge. To address this problem, we propose a novel No-Reference (NR) video quality metric called NR-VMAF. Our method is designed to replicate the popular Full-Reference (FR) metric VMAF in scenarios where the reference signal is unavailable or impractical to obtain. Like its FR counterpart, NR-VMAF is tailored specifically for measuring video quality in the presence of compression and scaling artifacts. The proposed model utilizes a deep convolutional neural network to extract quality-aware features from the pixel information of the distorted video, thereby eliminating the need for manual feature engineering. By adopting a patch-based approach, we are able to process high-resolution video data without any information loss. While the current model is trained solely on H.265/HEVC videos, its performance is verified on subjective datasets containing mainly H.264/AVC content. We demonstrate that NR-VMAF outperforms current state-of-the-art NR metrics while achieving a prediction accuracy that is comparable to VMAF and other FR metrics. Based on this strong performance, we believe that NR-VMAF is a viable approach to efficient and reliable No-Reference video quality assessment.}},
author = {{De Decker, Axel and De Cock, Jan and Lambert, Peter and Van Wallendael, Glenn}},
issn = {{0018-9316}},
journal = {{IEEE TRANSACTIONS ON BROADCASTING}},
keywords = {{STATISTICS,Measurement,Streaming media,Visualization,Feature extraction,Quality assessment,Video recording,Accuracy,Video quality assessment,no reference,compression & scaling artifacts,convolutional neural networks,patch-based processing}},
language = {{eng}},
number = {{3}},
pages = {{844--861}},
title = {{No-reference VMAF : a deep neural network-based approach to blind video quality assessment}},
url = {{http://doi.org/10.1109/TBC.2024.3399479}},
volume = {{70}},
year = {{2024}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: