Academic Bibliography

 Search 200 years of publications by Ghent University researchers.
Advanced search
1 file | 2.89 MB
Add to list
  1. Search results
  2. On the link between subjective score ...

On the link between subjective score prediction and disagreement of video quality metrics

Lohic Fotio Tiotsop, Florence Agboma, Glenn Van Wallendael (UGent) , Ahmed Aldahdooh, Sebastian Bosse, Lucjan Janowski, Marcus Barkowsky and Enrico Masala
(2021) IEEE ACCESS. 9. p.152923-152937
Author
Organization
Abstract
Several video quality metrics (VQMs) have been proposed in many publications to predict how humans perceive video quality. It is common to observe significant disagreements amongst the quality predictions of these VQMs for the same video sequence. Following an extensive literature search, we found no publicised work that has investigated if such disagreements convey useful information on the accuracy of VQMs. Herein, a measure for quantifying the disagreement between VQMs is proposed. A small-scale subjective study is carried out to assess the effectiveness of our proposal. In particular, the proposed disagreement measure is shown to be extremely effective in determining whether the quality of any given processed video sequence (PVS) can be accurately predicted by the VQMs. This type of information is particularly useful for identifying video sequences that are likely to degrade the end-user's quality of experience (QoE). Our proposal is also useful in selecting the most effective PVSs to be employed in a subjective test. We show that the proposed disagreement measure can be effectively predicted from bitstream features. This establishes a link between the capability to accurately assess the quality of a PVS and the way it is encoded. In addition, an analysis is conducted to compare the performances of some well-known and widely used open-source metrics and two proprietary metrics. The two proprietary metrics are used by a large media company for enhancing its delivery pipeline. The outcome of this comparison highlights the suitability of the open-source VQM, Video Multi-method Assessment Fusion (VMAF), as a good benchmark quality measure for both the industrial and academic environments.
Keywords
Measurement, Quality assessment, Open source software, Video recording, Industries, Media, Quality of experience, Objective measures, proprietary metrics, subjective test, video quality, metrics, disagreement

Downloads

  • Download
    DS484.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 2.89 MB

Citation

Please use this url to cite or link to this publication:

MLA
Tiotsop, Lohic Fotio, et al. “On the Link between Subjective Score Prediction and Disagreement of Video Quality Metrics.” IEEE ACCESS, vol. 9, 2021, pp. 152923–37, doi:10.1109/ACCESS.2021.3127395.
APA
Tiotsop, L. F., Agboma, F., Van Wallendael, G., Aldahdooh, A., Bosse, S., Janowski, L., … Masala, E. (2021). On the link between subjective score prediction and disagreement of video quality metrics. IEEE ACCESS, 9, 152923–152937. https://doi.org/10.1109/ACCESS.2021.3127395
Chicago author-date
Tiotsop, Lohic Fotio, Florence Agboma, Glenn Van Wallendael, Ahmed Aldahdooh, Sebastian Bosse, Lucjan Janowski, Marcus Barkowsky, and Enrico Masala. 2021. “On the Link between Subjective Score Prediction and Disagreement of Video Quality Metrics.” IEEE ACCESS 9: 152923–37. https://doi.org/10.1109/ACCESS.2021.3127395.
Chicago author-date (all authors)
Tiotsop, Lohic Fotio, Florence Agboma, Glenn Van Wallendael, Ahmed Aldahdooh, Sebastian Bosse, Lucjan Janowski, Marcus Barkowsky, and Enrico Masala. 2021. “On the Link between Subjective Score Prediction and Disagreement of Video Quality Metrics.” IEEE ACCESS 9: 152923–152937. doi:10.1109/ACCESS.2021.3127395.
Vancouver
1.
Tiotsop LF, Agboma F, Van Wallendael G, Aldahdooh A, Bosse S, Janowski L, et al. On the link between subjective score prediction and disagreement of video quality metrics. IEEE ACCESS. 2021;9:152923–37.
IEEE
[1]
L. F. Tiotsop et al., “On the link between subjective score prediction and disagreement of video quality metrics,” IEEE ACCESS, vol. 9, pp. 152923–152937, 2021.
@article{8728877,
  abstract     = {{Several video quality metrics (VQMs) have been proposed in many publications to predict how humans perceive video quality. It is common to observe significant disagreements amongst the quality predictions of these VQMs for the same video sequence. Following an extensive literature search, we found no publicised work that has investigated if such disagreements convey useful information on the accuracy of VQMs. Herein, a measure for quantifying the disagreement between VQMs is proposed. A small-scale subjective study is carried out to assess the effectiveness of our proposal. In particular, the proposed disagreement measure is shown to be extremely effective in determining whether the quality of any given processed video sequence (PVS) can be accurately predicted by the VQMs. This type of information is particularly useful for identifying video sequences that are likely to degrade the end-user's quality of experience (QoE). Our proposal is also useful in selecting the most effective PVSs to be employed in a subjective test. We show that the proposed disagreement measure can be effectively predicted from bitstream features. This establishes a link between the capability to accurately assess the quality of a PVS and the way it is encoded. In addition, an analysis is conducted to compare the performances of some well-known and widely used open-source metrics and two proprietary metrics. The two proprietary metrics are used by a large media company for enhancing its delivery pipeline. The outcome of this comparison highlights the suitability of the open-source VQM, Video Multi-method Assessment Fusion (VMAF), as a good benchmark quality measure for both the industrial and academic environments.}},
  author       = {{Tiotsop, Lohic Fotio and Agboma, Florence and Van Wallendael, Glenn and Aldahdooh, Ahmed and Bosse, Sebastian and Janowski, Lucjan and Barkowsky, Marcus and Masala, Enrico}},
  issn         = {{2169-3536}},
  journal      = {{IEEE ACCESS}},
  keywords     = {{Measurement,Quality assessment,Open source software,Video recording,Industries,Media,Quality of experience,Objective measures,proprietary metrics,subjective test,video quality,metrics,disagreement}},
  language     = {{eng}},
  pages        = {{152923--152937}},
  title        = {{On the link between subjective score prediction and disagreement of video quality metrics}},
  url          = {{http://doi.org/10.1109/ACCESS.2021.3127395}},
  volume       = {{9}},
  year         = {{2021}},
}
Altmetric
View in Altmetric
Web of Science
Times cited: