A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair
- Author
- Hannes Mareen (UGent) , Martijn Courteaux (UGent) , Pieter-Jan Speelmans, Peter Lambert (UGent) and Glenn Van Wallendael (UGent)
- Organization
- Project
- Abstract
- It is challenging to enable fast channel switching and packet-loss repair in low-delay live video distribution without negatively influencing the steady-state viewing performance. For example, regularly breaking the inter-frame dependency by introducing intra-predicted keyframes enables random access, but is costly in terms of rate-distortion performance. For this reason, the keyframe-injection method minimizes the impact by sending a compression-efficient normal video stream to all end-users. As accompaniment, a companion stream that solely consists of keyframes is sporadically used for only those users that switch channels or experience packet loss. This paper describes the requirements to implement keyframe injection in three video coding standard generations (H.264/AVC, H.265/HEVC, and H.266/VVC). We evaluated the impact that keyframe injection has on the quality of the video in terms of a decrease in VMAF, PSNR and SSIM. We demonstrate that the quality reduction caused by keyframe insertion is generally low, meaning that keyframe injection typically is imperceptible. However, drift-error artifacts become perceptible over time for rare outliers. Moreover, we pinpointed the cause of this worst-case artifact type to be halfpel interpolation. As a solution, codecs can disable subpel motion estimation, and future standards could design their filters more carefully. Lastly, it should be noted that keyframe injection will only be applied sporadically when users require a random access or experience packet loss, and only to those users. Most interestingly, all other users receive a compression-efficient stream wherein the inter-frame dependency is not artificially broken at regular short intervals. As such, our proposed solution makes low-latency video distribution efficient and viable in multiple coding standards.
- Keywords
- IPTV, DELAY, TIME, Fast channel switching, Random access, Packet loss, Error recovery, H.264/AVC, H.265/HEVC, H.266/VVC
Downloads
-
DS682 acc.pdf
- full text (Accepted manuscript)
- |
- open access
- |
- |
- 5.01 MB
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 1.52 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HEJ64Y60024K9ZB247GASZ8Z
- MLA
- Mareen, Hannes, et al. “A Study on Keyframe Injection in Three Generations of Video Coding Standards for Fast Channel Switching and Packet-Loss Repair.” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 83, 2024, pp. 44485–501, doi:10.1007/s11042-023-17163-2.
- APA
- Mareen, H., Courteaux, M., Speelmans, P.-J., Lambert, P., & Van Wallendael, G. (2024). A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair. MULTIMEDIA TOOLS AND APPLICATIONS, 83, 44485–44501. https://doi.org/10.1007/s11042-023-17163-2
- Chicago author-date
- Mareen, Hannes, Martijn Courteaux, Pieter-Jan Speelmans, Peter Lambert, and Glenn Van Wallendael. 2024. “A Study on Keyframe Injection in Three Generations of Video Coding Standards for Fast Channel Switching and Packet-Loss Repair.” MULTIMEDIA TOOLS AND APPLICATIONS 83: 44485–501. https://doi.org/10.1007/s11042-023-17163-2.
- Chicago author-date (all authors)
- Mareen, Hannes, Martijn Courteaux, Pieter-Jan Speelmans, Peter Lambert, and Glenn Van Wallendael. 2024. “A Study on Keyframe Injection in Three Generations of Video Coding Standards for Fast Channel Switching and Packet-Loss Repair.” MULTIMEDIA TOOLS AND APPLICATIONS 83: 44485–44501. doi:10.1007/s11042-023-17163-2.
- Vancouver
- 1.Mareen H, Courteaux M, Speelmans P-J, Lambert P, Van Wallendael G. A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair. MULTIMEDIA TOOLS AND APPLICATIONS. 2024;83:44485–501.
- IEEE
- [1]H. Mareen, M. Courteaux, P.-J. Speelmans, P. Lambert, and G. Van Wallendael, “A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair,” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 83, pp. 44485–44501, 2024.
@article{01HEJ64Y60024K9ZB247GASZ8Z, abstract = {{It is challenging to enable fast channel switching and packet-loss repair in low-delay live video distribution without negatively influencing the steady-state viewing performance. For example, regularly breaking the inter-frame dependency by introducing intra-predicted keyframes enables random access, but is costly in terms of rate-distortion performance. For this reason, the keyframe-injection method minimizes the impact by sending a compression-efficient normal video stream to all end-users. As accompaniment, a companion stream that solely consists of keyframes is sporadically used for only those users that switch channels or experience packet loss. This paper describes the requirements to implement keyframe injection in three video coding standard generations (H.264/AVC, H.265/HEVC, and H.266/VVC). We evaluated the impact that keyframe injection has on the quality of the video in terms of a decrease in VMAF, PSNR and SSIM. We demonstrate that the quality reduction caused by keyframe insertion is generally low, meaning that keyframe injection typically is imperceptible. However, drift-error artifacts become perceptible over time for rare outliers. Moreover, we pinpointed the cause of this worst-case artifact type to be halfpel interpolation. As a solution, codecs can disable subpel motion estimation, and future standards could design their filters more carefully. Lastly, it should be noted that keyframe injection will only be applied sporadically when users require a random access or experience packet loss, and only to those users. Most interestingly, all other users receive a compression-efficient stream wherein the inter-frame dependency is not artificially broken at regular short intervals. As such, our proposed solution makes low-latency video distribution efficient and viable in multiple coding standards.}}, author = {{Mareen, Hannes and Courteaux, Martijn and Speelmans, Pieter-Jan and Lambert, Peter and Van Wallendael, Glenn}}, issn = {{1380-7501}}, journal = {{MULTIMEDIA TOOLS AND APPLICATIONS}}, keywords = {{IPTV,DELAY,TIME,Fast channel switching,Random access,Packet loss,Error recovery,H.264/AVC,H.265/HEVC,H.266/VVC}}, language = {{eng}}, pages = {{44485--44501}}, title = {{A study on keyframe injection in three generations of video coding standards for fast channel switching and packet-loss repair}}, url = {{http://doi.org/10.1007/s11042-023-17163-2}}, volume = {{83}}, year = {{2024}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: