Advanced search
2 files | 4.56 MB Add to list

Random access prediction structures for light field video coding with MV-HEVC

(2020) MULTIMEDIA TOOLS AND APPLICATIONS. 79(19-20). p.12847-12867
Author
Organization
Abstract
Computational imaging and light field technology promise to deliver the required six-degrees-of-freedom for natural scenes in virtual reality. Already existing extensions of standardized video coding formats, such as multi-view coding and multi-view plus depth, are the most conventional light field video coding solutions at the moment. The latest multi-view coding format, which is a direct extension of the high efficiency video coding (HEVC) standard, is called multi-view HEVC (or MV-HEVC). MV-HEVC treats each light field view as a separate video sequence, and uses syntax elements similar to standard HEVC for exploiting redundancies between neighboring views. To achieve this, inter-view and temporal prediction schemes are deployed with the aim to find the most optimal trade-off between coding performance and reconstruction quality. The number of possible prediction structures is unlimited and many of them are proposed in the literature. Although some of them are efficient in terms of compression ratio, they complicate random access due to the dependencies on previously decoded pixels or frames. Random access is an important feature in video delivery, and a crucial requirement in multi-view video coding. In this work, we propose and compare different prediction structures for coding light field video using MV-HEVC with a focus on both compression efficiency and random accessibility. Experiments on three different short-baseline light field video sequences show the trade-off between bit-rate and distortion, as well as the average number of decoded views/frames, necessary for displaying any random frame at any time instance. The findings of this work indicate the most appropriate prediction structure depending on the available bandwidth and the required degree of random access.
Keywords
MULTIVIEW VIDEO, IMAGE, Light field video coding, Multi-view video coding, MV-HEVC, Prediction, structures, Random access, Virtual reality, Free navigation

Downloads

  • DS308 i.pdf
    • full text (Author's original)
    • |
    • open access
    • |
    • PDF
    • |
    • 1.46 MB
  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 3.10 MB

Citation

Please use this url to cite or link to this publication:

MLA
Avramelos, Vasileios, et al. “Random Access Prediction Structures for Light Field Video Coding with MV-HEVC.” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 19–20, 2020, pp. 12847–67.
APA
Avramelos, V., De Praeter, J., Van Wallendael, G., & Lambert, P. (2020). Random access prediction structures for light field video coding with MV-HEVC. MULTIMEDIA TOOLS AND APPLICATIONS, 79(19–20), 12847–12867.
Chicago author-date
Avramelos, Vasileios, Johan De Praeter, Glenn Van Wallendael, and Peter Lambert. 2020. “Random Access Prediction Structures for Light Field Video Coding with MV-HEVC.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (19–20): 12847–67.
Chicago author-date (all authors)
Avramelos, Vasileios, Johan De Praeter, Glenn Van Wallendael, and Peter Lambert. 2020. “Random Access Prediction Structures for Light Field Video Coding with MV-HEVC.” MULTIMEDIA TOOLS AND APPLICATIONS 79 (19–20): 12847–12867.
Vancouver
1.
Avramelos V, De Praeter J, Van Wallendael G, Lambert P. Random access prediction structures for light field video coding with MV-HEVC. MULTIMEDIA TOOLS AND APPLICATIONS. 2020;79(19–20):12847–67.
IEEE
[1]
V. Avramelos, J. De Praeter, G. Van Wallendael, and P. Lambert, “Random access prediction structures for light field video coding with MV-HEVC,” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 79, no. 19–20, pp. 12847–12867, 2020.
@article{8663919,
  abstract     = {Computational imaging and light field technology promise to deliver the required six-degrees-of-freedom for natural scenes in virtual reality. Already existing extensions of standardized video coding formats, such as multi-view coding and multi-view plus depth, are the most conventional light field video coding solutions at the moment. The latest multi-view coding format, which is a direct extension of the high efficiency video coding (HEVC) standard, is called multi-view HEVC (or MV-HEVC). MV-HEVC treats each light field view as a separate video sequence, and uses syntax elements similar to standard HEVC for exploiting redundancies between neighboring views. To achieve this, inter-view and temporal prediction schemes are deployed with the aim to find the most optimal trade-off between coding performance and reconstruction quality. The number of possible prediction structures is unlimited and many of them are proposed in the literature. Although some of them are efficient in terms of compression ratio, they complicate random access due to the dependencies on previously decoded pixels or frames. Random access is an important feature in video delivery, and a crucial requirement in multi-view video coding. In this work, we propose and compare different prediction structures for coding light field video using MV-HEVC with a focus on both compression efficiency and random accessibility. Experiments on three different short-baseline light field video sequences show the trade-off between bit-rate and distortion, as well as the average number of decoded views/frames, necessary for displaying any random frame at any time instance. The findings of this work indicate the most appropriate prediction structure depending on the available bandwidth and the required degree of random access.},
  author       = {Avramelos, Vasileios and De Praeter, Johan and Van Wallendael, Glenn and Lambert, Peter},
  issn         = {1380-7501},
  journal      = {MULTIMEDIA TOOLS AND APPLICATIONS},
  keywords     = {MULTIVIEW VIDEO,IMAGE,Light field video coding,Multi-view video coding,MV-HEVC,Prediction,structures,Random access,Virtual reality,Free navigation},
  language     = {eng},
  number       = {19-20},
  pages        = {12847--12867},
  title        = {Random access prediction structures for light field video coding with MV-HEVC},
  url          = {http://dx.doi.org/10.1007/s11042-019-08605-x},
  volume       = {79},
  year         = {2020},
}

Altmetric
View in Altmetric
Web of Science
Times cited: