Advanced search
1 file | 3.38 MB Add to list

Tile-based adaptive streaming for virtual reality video

Jeroen van der Hooft (UGent) , Maria Torres Vega (UGent) , Stefano Petrangeli (UGent) , Tim Wauters (UGent) and Filip De Turck (UGent)
Author
Organization
Abstract
The increasing popularity of head-mounted devices and 360 degrees video cameras allows content providers to provide virtual reality (VR) video streaming over the Internet, using a two-dimensional representation of the immersive content combined with traditional HTTP adaptive streaming (HAS) techniques. However, since only a limited part of the video (i.e., the viewport) is watched by the user, the available bandwidth is not optimally used. Recent studies have shown the benefits of adaptive tile-based video streaming; rather than sending the whole 360 degrees video at once, the video is cut into temporal segments and spatial tiles, each of which can be requested at a different quality level. This allows prioritization of viewable video content and thus results in an increased bandwidth utilization. Given the early stages of research, there are still a number of open challenges to unlock the full potential of adaptive tile-based VR streaming. The aim of this work is to provide an answer to several of these open research questions. Among others, we propose two tile-based rate adaptation heuristics for equirectangular VR video, which use the great-circle distance between the viewport center and the center of each of the tiles to decide upon the most appropriate quality representation. We also introduce a feedback loop in the quality decision process, which allows the client to revise prior decisions based on more recent information on the viewport location. Furthermore, we investigate the benefits of parallel TCP connections and the use of HTTP/2 as an application layer optimization. Through an extensive evaluation, we show that the proposed optimizations result in a significant improvement in terms of video quality (more than twice the time spent on the highest quality layer), compared to non-tiled HAS solutions.
Keywords
Virtual reality, HTTP adaptive streaming, tile-based rate adaptation

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 3.38 MB

Citation

Please use this url to cite or link to this publication:

MLA
van der Hooft, Jeroen, et al. “Tile-Based Adaptive Streaming for Virtual Reality Video.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, vol. 15, no. 4, 2019.
APA
van der Hooft, J., Torres Vega, M., Petrangeli, S., Wauters, T., & De Turck, F. (2019). Tile-based adaptive streaming for virtual reality video. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 15(4).
Chicago author-date
Hooft, Jeroen van der, Maria Torres Vega, Stefano Petrangeli, Tim Wauters, and Filip De Turck. 2019. “Tile-Based Adaptive Streaming for Virtual Reality Video.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 15 (4).
Chicago author-date (all authors)
van der Hooft, Jeroen, Maria Torres Vega, Stefano Petrangeli, Tim Wauters, and Filip De Turck. 2019. “Tile-Based Adaptive Streaming for Virtual Reality Video.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 15 (4).
Vancouver
1.
van der Hooft J, Torres Vega M, Petrangeli S, Wauters T, De Turck F. Tile-based adaptive streaming for virtual reality video. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS. 2019;15(4).
IEEE
[1]
J. van der Hooft, M. Torres Vega, S. Petrangeli, T. Wauters, and F. De Turck, “Tile-based adaptive streaming for virtual reality video,” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, vol. 15, no. 4, 2019.
@article{8649668,
  abstract     = {The increasing popularity of head-mounted devices and 360 degrees video cameras allows content providers to provide virtual reality (VR) video streaming over the Internet, using a two-dimensional representation of the immersive content combined with traditional HTTP adaptive streaming (HAS) techniques. However, since only a limited part of the video (i.e., the viewport) is watched by the user, the available bandwidth is not optimally used. Recent studies have shown the benefits of adaptive tile-based video streaming; rather than sending the whole 360 degrees video at once, the video is cut into temporal segments and spatial tiles, each of which can be requested at a different quality level. This allows prioritization of viewable video content and thus results in an increased bandwidth utilization. Given the early stages of research, there are still a number of open challenges to unlock the full potential of adaptive tile-based VR streaming. The aim of this work is to provide an answer to several of these open research questions. Among others, we propose two tile-based rate adaptation heuristics for equirectangular VR video, which use the great-circle distance between the viewport center and the center of each of the tiles to decide upon the most appropriate quality representation. We also introduce a feedback loop in the quality decision process, which allows the client to revise prior decisions based on more recent information on the viewport location. Furthermore, we investigate the benefits of parallel TCP connections and the use of HTTP/2 as an application layer optimization. Through an extensive evaluation, we show that the proposed optimizations result in a significant improvement in terms of video quality (more than twice the time spent on the highest quality layer), compared to non-tiled HAS solutions.},
  articleno    = {110},
  author       = {van der Hooft, Jeroen and Torres Vega, Maria and Petrangeli, Stefano and Wauters, Tim and De Turck, Filip},
  issn         = {1551-6857},
  journal      = {ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS},
  keywords     = {Virtual reality,HTTP adaptive streaming,tile-based rate adaptation},
  language     = {eng},
  number       = {4},
  pages        = {24},
  title        = {Tile-based adaptive streaming for virtual reality video},
  url          = {http://dx.doi.org/10.1145/3362101},
  volume       = {15},
  year         = {2019},
}

Altmetric
View in Altmetric
Web of Science
Times cited: