Advanced search
1 file | 1.50 MB Add to list

Towards 6DoF HTTP adaptive streaming through point cloud compression

Author
Organization
Abstract
The increasing popularity of head-mounted devices and 360 degrees video cameras allows content providers to offer virtual reality video streaming over the Internet, using a relevant representation of the immersive content combined with traditional streaming techniques. While this approach allows the user to freely move her head, her location is fixed by the camera's position within the scene. Recently, an increased interest has been shown for free movement within immersive scenes, referred to as six degrees of freedom. One way to realize this is by capturing objects through a number of cameras positioned in different angles, and creating a point cloud which consists of the location and RGB color of a significant number of points in the three-dimensional space. Although the concept of point clouds has been around for over two decades, it recently received increased attention by ISO/IEC MPEG, issuing a call for proposals for point cloud compression. As a result, dynamic point cloud objects can now be compressed to bit rates in the order of 3 to 55 Mb/s, allowing feasible delivery over today's mobile networks. In this paper, we propose PCC-DASH, a standards-compliant means for HTTP adaptive streaming of scenes comprising multiple, dynamic point cloud objects. We present a number of rate adaptation heuristics which use information on the user's position and focus, the available bandwidth, and the client's buffer status to decide upon the most appropriate quality representation of each object. Through an extensive evaluation, we discuss the advantages and drawbacks of each solution. We argue that the optimal solution depends on the considered scene and camera path, which opens interesting possibilities for future work.
Keywords
VIDEO, HTTP adaptive streaming, MPEG-DASH, immersive video, point clouds, MPEG, V-PCC, rate adaptation

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 1.50 MB

Citation

Please use this url to cite or link to this publication:

MLA
van der Hooft, Jeroen, et al. “Towards 6DoF HTTP Adaptive Streaming through Point Cloud Compression.” PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19), Assoc Computing Machinery, 2019, pp. 2405–13.
APA
van der Hooft, J., Wauters, T., De Turck, F., Timmerer, C., & Hellwagner, H. (2019). Towards 6DoF HTTP adaptive streaming through point cloud compression. In PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19) (pp. 2405–2413). New york: Assoc Computing Machinery.
Chicago author-date
Hooft, Jeroen van der, Tim Wauters, Filip De Turck, Christian Timmerer, and Hermann Hellwagner. 2019. “Towards 6DoF HTTP Adaptive Streaming through Point Cloud Compression.” In PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19), 2405–13. New york: Assoc Computing Machinery.
Chicago author-date (all authors)
van der Hooft, Jeroen, Tim Wauters, Filip De Turck, Christian Timmerer, and Hermann Hellwagner. 2019. “Towards 6DoF HTTP Adaptive Streaming through Point Cloud Compression.” In PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19), 2405–2413. New york: Assoc Computing Machinery.
Vancouver
1.
van der Hooft J, Wauters T, De Turck F, Timmerer C, Hellwagner H. Towards 6DoF HTTP adaptive streaming through point cloud compression. In: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19). New york: Assoc Computing Machinery; 2019. p. 2405–13.
IEEE
[1]
J. van der Hooft, T. Wauters, F. De Turck, C. Timmerer, and H. Hellwagner, “Towards 6DoF HTTP adaptive streaming through point cloud compression,” in PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM’19), Nice, FRANCE, 2019, pp. 2405–2413.
@inproceedings{8647372,
  abstract     = {The increasing popularity of head-mounted devices and 360 degrees video cameras allows content providers to offer virtual reality video streaming over the Internet, using a relevant representation of the immersive content combined with traditional streaming techniques. While this approach allows the user to freely move her head, her location is fixed by the camera's position within the scene. Recently, an increased interest has been shown for free movement within immersive scenes, referred to as six degrees of freedom. One way to realize this is by capturing objects through a number of cameras positioned in different angles, and creating a point cloud which consists of the location and RGB color of a significant number of points in the three-dimensional space. Although the concept of point clouds has been around for over two decades, it recently received increased attention by ISO/IEC MPEG, issuing a call for proposals for point cloud compression. As a result, dynamic point cloud objects can now be compressed to bit rates in the order of 3 to 55 Mb/s, allowing feasible delivery over today's mobile networks. In this paper, we propose PCC-DASH, a standards-compliant means for HTTP adaptive streaming of scenes comprising multiple, dynamic point cloud objects. We present a number of rate adaptation heuristics which use information on the user's position and focus, the available bandwidth, and the client's buffer status to decide upon the most appropriate quality representation of each object. Through an extensive evaluation, we discuss the advantages and drawbacks of each solution. We argue that the optimal solution depends on the considered scene and camera path, which opens interesting possibilities for future work.},
  author       = {van der Hooft, Jeroen and Wauters, Tim and De Turck, Filip and Timmerer, Christian and Hellwagner, Hermann},
  booktitle    = {PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19)},
  isbn         = {9781450368896},
  keywords     = {VIDEO,HTTP adaptive streaming,MPEG-DASH,immersive video,point clouds,MPEG,V-PCC,rate adaptation},
  language     = {eng},
  location     = {Nice, FRANCE},
  pages        = {2405--2413},
  publisher    = {Assoc Computing Machinery},
  title        = {Towards 6DoF HTTP adaptive streaming through point cloud compression},
  url          = {http://dx.doi.org/10.1145/3343031.3350917},
  year         = {2019},
}

Altmetric
View in Altmetric
Web of Science
Times cited: