Scalable MDC-based WebRTC streaming for one-to-many volumetric video conferencing
- Author
- Matthias De Fré (UGent) , Jeroen van der Hooft (UGent) , Tim Wauters (UGent) and Filip De Turck (UGent)
- Organization
- Abstract
- Video consumption has become central to modern life, with users seeking more immersive experiences such as virtual conferencing or concerts within virtual reality (VR). While 360 degrees video offers rotational movement, it lacks true positional freedom. Fully immersive formats like light fields and volumetric video enable six degrees-of-freedom (6DoF), allowing both types of freedom. However, their high bandwidth and computational demands make them impractical for low-latency applications. Efforts to address these issues through compression and quality adaptation have improved quality of experience (QoE), but real-time interaction remains limited because of latency. To solve this, we introduce a novel, open-source one-to-many streaming architecture using point cloud-based volumetric video. By compressing point clouds with the Draco codec and transmitting via web real-time communication (WebRTC), we achieve low-latency 6DoF streaming. Content is adapted by employing a multiple description coding (MDC) strategy which combines sampled point cloud descriptions using the estimated bandwidth returned by the Google congestion control (GCC) algorithm. MDC encoding scales more easily to a larger number of users compared to individual encoding. Our proposed solution achieves similar real-time latency for both three and eight clients (163 ms and 166 ms), which is 9% and 19% lower compared to individual encoding. The MDC-based approach, using three workers, achieves similar visual quality compared to a per client encoding solution using five worker threads, and increased quality when the number of clients is greater than 20. Additionally, when compared to an approach with five fixed quality levels, our MDC-based approach scores 13% better in terms of latency, while achieving similar quality.
- Keywords
- Volumetric Video, Adaptive Streaming, WebRTC, Virtual Conferencing, MDC, Virtual Reality, MESH
Downloads
-
9020.pdf
- full text (Published version)
- |
- open access
- |
- |
- 47.66 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01KM4YG9KA5BT7KNM086ZFJ9M7
- MLA
- De Fré, Matthias, et al. “Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, vol. 22, no. 3, 2026, doi:10.1145/3768314.
- APA
- De Fré, M., van der Hooft, J., Wauters, T., & De Turck, F. (2026). Scalable MDC-based WebRTC streaming for one-to-many volumetric video conferencing. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 22(3). https://doi.org/10.1145/3768314
- Chicago author-date
- De Fré, Matthias, Jeroen van der Hooft, Tim Wauters, and Filip De Turck. 2026. “Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 22 (3). https://doi.org/10.1145/3768314.
- Chicago author-date (all authors)
- De Fré, Matthias, Jeroen van der Hooft, Tim Wauters, and Filip De Turck. 2026. “Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing.” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS 22 (3). doi:10.1145/3768314.
- Vancouver
- 1.De Fré M, van der Hooft J, Wauters T, De Turck F. Scalable MDC-based WebRTC streaming for one-to-many volumetric video conferencing. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS. 2026;22(3).
- IEEE
- [1]M. De Fré, J. van der Hooft, T. Wauters, and F. De Turck, “Scalable MDC-based WebRTC streaming for one-to-many volumetric video conferencing,” ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, vol. 22, no. 3, 2026.
@article{01KM4YG9KA5BT7KNM086ZFJ9M7,
abstract = {{Video consumption has become central to modern life, with users seeking more immersive experiences such as virtual conferencing or concerts within virtual reality (VR). While 360 degrees video offers rotational movement, it lacks true positional freedom. Fully immersive formats like light fields and volumetric video enable six degrees-of-freedom (6DoF), allowing both types of freedom. However, their high bandwidth and computational demands make them impractical for low-latency applications. Efforts to address these issues through compression and quality adaptation have improved quality of experience (QoE), but real-time interaction remains limited because of latency. To solve this, we introduce a novel, open-source one-to-many streaming architecture using point cloud-based volumetric video. By compressing point clouds with the Draco codec and transmitting via web real-time communication (WebRTC), we achieve low-latency 6DoF streaming. Content is adapted by employing a multiple description coding (MDC) strategy which combines sampled point cloud descriptions using the estimated bandwidth returned by the Google congestion control (GCC) algorithm. MDC encoding scales more easily to a larger number of users compared to individual encoding. Our proposed solution achieves similar real-time latency for both three and eight clients (163 ms and 166 ms), which is 9% and 19% lower compared to individual encoding. The MDC-based approach, using three workers, achieves similar visual quality compared to a per client encoding solution using five worker threads, and increased quality when the number of clients is greater than 20. Additionally, when compared to an approach with five fixed quality levels, our MDC-based approach scores 13% better in terms of latency, while achieving similar quality.}},
articleno = {{65}},
author = {{De Fré, Matthias and van der Hooft, Jeroen and Wauters, Tim and De Turck, Filip}},
issn = {{1551-6857}},
journal = {{ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS}},
keywords = {{Volumetric Video,Adaptive Streaming,WebRTC,Virtual Conferencing,MDC,Virtual Reality,MESH}},
language = {{eng}},
number = {{3}},
pages = {{25}},
title = {{Scalable MDC-based WebRTC streaming for one-to-many volumetric video conferencing}},
url = {{http://doi.org/10.1145/3768314}},
volume = {{22}},
year = {{2026}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: