Advanced search
1 file | 2.60 MB Add to list

Platform for real-time subjective assessment of interactive multimedia applications

Author
Organization
Abstract
With the advent of cloud computing and remote execution of interactive applications, there is a need for evaluating the Quality of Experience (QoE) and the influence on this QoE of network condition variations, media encoding parameter settings and related optimization algorithms. However, current QoE assessment focuses mainly on audiovisual quality in non-interactive applications, such as video-on-demand services. On the other hand, where experiments aim to quantify interactive quality, the focus is typically targeted at games, using an ad-hoc test setup to assess the impact of network variations on the playing experience. In this paper, we present a novel platform enabling the assessment of a broad range of interactive applications (e.g., thin client remote desktop systems, remotely rendered engineering applications, games). Dynamic reconfiguration of media encoding and decoding is built into the system, to allow dynamic adaptation of the media encoding to the network conditions and the application characteristics. Evaluating the influence of these automatic adaptations is a key asset of our approach. A range of possible use cases is discussed, as well as a performance study of our implementation, showing that the platform we built is capable of highly controllable subjective user assessment. Furthermore, we present results obtained by applying the platform for a subjective evaluation of an interactive multimedia application. Specifically, the influence of visual quality and frame rate on interactive QoE has been assessed for a remotely executed race game.
Keywords
NETWORK QUALITY, PERFORMANCE, EXPERIENCE, FRAMEWORK, Interactive media quality assessment, Quality of experience, Interactivity, Subjective quality, IBCN, Thin client computing

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 2.60 MB

Citation

Please use this url to cite or link to this publication:

MLA
Vankeirsbilck, Bert, Dieter Verslype, Nicolas Staelens, et al. “Platform for Real-time Subjective Assessment of Interactive Multimedia Applications.” MULTIMEDIA TOOLS AND APPLICATIONS 72.1 (2014): 749–775. Print.
APA
Vankeirsbilck, B., Verslype, D., Staelens, N., Simoens, P., Develder, C., Demeester, P., De Turck, F., et al. (2014). Platform for real-time subjective assessment of interactive multimedia applications. MULTIMEDIA TOOLS AND APPLICATIONS, 72(1), 749–775.
Chicago author-date
Vankeirsbilck, Bert, Dieter Verslype, Nicolas Staelens, Pieter Simoens, Chris Develder, Piet Demeester, Filip De Turck, and Bart Dhoedt. 2014. “Platform for Real-time Subjective Assessment of Interactive Multimedia Applications.” Multimedia Tools and Applications 72 (1): 749–775.
Chicago author-date (all authors)
Vankeirsbilck, Bert, Dieter Verslype, Nicolas Staelens, Pieter Simoens, Chris Develder, Piet Demeester, Filip De Turck, and Bart Dhoedt. 2014. “Platform for Real-time Subjective Assessment of Interactive Multimedia Applications.” Multimedia Tools and Applications 72 (1): 749–775.
Vancouver
1.
Vankeirsbilck B, Verslype D, Staelens N, Simoens P, Develder C, Demeester P, et al. Platform for real-time subjective assessment of interactive multimedia applications. MULTIMEDIA TOOLS AND APPLICATIONS. 2014;72(1):749–75.
IEEE
[1]
B. Vankeirsbilck et al., “Platform for real-time subjective assessment of interactive multimedia applications,” MULTIMEDIA TOOLS AND APPLICATIONS, vol. 72, no. 1, pp. 749–775, 2014.
@article{4278400,
  abstract     = {With the advent of cloud computing and remote execution of interactive applications, there is a need for evaluating the Quality of Experience (QoE) and the influence on this QoE of network condition variations, media encoding parameter settings and related optimization algorithms. However, current QoE assessment focuses mainly on audiovisual quality in non-interactive applications, such as video-on-demand services. On the other hand, where experiments aim to quantify interactive quality, the focus is typically targeted at games, using an ad-hoc test setup to assess the impact of network variations on the playing experience. In this paper, we present a novel platform enabling the assessment of a broad range of interactive applications (e.g., thin client remote desktop systems, remotely rendered engineering applications, games). Dynamic reconfiguration of media encoding and decoding is built into the system, to allow dynamic adaptation of the media encoding to the network conditions and the application characteristics. Evaluating the influence of these automatic adaptations is a key asset of our approach. A range of possible use cases is discussed, as well as a performance study of our implementation, showing that the platform we built is capable of highly controllable subjective user assessment. Furthermore, we present results obtained by applying the platform for a subjective evaluation of an interactive multimedia application. Specifically, the influence of visual quality and frame rate on interactive QoE has been assessed for a remotely executed race game.},
  author       = {Vankeirsbilck, Bert and Verslype, Dieter and Staelens, Nicolas and Simoens, Pieter and Develder, Chris and Demeester, Piet and De Turck, Filip and Dhoedt, Bart},
  issn         = {1573-7721},
  journal      = {MULTIMEDIA TOOLS AND APPLICATIONS},
  keywords     = {NETWORK QUALITY,PERFORMANCE,EXPERIENCE,FRAMEWORK,Interactive media quality assessment,Quality of experience,Interactivity,Subjective quality,IBCN,Thin client computing},
  language     = {eng},
  number       = {1},
  pages        = {749--775},
  title        = {Platform for real-time subjective assessment of interactive multimedia applications},
  url          = {http://dx.doi.org/10.1007/s11042-013-1395-y},
  volume       = {72},
  year         = {2014},
}

Altmetric
View in Altmetric
Web of Science
Times cited: