Advanced search
1 file | 1.82 MB Add to list

Enabling user-centric assessment and modelling of immersiveness in multimodal multimedia applications

Sam Van Damme (UGent) , Maria Torres Vega (UGent) and Filip De Turck (UGent)
Author
Organization
Abstract
Multimodal, immersive systems are the latest development within the field of multimedia. These systems emulate the senses by means of omnidirectional visuals, 360° sound, motion tracking and touch simulation to create a feeling of presence in the virtual environment. They have the potential to substitute physical interactions in application domains such as training (Industry 4.0) or e-health (tele-surgery). However, the COVID-19 pandemic has shown that they are not ready, as they still have room for improvement in terms of network streaming quality, usability and the users’ feeling of presence. In addition, these systems can induce feelings of dizziness, nausea etc. (i.e. cybersickness). These factors therefore have an important impact on the user’s total immersion. In this work, we therefore propose that immersiveness can be devised from measuring four aspects, namely: presence (i.e. the feeling of being "in" the environment), cybersickness, network related Quality-of-Experience (QoE) and the usability of the application. Therefore, a two-dimensional user-centric approach on the assessment and modelling of immersiveness is proposed. These dimensions include (i) subjective and objective assessment of presence, cybersickness, usability and QoE and (ii) real-time modelling of immersiveness. Furthermore, a proof-of-concept is envisioned including two use cases. As such, we believe that this position paper will significantly advance the state of the art on immersive systems and multimedia in general.

Downloads

  • 8154.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 1.82 MB

Citation

Please use this url to cite or link to this publication:

MLA
Van Damme, Sam, et al. “Enabling User-Centric Assessment and Modelling of Immersiveness in Multimodal Multimedia Applications.” Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022), 2022, pp. 33–42.
APA
Van Damme, S., Torres Vega, M., & De Turck, F. (2022). Enabling user-centric assessment and modelling of immersiveness in multimodal multimedia applications. Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022), 33–42.
Chicago author-date
Van Damme, Sam, Maria Torres Vega, and Filip De Turck. 2022. “Enabling User-Centric Assessment and Modelling of Immersiveness in Multimodal Multimedia Applications.” In Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022), 33–42.
Chicago author-date (all authors)
Van Damme, Sam, Maria Torres Vega, and Filip De Turck. 2022. “Enabling User-Centric Assessment and Modelling of Immersiveness in Multimodal Multimedia Applications.” In Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022), 33–42.
Vancouver
1.
Van Damme S, Torres Vega M, De Turck F. Enabling user-centric assessment and modelling of immersiveness in multimodal multimedia applications. In: Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022). 2022. p. 33–42.
IEEE
[1]
S. Van Damme, M. Torres Vega, and F. De Turck, “Enabling user-centric assessment and modelling of immersiveness in multimodal multimedia applications,” in Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022), Aveiro, Portugal, 2022, pp. 33–42.
@inproceedings{8767083,
  abstract     = {{Multimodal, immersive systems are the latest development within the field of multimedia. These systems emulate the senses by means of omnidirectional visuals, 360° sound, motion tracking and touch simulation to create a feeling of presence in the virtual environment. They have the potential to substitute physical interactions in application domains such as training (Industry 4.0) or e-health (tele-surgery). However, the COVID-19 pandemic has shown that they are not ready, as they still have room for improvement in terms of network streaming quality, usability and the users’ feeling of presence. In addition, these systems can induce feelings of dizziness, nausea etc. (i.e. cybersickness). These factors therefore have an important impact on the user’s total immersion. In this work, we therefore propose that immersiveness can be devised from measuring four aspects, namely: presence (i.e. the feeling of being "in" the environment), cybersickness, network related Quality-of-Experience (QoE) and the usability of the application. Therefore, a two-dimensional user-centric approach on the assessment and modelling of immersiveness is proposed. These dimensions include (i) subjective and objective assessment of presence, cybersickness, usability and QoE and (ii) real-time modelling of immersiveness. Furthermore, a proof-of-concept is envisioned including two use cases. As such, we believe that this position paper will significantly advance the state of the art on immersive systems and multimedia in general.}},
  author       = {{Van Damme, Sam and Torres Vega, Maria and De Turck, Filip}},
  booktitle    = {{Doctoral Consortium : ACM International Conference on Interactive Media Experiences (IMX 2022)}},
  language     = {{eng}},
  location     = {{Aveiro, Portugal}},
  pages        = {{33--42}},
  title        = {{Enabling user-centric assessment and modelling of immersiveness in multimodal multimedia applications}},
  url          = {{https://figshare.com/articles/conference_contribution/Doctoral_Consortium_6_-_Enabling_User-centric_Assessment_and_Modelling_of_Immersiveness_in_Multimodal_Multimedia_Applications/19794148?backTo=/collections/Adjunct_Proceedings_of_the_ACM_International_Conference_on_Interactive_Media_Experiences_IMX_2022/5854662}},
  year         = {{2022}},
}