Project: M3-Apps: Enabling User-centric Modelling of Immersiveness in Multimodal Multimedia Applications
2021-11-01 – 2025-10-31
- Abstract
Multimodal, immersive systems are the latest development within the field of multimedia. These systems emulate the senses by means of omnidirectional visuals, 360° sound, motion tracking and touch simulation to create a feeling of presence in the virtual environment. They have the potential to substitute physical interactions in application domains such as training (Industry 4.0), or e-health (tele-surgery). However, the current COVID19 pandemic has shown that they are not ready, as they do not fulfill the requirements in terms of immersiveness. In this research project, I argue that immersiveness can be devised from measuring four aspects, namely: presence (i.e. the feeling of being "in" the environment), cybersickness, network-related Quality of Experience and the usability of the application. Therefore, this project proposes a user-centric approach on the assessment and modelling of immersiveness. Two dimensions are put forward: (1) Subjective and objective assessment of presence, cybersickness, usability and QoE and (2) Real-time modelling of immersiveness. Furthermore, a proof-of-concept is designed including two use cases. As such, this work will significantly advance the state of the art on immersive systems and multimedia in general.
-
- Journal Article
- A1
- open access
Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
-
- Journal Article
- A1
- open access
Physiology-driven cybersickness detection in virtual reality : a machine learning and explainable AI approach
-
- Journal Article
- A1
- open access
Toward interactive multi-user extended reality using millimeter-wave networking
-
- Conference Paper
- P1
- open access
Collaborative cooking in VR : effects of network distortion in multi-user virtual environments
-
- Journal Article
- A1
- open access
Impact of latency on QoE, performance, and collaboration in interactive multi-user virtual reality
-
- Journal Article
- A1
- open access
Characterization of the quality of experience and immersion of point cloud videos in augmented reality through a subjective study
-
- Conference Paper
- C1
- open access
A haptic-enabled, distributed and networked immersive system for multi-user collaborative virtual reality
-
- Conference Paper
- P1
- open access
Are we ready for haptic interactivity in VR? An experimental comparison of different interaction methods in virtual reality training
-
- Conference Paper
- P1
- open access
Impact of quality and distance on the perception of point clouds in mixed reality
-
- Conference Paper
- P1
- open access
Immersive and interactive subjective quality assessment of dynamic volumetric meshes