Advanced search
2 files | 2.65 MB Add to list

Assessing the importance of audio/video synchronization for simultaneous translation of video sequences

(2012) MULTIMEDIA SYSTEMS. 18(6). p.445-457
Author
Organization
Abstract
Lip synchronization is considered a key parameter during interactive communication. In the case of video conferencing and television broadcasting, the differential delay between audio and video should remain below certain thresholds, as recommended by several standardization bodies. However, further research has also shown that these thresholds can be relaxed, depending on the targeted application and use case. In this article, we investigate the influence of lip sync on the ability to perform real-time language interpretation during video conferencing. Furthermore, we are also interested in determining proper lip sync visibility thresholds applicable to this use case. Therefore, we conducted a subjective experiment using expert interpreters, which were required to perform a simultaneous translation, and non-experts. Our results show that significant differences are obtained when conducting subjective experiments with expert interpreters. As interpreters are primarily focused on performing the simultaneous translation, lip sync detectability thresholds are higher compared with existing recommended thresholds. As such, primary focus and the targeted application and use case are important factors to be considered when selecting proper lip sync acceptability thresholds.
Keywords
IBCN, Audio/video synchronization, Audiovisual quality, Lip sync, Subjective quality assessment, Language interpretation

Downloads

  • 5491 i.pdf
    • full text
    • |
    • open access
    • |
    • PDF
    • |
    • 1.19 MB
  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 1.47 MB

Citation

Please use this url to cite or link to this publication:

MLA
Staelens, Nicolas et al. “Assessing the Importance of Audio/video Synchronization for Simultaneous Translation of Video Sequences.” MULTIMEDIA SYSTEMS 18.6 (2012): 445–457. Print.
APA
Staelens, N., De Meulenaere, J., Bleumers, L., Van Wallendael, G., De Cock, J., Geeraert, K., Vercammen, N., et al. (2012). Assessing the importance of audio/video synchronization for simultaneous translation of video sequences. MULTIMEDIA SYSTEMS, 18(6), 445–457.
Chicago author-date
Staelens, Nicolas, Jonas De Meulenaere, Lizzy Bleumers, Glenn Van Wallendael, Jan De Cock, Koen Geeraert, Nick Vercammen, et al. 2012. “Assessing the Importance of Audio/video Synchronization for Simultaneous Translation of Video Sequences.” Multimedia Systems 18 (6): 445–457.
Chicago author-date (all authors)
Staelens, Nicolas, Jonas De Meulenaere, Lizzy Bleumers, Glenn Van Wallendael, Jan De Cock, Koen Geeraert, Nick Vercammen, Wendy Van den Broeck, Brecht Vermeulen, Rik Van de Walle, and Piet Demeester. 2012. “Assessing the Importance of Audio/video Synchronization for Simultaneous Translation of Video Sequences.” Multimedia Systems 18 (6): 445–457.
Vancouver
1.
Staelens N, De Meulenaere J, Bleumers L, Van Wallendael G, De Cock J, Geeraert K, et al. Assessing the importance of audio/video synchronization for simultaneous translation of video sequences. MULTIMEDIA SYSTEMS. 2012;18(6):445–57.
IEEE
[1]
N. Staelens et al., “Assessing the importance of audio/video synchronization for simultaneous translation of video sequences,” MULTIMEDIA SYSTEMS, vol. 18, no. 6, pp. 445–457, 2012.
@article{3234654,
  abstract     = {Lip synchronization is considered a key parameter during interactive communication. In the case of video conferencing and television broadcasting, the differential delay between audio and video should remain below certain thresholds, as recommended by several standardization bodies. However, further research has also shown that these thresholds can be relaxed, depending on the targeted application and use case. In this article, we investigate the influence of lip sync on the ability to perform real-time language interpretation during video conferencing. Furthermore, we are also interested in determining proper lip sync visibility thresholds applicable to this use case. Therefore, we conducted a subjective experiment using expert interpreters, which were required to perform a simultaneous translation, and non-experts. Our results show that significant differences are obtained when conducting subjective experiments with expert interpreters. As interpreters are primarily focused on performing the simultaneous translation, lip sync detectability thresholds are higher compared with existing recommended thresholds. As such, primary focus and the targeted application and use case are important factors to be considered when selecting proper lip sync acceptability thresholds.},
  author       = {Staelens, Nicolas and De Meulenaere, Jonas and Bleumers, Lizzy and Van Wallendael, Glenn and De Cock, Jan and Geeraert, Koen and Vercammen, Nick and Van den Broeck, Wendy and Vermeulen, Brecht and Van de Walle, Rik and Demeester, Piet},
  issn         = {0942-4962},
  journal      = {MULTIMEDIA SYSTEMS},
  keywords     = {IBCN,Audio/video synchronization,Audiovisual quality,Lip sync,Subjective quality assessment,Language interpretation},
  language     = {eng},
  number       = {6},
  pages        = {445--457},
  title        = {Assessing the importance of audio/video synchronization for simultaneous translation of video sequences},
  url          = {http://dx.doi.org/10.1007/s00530-012-0262-4},
  volume       = {18},
  year         = {2012},
}

Altmetric
View in Altmetric
Web of Science
Times cited: