Academic Bibliography

 Search 200 years of publications by Ghent University researchers.
Advanced search
1 file | 635.19 KB
Add to list
  1. Search results
  2. I spy with my AI : the effects of AI-...

I spy with my AI : the effects of AI-based visual cueing on human operators’ performance and cognitive load in CCTV control rooms

Jonas De Bruyne (UGent) , Jamil Joundi (UGent) , Jessica Morton, Aleksandra Zheleva (UGent) , Niels Van Kets (UGent) , Glenn Van Wallendael (UGent) , Durk Talsma (UGent) , Jelle Saldien (UGent) , Lieven De Marez (UGent) , Wouter Durnez (UGent) , et al.
(2023) INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS. 95.
Author
Organization
Abstract
The increased number of security cameras in modern cities has elevated the video-feed monitoring demands of closed-circuit television (CCTV) operators. As a result, new AI-driven support systems that leverage the power of computer vision algorithms have been deployed to facilitate the operators' work. However, to effectively design intuitive, AI-driven interfaces and validate their impact on the operators' performance, extensive user testing is required. To address this, we previously developed and tested a virtual reality (VR) control room that can be used to iteratively evaluate intelligent computer assistants and interfaces while operators are subjected to different cognitive load. In the present study, we use this VR environment and physiological markers (e.g., eye tracking measures) to investigate how AI-based visual cueing (i.e., pushing forward video streams on which detections are highlighted by rectangles drawn around targets) affects operator performance and cognitive load. Results suggest that support systems using such technology in a control room improve operators' performance and decrease their cognitive load, as reflected by changes in pupil dilation and subjective reports irrespective of induced cognitive load.
Keywords
Human Factors and Ergonomics, Virtual Reality, AI, Cognitive Load, Artificial intelligence, CCTV, Cognitive load, Visual cueing, User testing, Virtual reality

Downloads

  • Download
    I Spy with my AI International Journal of Industrial Ergonomics JDB.pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 635.19 KB

Citation

Please use this url to cite or link to this publication:

MLA
De Bruyne, Jonas, et al. “I Spy with My AI : The Effects of AI-Based Visual Cueing on Human Operators’ Performance and Cognitive Load in CCTV Control Rooms.” INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, vol. 95, Elsevier BV, 2023, doi:10.1016/j.ergon.2023.103444.
APA
De Bruyne, J., Joundi, J., Morton, J., Zheleva, A., Van Kets, N., Van Wallendael, G., … Bombeke, K. (2023). I spy with my AI : the effects of AI-based visual cueing on human operators’ performance and cognitive load in CCTV control rooms. INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 95. https://doi.org/10.1016/j.ergon.2023.103444
Chicago author-date
De Bruyne, Jonas, Jamil Joundi, Jessica Morton, Aleksandra Zheleva, Niels Van Kets, Glenn Van Wallendael, Durk Talsma, et al. 2023. “I Spy with My AI : The Effects of AI-Based Visual Cueing on Human Operators’ Performance and Cognitive Load in CCTV Control Rooms.” INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS 95. https://doi.org/10.1016/j.ergon.2023.103444.
Chicago author-date (all authors)
De Bruyne, Jonas, Jamil Joundi, Jessica Morton, Aleksandra Zheleva, Niels Van Kets, Glenn Van Wallendael, Durk Talsma, Jelle Saldien, Lieven De Marez, Wouter Durnez, and Klaas Bombeke. 2023. “I Spy with My AI : The Effects of AI-Based Visual Cueing on Human Operators’ Performance and Cognitive Load in CCTV Control Rooms.” INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS 95. doi:10.1016/j.ergon.2023.103444.
Vancouver
1.
De Bruyne J, Joundi J, Morton J, Zheleva A, Van Kets N, Van Wallendael G, et al. I spy with my AI : the effects of AI-based visual cueing on human operators’ performance and cognitive load in CCTV control rooms. INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS. 2023;95.
IEEE
[1]
J. De Bruyne et al., “I spy with my AI : the effects of AI-based visual cueing on human operators’ performance and cognitive load in CCTV control rooms,” INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, vol. 95, 2023.
@article{01GWVF9PPZFMTTMZM17YDB824B,
  abstract     = {{The increased number of security cameras in modern cities has elevated the video-feed monitoring demands of closed-circuit television (CCTV) operators. As a result, new AI-driven support systems that leverage the power of computer vision algorithms have been deployed to facilitate the operators' work. However, to effectively design intuitive, AI-driven interfaces and validate their impact on the operators' performance, extensive user testing is required. To address this, we previously developed and tested a virtual reality (VR) control room that can be used to iteratively evaluate intelligent computer assistants and interfaces while operators are subjected to different cognitive load. In the present study, we use this VR environment and physiological markers (e.g., eye tracking measures) to investigate how AI-based visual cueing (i.e., pushing forward video streams on which detections are highlighted by rectangles drawn around targets) affects operator performance and cognitive load. Results suggest that support systems using such technology in a control room improve operators' performance and decrease their cognitive load, as reflected by changes in pupil dilation and subjective reports irrespective of induced cognitive load.}},
  articleno    = {{103444}},
  author       = {{De Bruyne, Jonas and Joundi, Jamil and Morton, Jessica and Zheleva, Aleksandra and Van Kets, Niels and Van Wallendael, Glenn and Talsma, Durk and Saldien, Jelle and De Marez, Lieven and Durnez, Wouter and Bombeke, Klaas}},
  issn         = {{0169-8141}},
  journal      = {{INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS}},
  keywords     = {{Human Factors and Ergonomics,Virtual Reality,AI,Cognitive Load,Artificial intelligence,CCTV,Cognitive load,Visual cueing,User testing,Virtual reality}},
  language     = {{eng}},
  pages        = {{10}},
  publisher    = {{Elsevier BV}},
  title        = {{I spy with my AI : the effects of AI-based visual cueing on human operators’ performance and cognitive load in CCTV control rooms}},
  url          = {{http://doi.org/10.1016/j.ergon.2023.103444}},
  volume       = {{95}},
  year         = {{2023}},
}
Altmetric
View in Altmetric
Web of Science
Times cited: