Advanced search
1 file | 1.05 MB Add to list

Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors

Frieke Vancoillie (UGent) , Soetkin Gardin (UGent) , Frederik Anseel (UGent) , Wouter Duyck (UGent) , Lieven Verbeke (UGent) and Robert De Wulf (UGent)
Author
Organization
Abstract
This study tackles a common, yet underrated problem in remote-sensing image analysis: the fact that human interpretation is highly variable among different operators. Despite current technological advancements, human perception and interpretation are still vital components of the map-making process. Consequently, human errors can considerably bias both mapping and modelling results. In our study, we present a web-based tool to quantify operator variability and to identify the human and external factors affecting this variability. Human operators were given a series of images and were asked to hand-digitize different point, line, and polygon objects. The quantification of performance variability was achieved using both thematic and positional accuracy measures. Subsequently, a series of questions related to demographics, experience, and personality were asked, and the answers were also quantified. Correlation and regression analysis was then used to explain the variability in operator performance. From our study, we conclude that: (1) humans were seldom perfect in visual interpretation; (2) some geographic objects were more complex to accurately digitize than others; (3) there was a high degree of variability among image interpreters when hand-digitizing the same objects; and (4) operator performance was mainly determined by demographic, non-cognitive, and cognitive personality factors, whereas external and technical factors influenced operator performance to a lesser extent. Finally, the results also indicated a gradual decline in performance over time, mimicking classical mental fatigue effects.
Keywords
IBCN, PREDICTS INDIVIDUAL-DIFFERENCES, PERSONALITY-TRAITS, SHORT-TERM-MEMORY, VISUAL WORKING-MEMORY, ACCURACY ASSESSMENT, VALIDATION, CAPACITY, OBSERVERS, CULTURES, PSYCHOLOGY

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 1.05 MB

Citation

Please use this url to cite or link to this publication:

MLA
Vancoillie, Frieke, et al. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING, vol. 35, no. 2, 2014, pp. 754–78, doi:10.1080/01431161.2013.873152.
APA
Vancoillie, F., Gardin, S., Anseel, F., Duyck, W., Verbeke, L., & De Wulf, R. (2014). Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors. INTERNATIONAL JOURNAL OF REMOTE SENSING, 35(2), 754–778. https://doi.org/10.1080/01431161.2013.873152
Chicago author-date
Vancoillie, Frieke, Soetkin Gardin, Frederik Anseel, Wouter Duyck, Lieven Verbeke, and Robert De Wulf. 2014. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING 35 (2): 754–78. https://doi.org/10.1080/01431161.2013.873152.
Chicago author-date (all authors)
Vancoillie, Frieke, Soetkin Gardin, Frederik Anseel, Wouter Duyck, Lieven Verbeke, and Robert De Wulf. 2014. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING 35 (2): 754–778. doi:10.1080/01431161.2013.873152.
Vancouver
1.
Vancoillie F, Gardin S, Anseel F, Duyck W, Verbeke L, De Wulf R. Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors. INTERNATIONAL JOURNAL OF REMOTE SENSING. 2014;35(2):754–78.
IEEE
[1]
F. Vancoillie, S. Gardin, F. Anseel, W. Duyck, L. Verbeke, and R. De Wulf, “Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors,” INTERNATIONAL JOURNAL OF REMOTE SENSING, vol. 35, no. 2, pp. 754–778, 2014.
@article{5876083,
  abstract     = {{This study tackles a common, yet underrated problem in remote-sensing image analysis: the fact that human interpretation is highly variable among different operators. Despite current technological advancements, human perception and interpretation are still vital components of the map-making process. Consequently, human errors can considerably bias both mapping and modelling results. In our study, we present a web-based tool to quantify operator variability and to identify the human and external factors affecting this variability. Human operators were given a series of images and were asked to hand-digitize different point, line, and polygon objects. The quantification of performance variability was achieved using both thematic and positional accuracy measures. Subsequently, a series of questions related to demographics, experience, and personality were asked, and the answers were also quantified. Correlation and regression analysis was then used to explain the variability in operator performance. From our study, we conclude that: (1) humans were seldom perfect in visual interpretation; (2) some geographic objects were more complex to accurately digitize than others; (3) there was a high degree of variability among image interpreters when hand-digitizing the same objects; and (4) operator performance was mainly determined by demographic, non-cognitive, and cognitive personality factors, whereas external and technical factors influenced operator performance to a lesser extent. Finally, the results also indicated a gradual decline in performance over time, mimicking classical mental fatigue effects.}},
  author       = {{Vancoillie, Frieke and Gardin, Soetkin and Anseel, Frederik and Duyck, Wouter and Verbeke, Lieven and De Wulf, Robert}},
  issn         = {{0143-1161}},
  journal      = {{INTERNATIONAL JOURNAL OF REMOTE SENSING}},
  keywords     = {{IBCN,PREDICTS INDIVIDUAL-DIFFERENCES,PERSONALITY-TRAITS,SHORT-TERM-MEMORY,VISUAL WORKING-MEMORY,ACCURACY ASSESSMENT,VALIDATION,CAPACITY,OBSERVERS,CULTURES,PSYCHOLOGY}},
  language     = {{eng}},
  number       = {{2}},
  pages        = {{754--778}},
  title        = {{Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors}},
  url          = {{http://doi.org/10.1080/01431161.2013.873152}},
  volume       = {{35}},
  year         = {{2014}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: