Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors
- Author
- Frieke Vancoillie (UGent) , Soetkin Gardin (UGent) , Frederik Anseel (UGent) , Wouter Duyck (UGent) , Lieven Verbeke (UGent) and Robert De Wulf (UGent)
- Organization
- Abstract
- This study tackles a common, yet underrated problem in remote-sensing image analysis: the fact that human interpretation is highly variable among different operators. Despite current technological advancements, human perception and interpretation are still vital components of the map-making process. Consequently, human errors can considerably bias both mapping and modelling results. In our study, we present a web-based tool to quantify operator variability and to identify the human and external factors affecting this variability. Human operators were given a series of images and were asked to hand-digitize different point, line, and polygon objects. The quantification of performance variability was achieved using both thematic and positional accuracy measures. Subsequently, a series of questions related to demographics, experience, and personality were asked, and the answers were also quantified. Correlation and regression analysis was then used to explain the variability in operator performance. From our study, we conclude that: (1) humans were seldom perfect in visual interpretation; (2) some geographic objects were more complex to accurately digitize than others; (3) there was a high degree of variability among image interpreters when hand-digitizing the same objects; and (4) operator performance was mainly determined by demographic, non-cognitive, and cognitive personality factors, whereas external and technical factors influenced operator performance to a lesser extent. Finally, the results also indicated a gradual decline in performance over time, mimicking classical mental fatigue effects.
- Keywords
- IBCN, PREDICTS INDIVIDUAL-DIFFERENCES, PERSONALITY-TRAITS, SHORT-TERM-MEMORY, VISUAL WORKING-MEMORY, ACCURACY ASSESSMENT, VALIDATION, CAPACITY, OBSERVERS, CULTURES, PSYCHOLOGY
Downloads
-
(...).pdf
- full text
- |
- UGent only
- |
- |
- 1.05 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-5876083
- MLA
- Vancoillie, Frieke, et al. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING, vol. 35, no. 2, 2014, pp. 754–78, doi:10.1080/01431161.2013.873152.
- APA
- Vancoillie, F., Gardin, S., Anseel, F., Duyck, W., Verbeke, L., & De Wulf, R. (2014). Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors. INTERNATIONAL JOURNAL OF REMOTE SENSING, 35(2), 754–778. https://doi.org/10.1080/01431161.2013.873152
- Chicago author-date
- Vancoillie, Frieke, Soetkin Gardin, Frederik Anseel, Wouter Duyck, Lieven Verbeke, and Robert De Wulf. 2014. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING 35 (2): 754–78. https://doi.org/10.1080/01431161.2013.873152.
- Chicago author-date (all authors)
- Vancoillie, Frieke, Soetkin Gardin, Frederik Anseel, Wouter Duyck, Lieven Verbeke, and Robert De Wulf. 2014. “Variability of Operator Performance in Remote-Sensing Image Interpretation: The Importance of Human and External Factors.” INTERNATIONAL JOURNAL OF REMOTE SENSING 35 (2): 754–778. doi:10.1080/01431161.2013.873152.
- Vancouver
- 1.Vancoillie F, Gardin S, Anseel F, Duyck W, Verbeke L, De Wulf R. Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors. INTERNATIONAL JOURNAL OF REMOTE SENSING. 2014;35(2):754–78.
- IEEE
- [1]F. Vancoillie, S. Gardin, F. Anseel, W. Duyck, L. Verbeke, and R. De Wulf, “Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors,” INTERNATIONAL JOURNAL OF REMOTE SENSING, vol. 35, no. 2, pp. 754–778, 2014.
@article{5876083, abstract = {{This study tackles a common, yet underrated problem in remote-sensing image analysis: the fact that human interpretation is highly variable among different operators. Despite current technological advancements, human perception and interpretation are still vital components of the map-making process. Consequently, human errors can considerably bias both mapping and modelling results. In our study, we present a web-based tool to quantify operator variability and to identify the human and external factors affecting this variability. Human operators were given a series of images and were asked to hand-digitize different point, line, and polygon objects. The quantification of performance variability was achieved using both thematic and positional accuracy measures. Subsequently, a series of questions related to demographics, experience, and personality were asked, and the answers were also quantified. Correlation and regression analysis was then used to explain the variability in operator performance. From our study, we conclude that: (1) humans were seldom perfect in visual interpretation; (2) some geographic objects were more complex to accurately digitize than others; (3) there was a high degree of variability among image interpreters when hand-digitizing the same objects; and (4) operator performance was mainly determined by demographic, non-cognitive, and cognitive personality factors, whereas external and technical factors influenced operator performance to a lesser extent. Finally, the results also indicated a gradual decline in performance over time, mimicking classical mental fatigue effects.}}, author = {{Vancoillie, Frieke and Gardin, Soetkin and Anseel, Frederik and Duyck, Wouter and Verbeke, Lieven and De Wulf, Robert}}, issn = {{0143-1161}}, journal = {{INTERNATIONAL JOURNAL OF REMOTE SENSING}}, keywords = {{IBCN,PREDICTS INDIVIDUAL-DIFFERENCES,PERSONALITY-TRAITS,SHORT-TERM-MEMORY,VISUAL WORKING-MEMORY,ACCURACY ASSESSMENT,VALIDATION,CAPACITY,OBSERVERS,CULTURES,PSYCHOLOGY}}, language = {{eng}}, number = {{2}}, pages = {{754--778}}, title = {{Variability of operator performance in remote-sensing image interpretation: the importance of human and external factors}}, url = {{http://doi.org/10.1080/01431161.2013.873152}}, volume = {{35}}, year = {{2014}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: