Ghent University Academic Bibliography

Advanced

Influence of study design on digital pathology image quality evaluation : the need to define a clinical task

Ljiljana Platisa UGent, Leen Van Brantegem UGent, Asli Kumcu UGent, Richard Ducatelle UGent and Wilfried Philips UGent (2017) JOURNAL OF MEDICAL IMAGING. 4(2).
abstract
Despite the current rapid advance in technologies for whole slide imaging, there is still no scientific consensus on the recommended methodology for image quality assessment of digital pathology slides. For medical images in general, it has been recommended to assess image quality in terms of doctors’ success rates in performing a specific clinical task while using the images (clinical image quality, cIQ). However, digital pathology is a new modality, and already identifying the appropriate task is difficult. In an alternative common approach, humans are asked to do a simpler task such as rating overall image quality (perceived image quality, pIQ), but that involves the risk of nonclinically relevant findings due to an unknown relationship between the pIQ and cIQ. In this study, we explored three different experimental protocols: (1) conducting a clinical task (detecting inclusion bodies), (2) rating image similarity and preference, and (3) rating the overall image quality. Additionally, within protocol 1, overall quality ratings were also collected (task-aware pIQ). The experiments were done by diagnostic veterinary pathologists in the context of evaluating the quality of hematoxylin and eosin-stained digital pathology slides of animal tissue samples under several common image alterations: additive noise, blurring, change in gamma, change in color saturation, and JPG compression. While the size of our experiments was small and prevents drawing strong conclusions, the results suggest the need to define a clinical task. Importantly, the pIQ data collected under protocols 2 and 3 did not always rank the image alterations the same as their cIQ from protocol 1, warning against using conventional pIQ to predict cIQ. At the same time, there was a correlation between the cIQ and task-aware pIQ ratings from protocol 1, suggesting that the clinical experiment context (set by specifying the clinical task) may affect human visual attention and bring focus to their criteria of image quality. Further research is needed to assess whether and for which purposes (e.g., preclinical testing) task-aware pIQ ratings could substitute cIQ for a given clinical task.
Please use this url to cite or link to this publication:
author
organization
year
type
journalArticle (original)
publication status
published
subject
keyword
digital pathology, image quality, human observer, signal detection, image compression
journal title
JOURNAL OF MEDICAL IMAGING
J. Med. Imaging
volume
4
issue
2
article number
021108
pages
12 pages
ISSN
2329-4302
DOI
10.1117/1.jmi.4.2.021108
language
English
UGent publication?
yes
classification
A2
copyright statement
I have retained and own the full copyright for this publication
id
8525393
handle
http://hdl.handle.net/1854/LU-8525393
date created
2017-06-27 13:58:23
date last changed
2017-06-30 07:49:44
@article{8525393,
  abstract     = {Despite the current rapid advance in technologies for whole slide imaging, there is still no scientific consensus on the recommended methodology for image quality assessment of digital pathology slides. For medical images in general, it has been recommended to assess image quality in terms of doctors{\textquoteright} success rates in performing a specific clinical task while using the images (clinical image quality, cIQ). However, digital pathology is a new modality, and already identifying the appropriate task is difficult. In an alternative common approach, humans are asked to do a simpler task such as rating overall image quality (perceived image quality, pIQ), but that involves the risk of nonclinically relevant findings due to an unknown relationship between the pIQ and cIQ. In this study, we explored three different experimental protocols: (1) conducting a clinical task (detecting inclusion bodies), (2) rating image similarity and preference, and (3) rating the overall image quality. Additionally, within protocol 1, overall quality ratings were also collected (task-aware pIQ). The experiments were done by diagnostic veterinary pathologists in the context of evaluating the quality of hematoxylin and eosin-stained digital pathology slides of animal tissue samples under several common image alterations: additive noise, blurring, change in gamma, change in color saturation, and JPG compression. While the size of our experiments was small and prevents drawing strong conclusions, the results suggest the need to define a clinical task. Importantly, the pIQ data collected under protocols 2 and 3 did not always rank the image alterations the
same as their cIQ from protocol 1, warning against using conventional pIQ to predict cIQ. At the same time, there was a correlation between the cIQ and task-aware pIQ ratings from protocol 1, suggesting that the clinical experiment context (set by specifying the clinical task) may affect human visual attention and bring focus to their criteria of image quality. Further research is needed to assess whether and for which purposes (e.g., preclinical testing) task-aware pIQ ratings could substitute cIQ for a given clinical task.},
  articleno    = {021108},
  author       = {Platisa, Ljiljana and Van Brantegem, Leen and Kumcu, Asli and Ducatelle, Richard and Philips, Wilfried},
  issn         = {2329-4302},
  journal      = {JOURNAL OF MEDICAL IMAGING},
  keyword      = {digital pathology,image quality,human observer,signal detection,image compression},
  language     = {eng},
  number       = {2},
  pages        = {12},
  title        = {Influence of study design on digital pathology image quality evaluation : the need to define a clinical task},
  url          = {http://dx.doi.org/10.1117/1.jmi.4.2.021108},
  volume       = {4},
  year         = {2017},
}

Chicago
Platisa, Ljiljana, Leen Van Brantegem, Asli Kumcu, Richard Ducatelle, and Wilfried Philips. 2017. “Influence of Study Design on Digital Pathology Image Quality Evaluation : the Need to Define a Clinical Task.” Journal of Medical Imaging 4 (2).
APA
Platisa, L., Van Brantegem, L., Kumcu, A., Ducatelle, R., & Philips, W. (2017). Influence of study design on digital pathology image quality evaluation : the need to define a clinical task. JOURNAL OF MEDICAL IMAGING, 4(2).
Vancouver
1.
Platisa L, Van Brantegem L, Kumcu A, Ducatelle R, Philips W. Influence of study design on digital pathology image quality evaluation : the need to define a clinical task. JOURNAL OF MEDICAL IMAGING. 2017;4(2).
MLA
Platisa, Ljiljana, Leen Van Brantegem, Asli Kumcu, et al. “Influence of Study Design on Digital Pathology Image Quality Evaluation : the Need to Define a Clinical Task.” JOURNAL OF MEDICAL IMAGING 4.2 (2017): n. pag. Print.