Advanced search
1 file | 1.06 MB Add to list

Segment-then-segment : context-preserving crop-based segmentation for large biomedical images

(2023) SENSORS. 23(2).
Author
Organization
Project
Abstract
Medical images are often of huge size, which presents a challenge in terms of memory requirements when training machine learning models. Commonly, the images are downsampled to overcome this challenge, but this leads to a loss of information. We present a general approach for training semantic segmentation neural networks on much smaller input sizes called Segment-then-Segment. To reduce the input size, we use image crops instead of downscaling. One neural network performs the initial segmentation on a downscaled image. This segmentation is then used to take the most salient crops of the full-resolution image with the surrounding context. Each crop is segmented using a second specially trained neural network. The segmentation masks of each crop are joined to form the final output image. We evaluate our approach on multiple medical image modalities (microscopy, colonoscopy, and CT) and show that this approach greatly improves segmentation performance with small network input sizes when compared to baseline models trained on downscaled images, especially in terms of pixel-wise recall.
Keywords
biomedical images, convolutional neural networks, medical image, segmentation, semantic segmentation

Downloads

  • sensors-23-00633-v2.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 1.06 MB

Citation

Please use this url to cite or link to this publication:

MLA
Benčević, Marin, et al. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS, vol. 23, no. 2, 2023, doi:10.3390/s23020633.
APA
Benčević, M., Qiu, Y., Galić, I., & Pizurica, A. (2023). Segment-then-segment : context-preserving crop-based segmentation for large biomedical images. SENSORS, 23(2). https://doi.org/10.3390/s23020633
Chicago author-date
Benčević, Marin, Yuming Qiu, Irena Galić, and Aleksandra Pizurica. 2023. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS 23 (2). https://doi.org/10.3390/s23020633.
Chicago author-date (all authors)
Benčević, Marin, Yuming Qiu, Irena Galić, and Aleksandra Pizurica. 2023. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS 23 (2). doi:10.3390/s23020633.
Vancouver
1.
Benčević M, Qiu Y, Galić I, Pizurica A. Segment-then-segment : context-preserving crop-based segmentation for large biomedical images. SENSORS. 2023;23(2).
IEEE
[1]
M. Benčević, Y. Qiu, I. Galić, and A. Pizurica, “Segment-then-segment : context-preserving crop-based segmentation for large biomedical images,” SENSORS, vol. 23, no. 2, 2023.
@article{01GP83BJ3JYN7QZX1DWHRVD43N,
  abstract     = {{Medical images are often of huge size, which presents a challenge in terms of memory requirements when training machine learning models. Commonly, the images are downsampled to overcome this challenge, but this leads to a loss of information. We present a general approach for training semantic segmentation neural networks on much smaller input sizes called Segment-then-Segment. To reduce the input size, we use image crops instead of downscaling. One neural network performs the initial segmentation on a downscaled image. This segmentation is then used to take the most salient crops of the full-resolution image with the surrounding context. Each crop is segmented using a second specially trained neural network. The segmentation masks of each crop are joined to form the final output image. We evaluate our approach on multiple medical image modalities (microscopy, colonoscopy, and CT) and show that this approach greatly improves segmentation performance with small network input sizes when compared to baseline models trained on downscaled images, especially in terms of pixel-wise recall.}},
  articleno    = {{633}},
  author       = {{Benčević, Marin and Qiu, Yuming and Galić, Irena and Pizurica, Aleksandra}},
  issn         = {{1424-8220}},
  journal      = {{SENSORS}},
  keywords     = {{biomedical images,convolutional neural networks,medical image,segmentation,semantic segmentation}},
  language     = {{eng}},
  number       = {{2}},
  pages        = {{16}},
  title        = {{Segment-then-segment : context-preserving crop-based segmentation for large biomedical images}},
  url          = {{http://doi.org/10.3390/s23020633}},
  volume       = {{23}},
  year         = {{2023}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: