Segment-then-segment : context-preserving crop-based segmentation for large biomedical images
- Author
- Marin Benčević (UGent) , Yuming Qiu (UGent) , Irena Galić and Aleksandra Pizurica (UGent)
- Organization
- Project
- Abstract
- Medical images are often of huge size, which presents a challenge in terms of memory requirements when training machine learning models. Commonly, the images are downsampled to overcome this challenge, but this leads to a loss of information. We present a general approach for training semantic segmentation neural networks on much smaller input sizes called Segment-then-Segment. To reduce the input size, we use image crops instead of downscaling. One neural network performs the initial segmentation on a downscaled image. This segmentation is then used to take the most salient crops of the full-resolution image with the surrounding context. Each crop is segmented using a second specially trained neural network. The segmentation masks of each crop are joined to form the final output image. We evaluate our approach on multiple medical image modalities (microscopy, colonoscopy, and CT) and show that this approach greatly improves segmentation performance with small network input sizes when compared to baseline models trained on downscaled images, especially in terms of pixel-wise recall.
- Keywords
- biomedical images, convolutional neural networks, medical image, segmentation, semantic segmentation
Downloads
-
sensors-23-00633-v2.pdf
- full text (Published version)
- |
- open access
- |
- |
- 1.06 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01GP83BJ3JYN7QZX1DWHRVD43N
- MLA
- Benčević, Marin, et al. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS, vol. 23, no. 2, 2023, doi:10.3390/s23020633.
- APA
- Benčević, M., Qiu, Y., Galić, I., & Pizurica, A. (2023). Segment-then-segment : context-preserving crop-based segmentation for large biomedical images. SENSORS, 23(2). https://doi.org/10.3390/s23020633
- Chicago author-date
- Benčević, Marin, Yuming Qiu, Irena Galić, and Aleksandra Pizurica. 2023. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS 23 (2). https://doi.org/10.3390/s23020633.
- Chicago author-date (all authors)
- Benčević, Marin, Yuming Qiu, Irena Galić, and Aleksandra Pizurica. 2023. “Segment-Then-Segment : Context-Preserving Crop-Based Segmentation for Large Biomedical Images.” SENSORS 23 (2). doi:10.3390/s23020633.
- Vancouver
- 1.Benčević M, Qiu Y, Galić I, Pizurica A. Segment-then-segment : context-preserving crop-based segmentation for large biomedical images. SENSORS. 2023;23(2).
- IEEE
- [1]M. Benčević, Y. Qiu, I. Galić, and A. Pizurica, “Segment-then-segment : context-preserving crop-based segmentation for large biomedical images,” SENSORS, vol. 23, no. 2, 2023.
@article{01GP83BJ3JYN7QZX1DWHRVD43N, abstract = {{Medical images are often of huge size, which presents a challenge in terms of memory requirements when training machine learning models. Commonly, the images are downsampled to overcome this challenge, but this leads to a loss of information. We present a general approach for training semantic segmentation neural networks on much smaller input sizes called Segment-then-Segment. To reduce the input size, we use image crops instead of downscaling. One neural network performs the initial segmentation on a downscaled image. This segmentation is then used to take the most salient crops of the full-resolution image with the surrounding context. Each crop is segmented using a second specially trained neural network. The segmentation masks of each crop are joined to form the final output image. We evaluate our approach on multiple medical image modalities (microscopy, colonoscopy, and CT) and show that this approach greatly improves segmentation performance with small network input sizes when compared to baseline models trained on downscaled images, especially in terms of pixel-wise recall.}}, articleno = {{633}}, author = {{Benčević, Marin and Qiu, Yuming and Galić, Irena and Pizurica, Aleksandra}}, issn = {{1424-8220}}, journal = {{SENSORS}}, keywords = {{biomedical images,convolutional neural networks,medical image,segmentation,semantic segmentation}}, language = {{eng}}, number = {{2}}, pages = {{16}}, title = {{Segment-then-segment : context-preserving crop-based segmentation for large biomedical images}}, url = {{http://doi.org/10.3390/s23020633}}, volume = {{23}}, year = {{2023}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: