Advanced search
2 files | 14.61 MB Add to list

Automatic extraction of specimens from multi-specimen herbaria

Author
Organization
Project
Abstract
Since herbarium specimens are increasingly becoming digitized and accessible in online repositories, an important need has emerged to develop automated tools to process and enrich these collections to facilitate better access to the preserved archives. Particularly, automatic enrichment of multi-specimen herbaria sheets poses unique challenges and problems that have not been adequately addressed. The complexity of localization of species in a page increases exponentially when multiple specimens are present in the same page. This already challenges the performance of models that work accurately with single specimens. Therefore, in this work, we have performed experiments to identify the models that perform well for the plant specimen localization problem. The major bottleneck for performing such experiments was the lack of labeled data. We also address this problem by proposing tools and algorithms to semi-automatically generate annotations for herbarium images. Based on our experiments, segmentation models perform much better than detection models for the task of plant localization. Our binary segmentation model can accurately extract specimens from the background and achieves an F1 score of 0.977. The ablation experiments for multi-specimen instance segmentation show that our proposed augmentation method provides a 38% increase in performance (0.51 mAP@0.9 versus 0.37) on a dataset of 1,500 plant instances.
Keywords
Herbarium, Data enrichment, Data augmentation

Downloads

  • DS614 acc.pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 4.48 MB
  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 10.14 MB

Citation

Please use this url to cite or link to this publication:

MLA
Milleville, Kenzo, et al. “Automatic Extraction of Specimens from Multi-Specimen Herbaria.” ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, vol. 16, no. 1, 2023, doi:10.1145/3575862.
APA
Milleville, K., Thirukokaranam Chandrasekar, K. K., & Verstockt, S. (2023). Automatic extraction of specimens from multi-specimen herbaria. ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, 16(1). https://doi.org/10.1145/3575862
Chicago author-date
Milleville, Kenzo, Krishna Kumar Thirukokaranam Chandrasekar, and Steven Verstockt. 2023. “Automatic Extraction of Specimens from Multi-Specimen Herbaria.” ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE 16 (1). https://doi.org/10.1145/3575862.
Chicago author-date (all authors)
Milleville, Kenzo, Krishna Kumar Thirukokaranam Chandrasekar, and Steven Verstockt. 2023. “Automatic Extraction of Specimens from Multi-Specimen Herbaria.” ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE 16 (1). doi:10.1145/3575862.
Vancouver
1.
Milleville K, Thirukokaranam Chandrasekar KK, Verstockt S. Automatic extraction of specimens from multi-specimen herbaria. ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE. 2023;16(1).
IEEE
[1]
K. Milleville, K. K. Thirukokaranam Chandrasekar, and S. Verstockt, “Automatic extraction of specimens from multi-specimen herbaria,” ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, vol. 16, no. 1, 2023.
@article{01HA1VDK26RX4CWJF6XBXA3B5F,
  abstract     = {{Since herbarium specimens are increasingly becoming digitized and accessible in online repositories, an important need has emerged to develop automated tools to process and enrich these collections to facilitate better access to the preserved archives. Particularly, automatic enrichment of multi-specimen herbaria sheets poses unique challenges and problems that have not been adequately addressed. The complexity of localization of species in a page increases exponentially when multiple specimens are present in the same page. This already challenges the performance of models that work accurately with single specimens. Therefore, in this work, we have performed experiments to identify the models that perform well for the plant specimen localization problem. The major bottleneck for performing such experiments was the lack of labeled data. We also address this problem by proposing tools and algorithms to semi-automatically generate annotations for herbarium images. Based on our experiments, segmentation models perform much better than detection models for the task of plant localization. Our binary segmentation model can accurately extract specimens from the background and achieves an F1 score of 0.977. The ablation experiments for multi-specimen instance segmentation show that our proposed augmentation method provides a 38% increase in performance (0.51 mAP@0.9 versus 0.37) on a dataset of 1,500 plant instances.}},
  articleno    = {{4}},
  author       = {{Milleville, Kenzo and Thirukokaranam Chandrasekar, Krishna Kumar and Verstockt, Steven}},
  issn         = {{1556-4673}},
  journal      = {{ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE}},
  keywords     = {{Herbarium,Data enrichment,Data augmentation}},
  language     = {{eng}},
  number       = {{1}},
  pages        = {{15}},
  title        = {{Automatic extraction of specimens from multi-specimen herbaria}},
  url          = {{http://doi.org/10.1145/3575862}},
  volume       = {{16}},
  year         = {{2023}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: