Advanced search
1 file | 3.15 MB Add to list

Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark

(2024) IEEE ACCESS. 12. p.16881-16901
Author
Organization
Project
Abstract
Ultra-wideband (UWB) localization has emerged in GPS-denied environments as a crucial facilitator for diverse industries, including logistics, healthcare applications, and societal domains. Despite notable progress, UWB algorithms from the scientific literature are often evaluated in isolation in very specific conditions and hence difficult to compare. This paper introduces a novel benchmark platform designed to assess the performance of 11 prominent UWB accuracy-enhancing algorithms, both independently and in combination. A key feature of the platform is its incorporation of multiple diverse evaluation metrics, including mean average error, latency, and spatial error. We showcase the significance of adopting alternative metrics such as spatial error, which often, depending on the use case, offers greater relevance than the prevalently used mean average error. Furthermore, we show that "more is better" does not hold true when combining multiple accuracy-improving algorithms for UWB systems: combining multiple accuracy-improving algorithms reveals instances of diminishing returns and can even result in overall performance decline. Additionally, we caution against blind reliance on accuracy outcomes reported in the scientific literature when designing UWB systems for use cases that are different in terms of requirements or environment. Finally, we also provide algorithmic recommendations for distinct surroundings, exemplary applications, and usage contexts, assisting in driving efficient design in future UWB research and adoption.
Keywords
Benchmark testing, Guidelines, Location awareness, Ultra wideband technology, Global Positioning System, Benchmark, filters, guidelines, localization, LOS/NLOS, software, UWB, ultra-wideband

Downloads

  • 8484.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 3.15 MB

Citation

Please use this url to cite or link to this publication:

MLA
Van Herbruggen, Ben, et al. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS, vol. 12, 2024, pp. 16881–901, doi:10.1109/ACCESS.2024.3358274.
APA
Van Herbruggen, B., Vanhie-Van Gerwen, J., Luchie, S., Durodie, Y., Vanderborght, B., Aernouts, M., … De Poorter, E. (2024). Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark. IEEE ACCESS, 12, 16881–16901. https://doi.org/10.1109/ACCESS.2024.3358274
Chicago author-date
Van Herbruggen, Ben, Jono Vanhie-Van Gerwen, Stijn Luchie, Yuri Durodie, Bram Vanderborght, Michiel Aernouts, Adrian Munteanu, Jaron Fontaine, and Eli De Poorter. 2024. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS 12: 16881–901. https://doi.org/10.1109/ACCESS.2024.3358274.
Chicago author-date (all authors)
Van Herbruggen, Ben, Jono Vanhie-Van Gerwen, Stijn Luchie, Yuri Durodie, Bram Vanderborght, Michiel Aernouts, Adrian Munteanu, Jaron Fontaine, and Eli De Poorter. 2024. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS 12: 16881–16901. doi:10.1109/ACCESS.2024.3358274.
Vancouver
1.
Van Herbruggen B, Vanhie-Van Gerwen J, Luchie S, Durodie Y, Vanderborght B, Aernouts M, et al. Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark. IEEE ACCESS. 2024;12:16881–901.
IEEE
[1]
B. Van Herbruggen et al., “Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark,” IEEE ACCESS, vol. 12, pp. 16881–16901, 2024.
@article{01HQWMZSVRJNV30R2DY6BRKGJH,
  abstract     = {{Ultra-wideband (UWB) localization has emerged in GPS-denied environments as a crucial facilitator for diverse industries, including logistics, healthcare applications, and societal domains. Despite notable progress, UWB algorithms from the scientific literature are often evaluated in isolation in very specific conditions and hence difficult to compare. This paper introduces a novel benchmark platform designed to assess the performance of 11 prominent UWB accuracy-enhancing algorithms, both independently and in combination. A key feature of the platform is its incorporation of multiple diverse evaluation metrics, including mean average error, latency, and spatial error. We showcase the significance of adopting alternative metrics such as spatial error, which often, depending on the use case, offers greater relevance than the prevalently used mean average error. Furthermore, we show that "more is better" does not hold true when combining multiple accuracy-improving algorithms for UWB systems: combining multiple accuracy-improving algorithms reveals instances of diminishing returns and can even result in overall performance decline. Additionally, we caution against blind reliance on accuracy outcomes reported in the scientific literature when designing UWB systems for use cases that are different in terms of requirements or environment. Finally, we also provide algorithmic recommendations for distinct surroundings, exemplary applications, and usage contexts, assisting in driving efficient design in future UWB research and adoption.}},
  author       = {{Van Herbruggen, Ben and Vanhie-Van Gerwen, Jono and Luchie, Stijn and Durodie, Yuri and Vanderborght, Bram and Aernouts, Michiel and Munteanu, Adrian and Fontaine, Jaron and De Poorter, Eli}},
  issn         = {{2169-3536}},
  journal      = {{IEEE ACCESS}},
  keywords     = {{Benchmark testing,Guidelines,Location awareness,Ultra wideband technology,Global Positioning System,Benchmark,filters,guidelines,localization,LOS/NLOS,software,UWB,ultra-wideband}},
  language     = {{eng}},
  pages        = {{16881--16901}},
  title        = {{Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark}},
  url          = {{http://doi.org/10.1109/ACCESS.2024.3358274}},
  volume       = {{12}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: