
Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark
- Author
- Ben Van Herbruggen (UGent) , Jono Vanhie-Van Gerwen (UGent) , Stijn Luchie (UGent) , Yuri Durodie, Bram Vanderborght, Michiel Aernouts, Adrian Munteanu, Jaron Fontaine (UGent) and Eli De Poorter (UGent)
- Organization
- Project
- Abstract
- Ultra-wideband (UWB) localization has emerged in GPS-denied environments as a crucial facilitator for diverse industries, including logistics, healthcare applications, and societal domains. Despite notable progress, UWB algorithms from the scientific literature are often evaluated in isolation in very specific conditions and hence difficult to compare. This paper introduces a novel benchmark platform designed to assess the performance of 11 prominent UWB accuracy-enhancing algorithms, both independently and in combination. A key feature of the platform is its incorporation of multiple diverse evaluation metrics, including mean average error, latency, and spatial error. We showcase the significance of adopting alternative metrics such as spatial error, which often, depending on the use case, offers greater relevance than the prevalently used mean average error. Furthermore, we show that "more is better" does not hold true when combining multiple accuracy-improving algorithms for UWB systems: combining multiple accuracy-improving algorithms reveals instances of diminishing returns and can even result in overall performance decline. Additionally, we caution against blind reliance on accuracy outcomes reported in the scientific literature when designing UWB systems for use cases that are different in terms of requirements or environment. Finally, we also provide algorithmic recommendations for distinct surroundings, exemplary applications, and usage contexts, assisting in driving efficient design in future UWB research and adoption.
- Keywords
- Benchmark testing, Guidelines, Location awareness, Ultra wideband technology, Global Positioning System, Benchmark, filters, guidelines, localization, LOS/NLOS, software, UWB, ultra-wideband
Downloads
-
8484.pdf
- full text (Published version)
- |
- open access
- |
- |
- 3.15 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HQWMZSVRJNV30R2DY6BRKGJH
- MLA
- Van Herbruggen, Ben, et al. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS, vol. 12, 2024, pp. 16881–901, doi:10.1109/ACCESS.2024.3358274.
- APA
- Van Herbruggen, B., Vanhie-Van Gerwen, J., Luchie, S., Durodie, Y., Vanderborght, B., Aernouts, M., … De Poorter, E. (2024). Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark. IEEE ACCESS, 12, 16881–16901. https://doi.org/10.1109/ACCESS.2024.3358274
- Chicago author-date
- Van Herbruggen, Ben, Jono Vanhie-Van Gerwen, Stijn Luchie, Yuri Durodie, Bram Vanderborght, Michiel Aernouts, Adrian Munteanu, Jaron Fontaine, and Eli De Poorter. 2024. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS 12: 16881–901. https://doi.org/10.1109/ACCESS.2024.3358274.
- Chicago author-date (all authors)
- Van Herbruggen, Ben, Jono Vanhie-Van Gerwen, Stijn Luchie, Yuri Durodie, Bram Vanderborght, Michiel Aernouts, Adrian Munteanu, Jaron Fontaine, and Eli De Poorter. 2024. “Selecting and Combining UWB Localization Algorithms : Insights and Recommendations from a Multi-Metric Benchmark.” IEEE ACCESS 12: 16881–16901. doi:10.1109/ACCESS.2024.3358274.
- Vancouver
- 1.Van Herbruggen B, Vanhie-Van Gerwen J, Luchie S, Durodie Y, Vanderborght B, Aernouts M, et al. Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark. IEEE ACCESS. 2024;12:16881–901.
- IEEE
- [1]B. Van Herbruggen et al., “Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark,” IEEE ACCESS, vol. 12, pp. 16881–16901, 2024.
@article{01HQWMZSVRJNV30R2DY6BRKGJH, abstract = {{Ultra-wideband (UWB) localization has emerged in GPS-denied environments as a crucial facilitator for diverse industries, including logistics, healthcare applications, and societal domains. Despite notable progress, UWB algorithms from the scientific literature are often evaluated in isolation in very specific conditions and hence difficult to compare. This paper introduces a novel benchmark platform designed to assess the performance of 11 prominent UWB accuracy-enhancing algorithms, both independently and in combination. A key feature of the platform is its incorporation of multiple diverse evaluation metrics, including mean average error, latency, and spatial error. We showcase the significance of adopting alternative metrics such as spatial error, which often, depending on the use case, offers greater relevance than the prevalently used mean average error. Furthermore, we show that "more is better" does not hold true when combining multiple accuracy-improving algorithms for UWB systems: combining multiple accuracy-improving algorithms reveals instances of diminishing returns and can even result in overall performance decline. Additionally, we caution against blind reliance on accuracy outcomes reported in the scientific literature when designing UWB systems for use cases that are different in terms of requirements or environment. Finally, we also provide algorithmic recommendations for distinct surroundings, exemplary applications, and usage contexts, assisting in driving efficient design in future UWB research and adoption.}}, author = {{Van Herbruggen, Ben and Vanhie-Van Gerwen, Jono and Luchie, Stijn and Durodie, Yuri and Vanderborght, Bram and Aernouts, Michiel and Munteanu, Adrian and Fontaine, Jaron and De Poorter, Eli}}, issn = {{2169-3536}}, journal = {{IEEE ACCESS}}, keywords = {{Benchmark testing,Guidelines,Location awareness,Ultra wideband technology,Global Positioning System,Benchmark,filters,guidelines,localization,LOS/NLOS,software,UWB,ultra-wideband}}, language = {{eng}}, pages = {{16881--16901}}, title = {{Selecting and combining UWB localization algorithms : insights and recommendations from a multi-metric benchmark}}, url = {{http://doi.org/10.1109/ACCESS.2024.3358274}}, volume = {{12}}, year = {{2024}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: