Advanced search
2 files | 6.81 MB

Benchmarking of localization solutions : guidelines for the selection of evaluation points

Eli De Poorter (UGent) , Tom Van Haute (UGent) , Eric Laermans (UGent) and Ingrid Moerman (UGent)
(2017) AD HOC NETWORKS. 59. p.86-96
Author
Organization
Abstract
Indoor localization solutions are key enablers for next-generation indoor navigation and track and tracing solutions. As a result, an increasing number of different localization algorithms have been proposed and evaluated in scientific literature. However, many of these publications do not accurately substantiate the used evaluation methods. In particular, many authors utilize a different number of evaluation points, but they do not (i) analyze if the number of used evaluation points is sufficient to accurately evaluate the performance of their solutions and (ii) report on the uncertainty of the published results. To remedy this, this paper evaluates the influence of the selection of evaluation points. Based on statistical parameters such as the standard error of the mean value, an estimator is defined that can be used to quantitatively analyze the impact of the number of used evaluation points on the confidence interval of the mean value of the obtained results. This estimator is used to estimate the uncertainty of the presented accuracy results, and can be used to identify if more evaluations are required. To validate the proposed estimator, two different localization algorithms are evaluated in different testbeds and using different types of technology, showing that the number of required evaluation points does indeed vary significantly depending on the evaluated solution. (C) 2017 Elsevier B.V. All rights reserved.
Keywords
IBCN

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 3.29 MB
  • 6907 i.pdf
    • full text
    • |
    • open access
    • |
    • PDF
    • |
    • 3.52 MB

Citation

Please use this url to cite or link to this publication:

Chicago
De Poorter, Eli, Tom Van Haute, Eric Laermans, and Ingrid Moerman. 2017. “Benchmarking of Localization Solutions : Guidelines for the Selection of Evaluation Points.” Ad Hoc Networks 59: 86–96.
APA
De Poorter, E., Van Haute, T., Laermans, E., & Moerman, I. (2017). Benchmarking of localization solutions : guidelines for the selection of evaluation points. AD HOC NETWORKS, 59, 86–96.
Vancouver
1.
De Poorter E, Van Haute T, Laermans E, Moerman I. Benchmarking of localization solutions : guidelines for the selection of evaluation points. AD HOC NETWORKS. 2017;59:86–96.
MLA
De Poorter, Eli et al. “Benchmarking of Localization Solutions : Guidelines for the Selection of Evaluation Points.” AD HOC NETWORKS 59 (2017): 86–96. Print.
@article{8523102,
  abstract     = {Indoor localization solutions are key enablers for next-generation indoor navigation and track and tracing solutions. As a result, an increasing number of different localization algorithms have been proposed and evaluated in scientific literature. However, many of these publications do not accurately substantiate the used evaluation methods. In particular, many authors utilize a different number of evaluation points, but they do not (i) analyze if the number of used evaluation points is sufficient to accurately evaluate the performance of their solutions and (ii) report on the uncertainty of the published results. To remedy this, this paper evaluates the influence of the selection of evaluation points. Based on statistical parameters such as the standard error of the mean value, an estimator is defined that can be used to quantitatively analyze the impact of the number of used evaluation points on the confidence interval of the mean value of the obtained results. This estimator is used to estimate the uncertainty of the presented accuracy results, and can be used to identify if more evaluations are required. To validate the proposed estimator, two different localization algorithms are evaluated in different testbeds and using different types of technology, showing that the number of required evaluation points does indeed vary significantly depending on the evaluated solution. (C) 2017 Elsevier B.V. All rights reserved.},
  author       = {De Poorter, Eli and Van Haute, Tom and Laermans, Eric and Moerman, Ingrid},
  issn         = {1570-8705},
  journal      = {AD HOC NETWORKS},
  keywords     = {IBCN},
  language     = {eng},
  pages        = {86--96},
  title        = {Benchmarking of localization solutions : guidelines for the selection of evaluation points},
  url          = {http://dx.doi.org/10.1016/j.adhoc.2017.02.002},
  volume       = {59},
  year         = {2017},
}

Altmetric
View in Altmetric
Web of Science
Times cited: