Coexistence scheme for uncoordinated LTE and WiFi networks using experience replay based Q-learning
- Author
- Merkebu Girmay (UGent) , Vasilis Maglogiannis (UGent) , Dries Naudts (UGent) , Adnan Shahid (UGent) and Ingrid Moerman (UGent)
- Organization
- Abstract
- Nowadays, broadband applications that use the licensed spectrum of the cellular network are growing fast. For this reason, Long-Term Evolution-Unlicensed (LTE-U) technology is expected to offload its traffic to the unlicensed spectrum. However, LTE-U transmissions have to coexist with the existing WiFi networks. Most existing coexistence schemes consider coordinated LTE-U and WiFi networks where there is a central coordinator that communicates traffic demand of the co-located networks. However, such a method of WiFi traffic estimation raises the complexity, traffic overhead, and reaction time of the coexistence schemes. In this article, we propose Experience Replay (ER) and Reward selective Experience Replay (RER) based Q-learning techniques as a solution for the coexistence of uncoordinated LTE-U and WiFi networks. In the proposed schemes, the LTE-U deploys a WiFi saturation sensing model to estimate the traffic demand of co-located WiFi networks. We also made a performance comparison between the proposed schemes and other rule-based and Q-learning based coexistence schemes implemented in non-coordinated LTE-U and WiFi networks. The simulation results show that the RER Q-learning scheme converges faster than the ER Q-learning scheme. The RER Q-learning scheme also gives 19.1% and 5.2% enhancement in aggregated throughput and 16.4% and 10.9% enhancement in fairness performance as compared to the rule-based and Q-learning coexistence schemes, respectively.
- Keywords
- FAIR COEXISTENCE, FI, LAA, LTE-U, IEEE802.11, experience replay, Q-learning, coexistence
Downloads
-
8003.pdf
- full text (Published version)
- |
- open access
- |
- |
- 591.74 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8728870
- MLA
- Girmay, Merkebu, et al. “Coexistence Scheme for Uncoordinated LTE and WiFi Networks Using Experience Replay Based Q-Learning.” SENSORS, vol. 21, no. 21, 2021, doi:10.3390/s21216977.
- APA
- Girmay, M., Maglogiannis, V., Naudts, D., Shahid, A., & Moerman, I. (2021). Coexistence scheme for uncoordinated LTE and WiFi networks using experience replay based Q-learning. SENSORS, 21(21). https://doi.org/10.3390/s21216977
- Chicago author-date
- Girmay, Merkebu, Vasilis Maglogiannis, Dries Naudts, Adnan Shahid, and Ingrid Moerman. 2021. “Coexistence Scheme for Uncoordinated LTE and WiFi Networks Using Experience Replay Based Q-Learning.” SENSORS 21 (21). https://doi.org/10.3390/s21216977.
- Chicago author-date (all authors)
- Girmay, Merkebu, Vasilis Maglogiannis, Dries Naudts, Adnan Shahid, and Ingrid Moerman. 2021. “Coexistence Scheme for Uncoordinated LTE and WiFi Networks Using Experience Replay Based Q-Learning.” SENSORS 21 (21). doi:10.3390/s21216977.
- Vancouver
- 1.Girmay M, Maglogiannis V, Naudts D, Shahid A, Moerman I. Coexistence scheme for uncoordinated LTE and WiFi networks using experience replay based Q-learning. SENSORS. 2021;21(21).
- IEEE
- [1]M. Girmay, V. Maglogiannis, D. Naudts, A. Shahid, and I. Moerman, “Coexistence scheme for uncoordinated LTE and WiFi networks using experience replay based Q-learning,” SENSORS, vol. 21, no. 21, 2021.
@article{8728870,
abstract = {{Nowadays, broadband applications that use the licensed spectrum of the cellular network are growing fast. For this reason, Long-Term Evolution-Unlicensed (LTE-U) technology is expected to offload its traffic to the unlicensed spectrum. However, LTE-U transmissions have to coexist with the existing WiFi networks. Most existing coexistence schemes consider coordinated LTE-U and WiFi networks where there is a central coordinator that communicates traffic demand of the co-located networks. However, such a method of WiFi traffic estimation raises the complexity, traffic overhead, and reaction time of the coexistence schemes. In this article, we propose Experience Replay (ER) and Reward selective Experience Replay (RER) based Q-learning techniques as a solution for the coexistence of uncoordinated LTE-U and WiFi networks. In the proposed schemes, the LTE-U deploys a WiFi saturation sensing model to estimate the traffic demand of co-located WiFi networks. We also made a performance comparison between the proposed schemes and other rule-based and Q-learning based coexistence schemes implemented in non-coordinated LTE-U and WiFi networks. The simulation results show that the RER Q-learning scheme converges faster than the ER Q-learning scheme. The RER Q-learning scheme also gives 19.1% and 5.2% enhancement in aggregated throughput and 16.4% and 10.9% enhancement in fairness performance as compared to the rule-based and Q-learning coexistence schemes, respectively.}},
articleno = {{6977}},
author = {{Girmay, Merkebu and Maglogiannis, Vasilis and Naudts, Dries and Shahid, Adnan and Moerman, Ingrid}},
issn = {{1424-8220}},
journal = {{SENSORS}},
keywords = {{FAIR COEXISTENCE,FI,LAA,LTE-U,IEEE802.11,experience replay,Q-learning,coexistence}},
language = {{eng}},
number = {{21}},
pages = {{24}},
title = {{Coexistence scheme for uncoordinated LTE and WiFi networks using experience replay based Q-learning}},
url = {{http://doi.org/10.3390/s21216977}},
volume = {{21}},
year = {{2021}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: