Advanced search
1 file | 852.21 KB Add to list
Author
Organization
Abstract
With Digital transformation, the diversity of services and infrastructure in backhaul fog network(s) is rising to unprecedented levels. This is causing a rising threat of a wider range of cyber attacks coupled with a growing integration of constrained range of infrastructure, particularly seen at the network edge. Deep reinforcement-based learning is an attractive approach to detecting attacks, as it allows less dependency on labeled data with better ability to classify different attacks. However, current approaches to learning are known to be computationally expensive (cost) and the learning experience can be negatively impacted by the presence of outliers and noise (quality). This work tackles both the cost and quality challenges with a novel service-based federated deep reinforcement learning solution, enabling anomaly detection and attack classification at a reduced data cost and with better quality. The federated settings in the proposed approach enable multiple edge units to create clusters that follow a bottom-up learning approach. The proposed solution adapts deep Q-learning Network (DQN) for service-tunable flow classification, and introduces a novel federated DQN (FDQN) for federated learning. Through such targeted training and validation, variation in data patterns and noise is reduced. This leads to improved performance per service with lower training cost. Performance and cost of the solution, along with sensitivity to exploration parameters are evaluated using an example publicly available dataset (UNSW-NB15). Evaluation results show the proposed solution to maintain detection accuracy with lower data supply, while improving the classification rate by a factor of approximate to 2.
Keywords
cyber security, federated deep reinforcement learning, Deep Q-Learning, anomaly detection, cloud-to-edge continuum, fog computing

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 852.21 KB

Citation

Please use this url to cite or link to this publication:

MLA
AL-Naday, Mays, et al. “Service-Based Federated Deep Reinforcement Learning for Anomaly Detection in Fog Ecosystems.” 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN, IEEE, 2023, pp. 121–28, doi:10.1109/ICIN56760.2023.10073495.
APA
AL-Naday, M., Reed, M., Dobre, V., Toor, S., Volckaert, B., & De Turck, F. (2023). Service-based federated deep reinforcement learning for anomaly detection in fog ecosystems. 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN, 121–128. https://doi.org/10.1109/ICIN56760.2023.10073495
Chicago author-date
AL-Naday, Mays, Martin Reed, Vlad Dobre, Salman Toor, Bruno Volckaert, and Filip De Turck. 2023. “Service-Based Federated Deep Reinforcement Learning for Anomaly Detection in Fog Ecosystems.” In 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN, 121–28. IEEE. https://doi.org/10.1109/ICIN56760.2023.10073495.
Chicago author-date (all authors)
AL-Naday, Mays, Martin Reed, Vlad Dobre, Salman Toor, Bruno Volckaert, and Filip De Turck. 2023. “Service-Based Federated Deep Reinforcement Learning for Anomaly Detection in Fog Ecosystems.” In 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN, 121–128. IEEE. doi:10.1109/ICIN56760.2023.10073495.
Vancouver
1.
AL-Naday M, Reed M, Dobre V, Toor S, Volckaert B, De Turck F. Service-based federated deep reinforcement learning for anomaly detection in fog ecosystems. In: 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN. IEEE; 2023. p. 121–8.
IEEE
[1]
M. AL-Naday, M. Reed, V. Dobre, S. Toor, B. Volckaert, and F. De Turck, “Service-based federated deep reinforcement learning for anomaly detection in fog ecosystems,” in 2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN, Aivanc Sch Technol Business & Soc Format Initiale, Paris, FRANCE, 2023, pp. 121–128.
@inproceedings{01H7CZK37Y70MDEX2K7RDEC1HZ,
  abstract     = {{With Digital transformation, the diversity of services and infrastructure in backhaul fog network(s) is rising to unprecedented levels. This is causing a rising threat of a wider range of cyber attacks coupled with a growing integration of constrained range of infrastructure, particularly seen at the network edge. Deep reinforcement-based learning is an attractive approach to detecting attacks, as it allows less dependency on labeled data with better ability to classify different attacks. However, current approaches to learning are known to be computationally expensive (cost) and the learning experience can be negatively impacted by the presence of outliers and noise (quality). This work tackles both the cost and quality challenges with a novel service-based federated deep reinforcement learning solution, enabling anomaly detection and attack classification at a reduced data cost and with better quality. The federated settings in the proposed approach enable multiple edge units to create clusters that follow a bottom-up learning approach. The proposed solution adapts deep Q-learning Network (DQN) for service-tunable flow classification, and introduces a novel federated DQN (FDQN) for federated learning. Through such targeted training and validation, variation in data patterns and noise is reduced. This leads to improved performance per service with lower training cost. Performance and cost of the solution, along with sensitivity to exploration parameters are evaluated using an example publicly available dataset (UNSW-NB15). Evaluation results show the proposed solution to maintain detection accuracy with lower data supply, while improving the classification rate by a factor of approximate to 2.}},
  author       = {{AL-Naday, Mays and Reed, Martin and Dobre, Vlad and Toor, Salman and Volckaert, Bruno and De Turck, Filip}},
  booktitle    = {{2023 26TH CONFERENCE ON INNOVATION IN CLOUDS, INTERNET AND NETWORKS AND WORKSHOPS, ICIN}},
  isbn         = {{9798350398045}},
  issn         = {{2162-3414}},
  keywords     = {{cyber security,federated deep reinforcement learning,Deep Q-Learning,anomaly detection,cloud-to-edge continuum,fog computing}},
  language     = {{eng}},
  location     = {{Aivanc Sch Technol Business & Soc Format Initiale, Paris, FRANCE}},
  pages        = {{121--128}},
  publisher    = {{IEEE}},
  title        = {{Service-based federated deep reinforcement learning for anomaly detection in fog ecosystems}},
  url          = {{http://doi.org/10.1109/ICIN56760.2023.10073495}},
  year         = {{2023}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: