Edge anomaly detection framework for AIOps in Cloud and IoT
- Author
- Pieter Moens (UGent) , Bavo Andriessen, Merlijn Sebrechts (UGent) , Bruno Volckaert (UGent) and Sofie Van Hoecke (UGent)
- Organization
- Abstract
- Artificial Intelligence for IT Operations (AIOps) addresses the rising complexity of cloud computing and Internet of Things by assisting DevOps engineers to monitor and maintain applications. Machine Learning is an essential part of AIOps, enabling it to perform Anomaly Detection and Root Cause Analysis. These techniques are often executed in centralized components, however, which requires transferring vast amounts of data to a central location. This increase in network traffic causes strain on the network and results in higher latency. This paper leverages edge computing to address this issue by deploying ML models closer to the monitored services, reducing the network overhead. This paper investigates two architectural approaches: a sidecar architecture and a federated architecture, and highlights their advantages and shortcomings in different scenarios. Taking this into account, it proposes a framework that orchestrates the deployment and management of distributed edge ML models. Additionally, the paper introduces a Python library to assist data scientists during the development of AIOps techniques and concludes with a thorough evaluation of the resulting framework towards resource consumption and scalability. The results indicate up to 98.3% reduction in network usage depending on the configuration used while maintaining a minimal increase in resource usage at the edge.
- Keywords
- AIOps, Cloud Computing, Internet of Things, Microservices, Anomaly Detection, Monitoring
Downloads
-
8298.pdf
- full text (Published version)
- |
- open access
- |
- |
- 617.19 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HKYH95DXNAMDHXNBSP6W3SSW
- MLA
- Moens, Pieter, et al. “Edge Anomaly Detection Framework for AIOps in Cloud and IoT.” PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, SCITEPRESS, 2023, pp. 204–11, doi:10.5220/0011838600003488.
- APA
- Moens, P., Andriessen, B., Sebrechts, M., Volckaert, B., & Van Hoecke, S. (2023). Edge anomaly detection framework for AIOps in Cloud and IoT. PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, 204–211. https://doi.org/10.5220/0011838600003488
- Chicago author-date
- Moens, Pieter, Bavo Andriessen, Merlijn Sebrechts, Bruno Volckaert, and Sofie Van Hoecke. 2023. “Edge Anomaly Detection Framework for AIOps in Cloud and IoT.” In PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, 204–11. SCITEPRESS. https://doi.org/10.5220/0011838600003488.
- Chicago author-date (all authors)
- Moens, Pieter, Bavo Andriessen, Merlijn Sebrechts, Bruno Volckaert, and Sofie Van Hoecke. 2023. “Edge Anomaly Detection Framework for AIOps in Cloud and IoT.” In PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, 204–211. SCITEPRESS. doi:10.5220/0011838600003488.
- Vancouver
- 1.Moens P, Andriessen B, Sebrechts M, Volckaert B, Van Hoecke S. Edge anomaly detection framework for AIOps in Cloud and IoT. In: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023. SCITEPRESS; 2023. p. 204–11.
- IEEE
- [1]P. Moens, B. Andriessen, M. Sebrechts, B. Volckaert, and S. Van Hoecke, “Edge anomaly detection framework for AIOps in Cloud and IoT,” in PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023, Prague, CZECH REPUBLIC, 2023, pp. 204–211.
@inproceedings{01HKYH95DXNAMDHXNBSP6W3SSW, abstract = {{Artificial Intelligence for IT Operations (AIOps) addresses the rising complexity of cloud computing and Internet of Things by assisting DevOps engineers to monitor and maintain applications. Machine Learning is an essential part of AIOps, enabling it to perform Anomaly Detection and Root Cause Analysis. These techniques are often executed in centralized components, however, which requires transferring vast amounts of data to a central location. This increase in network traffic causes strain on the network and results in higher latency. This paper leverages edge computing to address this issue by deploying ML models closer to the monitored services, reducing the network overhead. This paper investigates two architectural approaches: a sidecar architecture and a federated architecture, and highlights their advantages and shortcomings in different scenarios. Taking this into account, it proposes a framework that orchestrates the deployment and management of distributed edge ML models. Additionally, the paper introduces a Python library to assist data scientists during the development of AIOps techniques and concludes with a thorough evaluation of the resulting framework towards resource consumption and scalability. The results indicate up to 98.3% reduction in network usage depending on the configuration used while maintaining a minimal increase in resource usage at the edge.}}, author = {{Moens, Pieter and Andriessen, Bavo and Sebrechts, Merlijn and Volckaert, Bruno and Van Hoecke, Sofie}}, booktitle = {{PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, CLOSER 2023}}, isbn = {{9789897586507}}, issn = {{2184-5042}}, keywords = {{AIOps,Cloud Computing,Internet of Things,Microservices,Anomaly Detection,Monitoring}}, language = {{eng}}, location = {{Prague, CZECH REPUBLIC}}, pages = {{204--211}}, publisher = {{SCITEPRESS}}, title = {{Edge anomaly detection framework for AIOps in Cloud and IoT}}, url = {{http://doi.org/10.5220/0011838600003488}}, year = {{2023}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: