
Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control
- Author
- Siebe Paesschesoone (UGent) , Nezmin Kayedpour (UGent) , Carlo Manna and Guillaume Crevecoeur (UGent)
- Organization
- Abstract
- The electric power sector is undergoing radical changes to enhance sustainability. A main part of this transformation involves the integration of more renewable energy sources (RES) into the power grid, emphasizing the critical need for increased grid flexibility. However, current power grid controllers face challenges in achieving this flexibility due to the unpredictable nature of RES and load, compounded by the complex multi-physical nature of the entire energy system. To tackle these challenges and improve existing controllers, this paper introduces a novel control strategy employing Reinforcement Learning (RL). The proposed strategy is validated through its application to a Photovoltaic (PV)-battery system, where the RL agent learns through interactions with the environment, guided by a reward function based on energy costs. Recognizing the difficulty of maintaining optimality in dynamic environments with single-model RL, our approach advocates for a multi-model RL framework. The framework incorporates a clustering algorithm to identify the optimal number of models. Additionally, we introduce a switching RL strategy involving an offline phase for dataset partitioning and RL model training, followed by an online phase where a real-time switching decision unit selects the optimal RL model, dynamically adapting to current operating conditions. Applying our proposed approach to the PV-battery system demonstrates an 8.15% increase in cost efficiency compared to a conventional single-model RL framework.
- Keywords
- energy flexibility, reinforcement learning, photovoltaic-battery systems, clustering, adaptive control
Downloads
-
(...).pdf
- full text (Accepted manuscript)
- |
- UGent only
- |
- |
- 744.82 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HNM96JJ7Q6RR5NQ83C0JBN87
- MLA
- Paesschesoone, Siebe, et al. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” IEEE Young Researchers Symposium 2024, Proceedings, 2024.
- APA
- Paesschesoone, S., Kayedpour, N., Manna, C., & Crevecoeur, G. (2024). Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control. IEEE Young Researchers Symposium 2024, Proceedings. Presented at the IEEE Young Researchers Symposium, Mons, Belgium.
- Chicago author-date
- Paesschesoone, Siebe, Nezmin Kayedpour, Carlo Manna, and Guillaume Crevecoeur. 2024. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” In IEEE Young Researchers Symposium 2024, Proceedings.
- Chicago author-date (all authors)
- Paesschesoone, Siebe, Nezmin Kayedpour, Carlo Manna, and Guillaume Crevecoeur. 2024. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” In IEEE Young Researchers Symposium 2024, Proceedings.
- Vancouver
- 1.Paesschesoone S, Kayedpour N, Manna C, Crevecoeur G. Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control. In: IEEE Young Researchers Symposium 2024, Proceedings. 2024.
- IEEE
- [1]S. Paesschesoone, N. Kayedpour, C. Manna, and G. Crevecoeur, “Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control,” in IEEE Young Researchers Symposium 2024, Proceedings, Mons, Belgium, 2024.
@inproceedings{01HNM96JJ7Q6RR5NQ83C0JBN87, abstract = {{The electric power sector is undergoing radical changes to enhance sustainability. A main part of this transformation involves the integration of more renewable energy sources (RES) into the power grid, emphasizing the critical need for increased grid flexibility. However, current power grid controllers face challenges in achieving this flexibility due to the unpredictable nature of RES and load, compounded by the complex multi-physical nature of the entire energy system. To tackle these challenges and improve existing controllers, this paper introduces a novel control strategy employing Reinforcement Learning (RL). The proposed strategy is validated through its application to a Photovoltaic (PV)-battery system, where the RL agent learns through interactions with the environment, guided by a reward function based on energy costs. Recognizing the difficulty of maintaining optimality in dynamic environments with single-model RL, our approach advocates for a multi-model RL framework. The framework incorporates a clustering algorithm to identify the optimal number of models. Additionally, we introduce a switching RL strategy involving an offline phase for dataset partitioning and RL model training, followed by an online phase where a real-time switching decision unit selects the optimal RL model, dynamically adapting to current operating conditions. Applying our proposed approach to the PV-battery system demonstrates an 8.15% increase in cost efficiency compared to a conventional single-model RL framework.}}, author = {{Paesschesoone, Siebe and Kayedpour, Nezmin and Manna, Carlo and Crevecoeur, Guillaume}}, booktitle = {{IEEE Young Researchers Symposium 2024, Proceedings}}, keywords = {{energy flexibility,reinforcement learning,photovoltaic-battery systems,clustering,adaptive control}}, language = {{eng}}, location = {{Mons, Belgium}}, pages = {{6}}, title = {{Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control}}, year = {{2024}}, }