Advanced search
1 file | 744.82 KB Add to list

Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control

Author
Organization
Abstract
The electric power sector is undergoing radical changes to enhance sustainability. A main part of this transformation involves the integration of more renewable energy sources (RES) into the power grid, emphasizing the critical need for increased grid flexibility. However, current power grid controllers face challenges in achieving this flexibility due to the unpredictable nature of RES and load, compounded by the complex multi-physical nature of the entire energy system. To tackle these challenges and improve existing controllers, this paper introduces a novel control strategy employing Reinforcement Learning (RL). The proposed strategy is validated through its application to a Photovoltaic (PV)-battery system, where the RL agent learns through interactions with the environment, guided by a reward function based on energy costs. Recognizing the difficulty of maintaining optimality in dynamic environments with single-model RL, our approach advocates for a multi-model RL framework. The framework incorporates a clustering algorithm to identify the optimal number of models. Additionally, we introduce a switching RL strategy involving an offline phase for dataset partitioning and RL model training, followed by an online phase where a real-time switching decision unit selects the optimal RL model, dynamically adapting to current operating conditions. Applying our proposed approach to the PV-battery system demonstrates an 8.15% increase in cost efficiency compared to a conventional single-model RL framework.
Keywords
energy flexibility, reinforcement learning, photovoltaic-battery systems, clustering, adaptive control

Downloads

  • (...).pdf
    • full text (Accepted manuscript)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 744.82 KB

Citation

Please use this url to cite or link to this publication:

MLA
Paesschesoone, Siebe, et al. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” IEEE Young Researchers Symposium 2024, Proceedings, 2024.
APA
Paesschesoone, S., Kayedpour, N., Manna, C., & Crevecoeur, G. (2024). Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control. IEEE Young Researchers Symposium 2024, Proceedings. Presented at the IEEE Young Researchers Symposium, Mons, Belgium.
Chicago author-date
Paesschesoone, Siebe, Nezmin Kayedpour, Carlo Manna, and Guillaume Crevecoeur. 2024. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” In IEEE Young Researchers Symposium 2024, Proceedings.
Chicago author-date (all authors)
Paesschesoone, Siebe, Nezmin Kayedpour, Carlo Manna, and Guillaume Crevecoeur. 2024. “Improving Energy Flexibility in Photovoltaic-Battery Systems through Switching Reinforcement Learning Control.” In IEEE Young Researchers Symposium 2024, Proceedings.
Vancouver
1.
Paesschesoone S, Kayedpour N, Manna C, Crevecoeur G. Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control. In: IEEE Young Researchers Symposium 2024, Proceedings. 2024.
IEEE
[1]
S. Paesschesoone, N. Kayedpour, C. Manna, and G. Crevecoeur, “Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control,” in IEEE Young Researchers Symposium 2024, Proceedings, Mons, Belgium, 2024.
@inproceedings{01HNM96JJ7Q6RR5NQ83C0JBN87,
  abstract     = {{The electric power sector is undergoing radical changes to enhance sustainability. A main part of this transformation involves the integration of more renewable energy sources (RES) into the power grid, emphasizing the critical need for increased grid flexibility. However, current power grid controllers face challenges in achieving this flexibility due to the unpredictable nature of RES and load, compounded by the complex multi-physical nature of the entire energy system. To tackle these challenges and improve existing controllers, this paper introduces a novel control strategy employing Reinforcement Learning (RL). The proposed strategy is validated through its application to a Photovoltaic (PV)-battery system, where the RL agent learns through interactions with the environment, guided by a reward function based on energy costs. Recognizing the difficulty of maintaining optimality in dynamic environments with single-model RL, our approach advocates for a multi-model RL framework. The framework incorporates a clustering algorithm to identify the optimal number of models. Additionally, we introduce a switching RL strategy involving an offline phase for dataset partitioning and RL model training, followed by an online phase where a real-time switching decision unit selects the optimal RL model, dynamically adapting to current operating conditions. Applying our proposed approach to the PV-battery system demonstrates an 8.15% increase in cost efficiency compared to a conventional single-model RL framework.}},
  author       = {{Paesschesoone, Siebe and Kayedpour, Nezmin and Manna, Carlo and Crevecoeur, Guillaume}},
  booktitle    = {{IEEE Young Researchers Symposium 2024, Proceedings}},
  keywords     = {{energy flexibility,reinforcement learning,photovoltaic-battery systems,clustering,adaptive control}},
  language     = {{eng}},
  location     = {{Mons, Belgium}},
  pages        = {{6}},
  title        = {{Improving energy flexibility in photovoltaic-battery systems through switching reinforcement learning control}},
  year         = {{2024}},
}