{"title":"Deep reinforcement learning approach for hybrid renewable energy systems optimization","authors":"Inoussa Legrene , Tony Wong , Louis-A. Dessaint","doi":"10.1016/j.engappai.2025.111650","DOIUrl":null,"url":null,"abstract":"<div><div>The sizing of hybrid renewable energy systems (HRES) is a major challenge faced in contemporary energy research. The optimal configuration based on the specific consumption requirements is essential for strategic energy planning. Effective sizing must balance the investment costs, reliability, environmental impacts, and greenhouse gas emissions while satisfying the expected energy requirements. This study proposes a novel multi-criteria sizing approach based on deep reinforcement learning (DRL). The DRL agent is guided by a reward function that integrates three essential performance metrics: energy cost (LCOE), renewable energy fraction (REF), and the loss of power supply probability (LPSP). A penalty function is also included to consider the reliance on external sources, such as diesel generators and the public grid, promoting greater autonomy and renewable usage. The DRL-based approach was implemented and tested on three distinct demand profiles, using hourly data for one year. A comparative analysis was conducted against three established methods: particle swarm optimization (PSO), multi-objective PSO (MOPSO), and non-dominated sorted genetic algorithm (NSGA-II). The results indicate that DRL significantly outperforms all the benchmark methods in terms of economic efficiency. DRL achieves a significant reduction in the energy costs, ranging from 21.33 % to 30.09 % when compared with PSO, 27.89 %–30.27 % when compared with MOPSO, and 27.63 %–28.47 % when compared with NSGA-II. These findings demonstrate that DRL presents a robust and adaptive framework for the sizing and operational control of HRES. DRL presents more autonomous, cost-effective, and scalable renewable energy solutions by minimizing the energy costs while maintaining the system reliability.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"159 ","pages":"Article 111650"},"PeriodicalIF":7.5000,"publicationDate":"2025-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625016525","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The sizing of hybrid renewable energy systems (HRES) is a major challenge faced in contemporary energy research. The optimal configuration based on the specific consumption requirements is essential for strategic energy planning. Effective sizing must balance the investment costs, reliability, environmental impacts, and greenhouse gas emissions while satisfying the expected energy requirements. This study proposes a novel multi-criteria sizing approach based on deep reinforcement learning (DRL). The DRL agent is guided by a reward function that integrates three essential performance metrics: energy cost (LCOE), renewable energy fraction (REF), and the loss of power supply probability (LPSP). A penalty function is also included to consider the reliance on external sources, such as diesel generators and the public grid, promoting greater autonomy and renewable usage. The DRL-based approach was implemented and tested on three distinct demand profiles, using hourly data for one year. A comparative analysis was conducted against three established methods: particle swarm optimization (PSO), multi-objective PSO (MOPSO), and non-dominated sorted genetic algorithm (NSGA-II). The results indicate that DRL significantly outperforms all the benchmark methods in terms of economic efficiency. DRL achieves a significant reduction in the energy costs, ranging from 21.33 % to 30.09 % when compared with PSO, 27.89 %–30.27 % when compared with MOPSO, and 27.63 %–28.47 % when compared with NSGA-II. These findings demonstrate that DRL presents a robust and adaptive framework for the sizing and operational control of HRES. DRL presents more autonomous, cost-effective, and scalable renewable energy solutions by minimizing the energy costs while maintaining the system reliability.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.