{"title":"基于Bi-Mamba+和约束策略优化的配电网安全强化学习规范维护:丹麦电网案例研究","authors":"Iason Gram, Hamid Mirshekali, Hamid Reza Shaker","doi":"10.1016/j.apenergy.2025.126803","DOIUrl":null,"url":null,"abstract":"<div><div>As Denmark pursues ambitious climate goals—aiming to reduce CO<sub>2</sub> emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"401 ","pages":"Article 126803"},"PeriodicalIF":11.0000,"publicationDate":"2025-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Safe reinforcement learning-based prescriptive maintenance of distribution grid using Bi-Mamba+ and constrained policy optimization: A Danish grid case study\",\"authors\":\"Iason Gram, Hamid Mirshekali, Hamid Reza Shaker\",\"doi\":\"10.1016/j.apenergy.2025.126803\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As Denmark pursues ambitious climate goals—aiming to reduce CO<sub>2</sub> emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"401 \",\"pages\":\"Article 126803\"},\"PeriodicalIF\":11.0000,\"publicationDate\":\"2025-10-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306261925015338\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306261925015338","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
Safe reinforcement learning-based prescriptive maintenance of distribution grid using Bi-Mamba+ and constrained policy optimization: A Danish grid case study
As Denmark pursues ambitious climate goals—aiming to reduce CO2 emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.
期刊介绍:
Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.