基于Bi-Mamba+和约束策略优化的配电网安全强化学习规范维护:丹麦电网案例研究

IF 11 1区 工程技术 Q1 ENERGY & FUELS
Iason Gram, Hamid Mirshekali, Hamid Reza Shaker
{"title":"基于Bi-Mamba+和约束策略优化的配电网安全强化学习规范维护:丹麦电网案例研究","authors":"Iason Gram,&nbsp;Hamid Mirshekali,&nbsp;Hamid Reza Shaker","doi":"10.1016/j.apenergy.2025.126803","DOIUrl":null,"url":null,"abstract":"<div><div>As Denmark pursues ambitious climate goals—aiming to reduce CO<sub>2</sub> emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.</div></div>","PeriodicalId":246,"journal":{"name":"Applied Energy","volume":"401 ","pages":"Article 126803"},"PeriodicalIF":11.0000,"publicationDate":"2025-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Safe reinforcement learning-based prescriptive maintenance of distribution grid using Bi-Mamba+ and constrained policy optimization: A Danish grid case study\",\"authors\":\"Iason Gram,&nbsp;Hamid Mirshekali,&nbsp;Hamid Reza Shaker\",\"doi\":\"10.1016/j.apenergy.2025.126803\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As Denmark pursues ambitious climate goals—aiming to reduce CO<sub>2</sub> emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.</div></div>\",\"PeriodicalId\":246,\"journal\":{\"name\":\"Applied Energy\",\"volume\":\"401 \",\"pages\":\"Article 126803\"},\"PeriodicalIF\":11.0000,\"publicationDate\":\"2025-10-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Energy\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306261925015338\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Energy","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306261925015338","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

随着丹麦追求雄心勃勃的气候目标——旨在到2030年将二氧化碳排放量相对于1990年的水平减少70%,到2050年实现气候中和——电气化正在各行业加速发展。由于电动汽车等的用电量不断增加,这种转变给该国老化的配电网带来了越来越大的压力。传统的电网扩张虽然是必要的,但会受到供应链中断的影响,而且不会直接减少排放。因此,提高运营效率和电网弹性的替代策略至关重要。本文提出了一个规定性框架,它结合了预测负荷预测和实时控制,以促进规定性维护,并主动缓解这些挑战。该框架使用来自丹麦网格的真实数据进行了演示。第一阶段利用Bi-Mamba+模型预测变压器级的用电量和产量,实现了高精度,并展示了整个电网中单个设计良好的模型的可扩展性。第二阶段采用约束策略优化(CPO)训练的基于神经网络的实时控制,通过动态控制存储单元有效减少电网报警,但对预测精度和系统复杂性敏感。最后,通过转换层将两个组件组合起来,以确保两个组件之间的兼容性。这些组件共同构成了一个前瞻性的解决方案,支持电网的稳定性和灵活性,减少对基础设施扩展的依赖,并为更智能的电网管理铺平了道路。结果强调了在配电系统运行中集成优化、预测和控制的潜力,以利用规范维护提供的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Safe reinforcement learning-based prescriptive maintenance of distribution grid using Bi-Mamba+ and constrained policy optimization: A Danish grid case study
As Denmark pursues ambitious climate goals—aiming to reduce CO2 emissions by 70 % relative to 1990 levels by 2030 and achieve climate neutrality by 2050—electrification is accelerating across sectors. This transition places increasing strain on the country’s aging distribution grids, driven by rising electricity consumption from electric vehicles and more. Traditional grid expansion, while necessary, is subject to interruptions in supply chains and does not directly reduce emissions. As a result, alternative strategies that enhance operational efficiency and grid resilience are essential. This article presents a prescriptive framework that combines predictive load forecasting and real-time control to facilitate prescriptive maintenance and proactively mitigate some of these challenges. The framework is demonstrated using real data from a Danish grid. The first stage utilizes the Bi-Mamba+ model for forecasting consumption and production at the transformer level, achieving high accuracy and demonstrating the scalability of a single, well-engineered model across the grid. The second stage applies neural network-based real-time control trained via Constrained Policy Optimization (CPO), effectively reducing grid alarms by dynamically controlling storage units, though sensitive to forecast accuracy and system complexity. Finally, the two components are combined via a transformation layer to ensure compatibility between the two components. Together, these components form a forward-looking solution that supports grid stability and flexibility, reduces reliance on infrastructure expansion, and paves the way for smarter grid management. The results underline the potential of integrating optimization, forecasting, and control in distribution system operations to take advantage of the potential that prescriptive maintenance offers.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Energy
Applied Energy 工程技术-工程:化工
CiteScore
21.20
自引率
10.70%
发文量
1830
审稿时长
41 days
期刊介绍: Applied Energy serves as a platform for sharing innovations, research, development, and demonstrations in energy conversion, conservation, and sustainable energy systems. The journal covers topics such as optimal energy resource use, environmental pollutant mitigation, and energy process analysis. It welcomes original papers, review articles, technical notes, and letters to the editor. Authors are encouraged to submit manuscripts that bridge the gap between research, development, and implementation. The journal addresses a wide spectrum of topics, including fossil and renewable energy technologies, energy economics, and environmental impacts. Applied Energy also explores modeling and forecasting, conservation strategies, and the social and economic implications of energy policies, including climate change mitigation. It is complemented by the open-access journal Advances in Applied Energy.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信