A Two-Stage Strategy for Black-Start Restoration by Coordinating Deep Reinforcement Learning and Mixed-Integer Linear Programming

IF 2.6 4区 工程技术 Q3 ENERGY & FUELS
Lingyu Liang, Huanming Zhang, Wencong Xiao, Xiangyu Zhao, Junbin Chen, Shang Cao, Tao Yu, Hanju Li
{"title":"A Two-Stage Strategy for Black-Start Restoration by Coordinating Deep Reinforcement Learning and Mixed-Integer Linear Programming","authors":"Lingyu Liang,&nbsp;Huanming Zhang,&nbsp;Wencong Xiao,&nbsp;Xiangyu Zhao,&nbsp;Junbin Chen,&nbsp;Shang Cao,&nbsp;Tao Yu,&nbsp;Hanju Li","doi":"10.1049/rpg2.70081","DOIUrl":null,"url":null,"abstract":"<p>Extreme events can lead to extensive blackouts, emphasising the crucial significance of power system black-start restoration. In this paper, a two-stage strategy coordinating deep reinforcement learning (DRL) and mixed-integer linear programming (MILP) for power system black-start restoration is proposed. In the first stage, a convolutional neural network-based (CNN-based) invalid action masking assisted proximal policy optimisation (CI-PPO) algorithm is developed to determine component connections. Furthermore, a MILP model for optimal power dispatch is formulated with the objective of minimising generation costs in the second stage. The effectiveness of the proposed method is validated using the New England 10-unit 39-bus power system. The results show strong learning ability and computational efficiency for varying system conditions.</p>","PeriodicalId":55000,"journal":{"name":"IET Renewable Power Generation","volume":"19 1","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/rpg2.70081","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Renewable Power Generation","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/rpg2.70081","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

Abstract

Extreme events can lead to extensive blackouts, emphasising the crucial significance of power system black-start restoration. In this paper, a two-stage strategy coordinating deep reinforcement learning (DRL) and mixed-integer linear programming (MILP) for power system black-start restoration is proposed. In the first stage, a convolutional neural network-based (CNN-based) invalid action masking assisted proximal policy optimisation (CI-PPO) algorithm is developed to determine component connections. Furthermore, a MILP model for optimal power dispatch is formulated with the objective of minimising generation costs in the second stage. The effectiveness of the proposed method is validated using the New England 10-unit 39-bus power system. The results show strong learning ability and computational efficiency for varying system conditions.

基于深度强化学习和混合整数线性规划的两阶段黑启动恢复策略
极端事件可导致大面积停电,因此电力系统黑启动恢复的重要性日益凸显。提出了一种基于深度强化学习(DRL)和混合整数线性规划(MILP)的电力系统黑启动恢复两阶段协调策略。在第一阶段,开发了一种基于卷积神经网络(cnn)的无效动作掩蔽辅助近端策略优化(CI-PPO)算法来确定组件连接。在此基础上,以第二阶段发电成本最小为目标,建立了最优电力调度的MILP模型。以新英格兰10台39母线电力系统为例,验证了该方法的有效性。结果表明,该算法具有较强的学习能力和计算效率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Renewable Power Generation
IET Renewable Power Generation 工程技术-工程:电子与电气
CiteScore
6.80
自引率
11.50%
发文量
268
审稿时长
6.6 months
期刊介绍: IET Renewable Power Generation (RPG) brings together the topics of renewable energy technology, power generation and systems integration, with techno-economic issues. All renewable energy generation technologies are within the scope of the journal. Specific technology areas covered by the journal include: Wind power technology and systems Photovoltaics Solar thermal power generation Geothermal energy Fuel cells Wave power Marine current energy Biomass conversion and power generation What differentiates RPG from technology specific journals is a concern with power generation and how the characteristics of the different renewable sources affect electrical power conversion, including power electronic design, integration in to power systems, and techno-economic issues. Other technologies that have a direct role in sustainable power generation such as fuel cells and energy storage are also covered, as are system control approaches such as demand side management, which facilitate the integration of renewable sources into power systems, both large and small. The journal provides a forum for the presentation of new research, development and applications of renewable power generation. Demonstrations and experimentally based research are particularly valued, and modelling studies should as far as possible be validated so as to give confidence that the models are representative of real-world behavior. Research that explores issues where the characteristics of the renewable energy source and their control impact on the power conversion is welcome. Papers covering the wider areas of power system control and operation, including scheduling and protection that are central to the challenge of renewable power integration are particularly encouraged. The journal is technology focused covering design, demonstration, modelling and analysis, but papers covering techno-economic issues are also of interest. Papers presenting new modelling and theory are welcome but this must be relevant to real power systems and power generation. Most papers are expected to include significant novelty of approach or application that has general applicability, and where appropriate include experimental results. Critical reviews of relevant topics are also invited and these would be expected to be comprehensive and fully referenced. Current Special Issue. Call for papers: Power Quality and Protection in Renewable Energy Systems and Microgrids - https://digital-library.theiet.org/files/IET_RPG_CFP_PQPRESM.pdf Energy and Rail/Road Transportation Integrated Development - https://digital-library.theiet.org/files/IET_RPG_CFP_ERTID.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信