发电机跳闸方案的智能预测:基于知识融合的深度强化学习框架

IF 6.9 2区 工程技术 Q2 ENERGY & FUELS
Lingkang Zeng;Wei Yao;Ze Hu;Hang Shuai;Zhouping Li;Jinyu Wen;Shijie Cheng
{"title":"发电机跳闸方案的智能预测:基于知识融合的深度强化学习框架","authors":"Lingkang Zeng;Wei Yao;Ze Hu;Hang Shuai;Zhouping Li;Jinyu Wen;Shijie Cheng","doi":"10.17775/CSEEJPES.2022.08970","DOIUrl":null,"url":null,"abstract":"Generator tripping scheme (GTS) is the most commonly used scheme to prevent power systems from losing safety and stability. Usually, GTS is composed of offline predetermination and real-time scenario match. However, it is extremely time-consuming and labor-intensive for manual predetermination for a large-scale modern power system. To improve efficiency of predetermination, this paper proposes a framework of knowledge fusion-based deep reinforcement learning (KF-DRL) for intelligent predetermination of GTS. First, the Markov Decision Process (MDP) for GTS problem is formulated based on transient instability events. Then, linear action space is developed to reduce dimensionality of action space for multiple controllable generators. Especially, KF-DRL leverages domain knowledge about GTS to mask invalid actions during the decision-making process. This can enhance the efficiency and learning process. Moreover, the graph convolutional network (GCN) is introduced to the policy network for enhanced learning ability. Numerical simulation results obtained on New England power system demonstrate superiority of the proposed KF-DRL framework for GTS over the purely data-driven DRL method.","PeriodicalId":10729,"journal":{"name":"CSEE Journal of Power and Energy Systems","volume":"10 1","pages":"66-75"},"PeriodicalIF":6.9000,"publicationDate":"2023-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10375964","citationCount":"0","resultStr":"{\"title\":\"Intelligent Predetermination of Generator Tripping Scheme: Knowledge Fusion-based Deep Reinforcement Learning Framework\",\"authors\":\"Lingkang Zeng;Wei Yao;Ze Hu;Hang Shuai;Zhouping Li;Jinyu Wen;Shijie Cheng\",\"doi\":\"10.17775/CSEEJPES.2022.08970\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Generator tripping scheme (GTS) is the most commonly used scheme to prevent power systems from losing safety and stability. Usually, GTS is composed of offline predetermination and real-time scenario match. However, it is extremely time-consuming and labor-intensive for manual predetermination for a large-scale modern power system. To improve efficiency of predetermination, this paper proposes a framework of knowledge fusion-based deep reinforcement learning (KF-DRL) for intelligent predetermination of GTS. First, the Markov Decision Process (MDP) for GTS problem is formulated based on transient instability events. Then, linear action space is developed to reduce dimensionality of action space for multiple controllable generators. Especially, KF-DRL leverages domain knowledge about GTS to mask invalid actions during the decision-making process. This can enhance the efficiency and learning process. Moreover, the graph convolutional network (GCN) is introduced to the policy network for enhanced learning ability. Numerical simulation results obtained on New England power system demonstrate superiority of the proposed KF-DRL framework for GTS over the purely data-driven DRL method.\",\"PeriodicalId\":10729,\"journal\":{\"name\":\"CSEE Journal of Power and Energy Systems\",\"volume\":\"10 1\",\"pages\":\"66-75\"},\"PeriodicalIF\":6.9000,\"publicationDate\":\"2023-12-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10375964\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"CSEE Journal of Power and Energy Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10375964/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"CSEE Journal of Power and Energy Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10375964/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

发电机跳闸方案(GTS)是防止电力系统失去安全性和稳定性的最常用方案。通常,GTS 由离线预判和实时情景匹配两部分组成。然而,对于大型现代电力系统来说,人工预判非常耗时耗力。为提高预判效率,本文提出了一种基于知识融合的深度强化学习(KF-DRL)框架,用于 GTS 的智能预判。首先,基于暂态不稳定事件,建立了 GTS 问题的马尔可夫决策过程(Markov Decision Process,MDP)。然后,开发了线性行动空间,以降低多个可控发电机的行动空间维度。特别是,KF-DRL 利用有关 GTS 的领域知识来掩盖决策过程中的无效行动。这可以提高效率,改善学习过程。此外,还在策略网络中引入了图卷积网络(GCN),以增强学习能力。在新英格兰电力系统上获得的数值模拟结果表明,针对 GTS 提出的 KF-DRL 框架优于纯数据驱动的 DRL 方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Intelligent Predetermination of Generator Tripping Scheme: Knowledge Fusion-based Deep Reinforcement Learning Framework
Generator tripping scheme (GTS) is the most commonly used scheme to prevent power systems from losing safety and stability. Usually, GTS is composed of offline predetermination and real-time scenario match. However, it is extremely time-consuming and labor-intensive for manual predetermination for a large-scale modern power system. To improve efficiency of predetermination, this paper proposes a framework of knowledge fusion-based deep reinforcement learning (KF-DRL) for intelligent predetermination of GTS. First, the Markov Decision Process (MDP) for GTS problem is formulated based on transient instability events. Then, linear action space is developed to reduce dimensionality of action space for multiple controllable generators. Especially, KF-DRL leverages domain knowledge about GTS to mask invalid actions during the decision-making process. This can enhance the efficiency and learning process. Moreover, the graph convolutional network (GCN) is introduced to the policy network for enhanced learning ability. Numerical simulation results obtained on New England power system demonstrate superiority of the proposed KF-DRL framework for GTS over the purely data-driven DRL method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
11.80
自引率
12.70%
发文量
389
审稿时长
26 weeks
期刊介绍: The CSEE Journal of Power and Energy Systems (JPES) is an international bimonthly journal published by the Chinese Society for Electrical Engineering (CSEE) in collaboration with CEPRI (China Electric Power Research Institute) and IEEE (The Institute of Electrical and Electronics Engineers) Inc. Indexed by SCI, Scopus, INSPEC, CSAD (Chinese Science Abstracts Database), DOAJ, and ProQuest, it serves as a platform for reporting cutting-edge theories, methods, technologies, and applications shaping the development of power systems in energy transition. The journal offers authors an international platform to enhance the reach and impact of their contributions.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信