本地能源社区调度的隐私增强安全强化学习

IF 8.6 1区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Haoyuan Deng;Ershun Du;Yi Wang
{"title":"本地能源社区调度的隐私增强安全强化学习","authors":"Haoyuan Deng;Ershun Du;Yi Wang","doi":"10.1109/TSG.2025.3536211","DOIUrl":null,"url":null,"abstract":"Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.","PeriodicalId":13331,"journal":{"name":"IEEE Transactions on Smart Grid","volume":"16 3","pages":"2169-2183"},"PeriodicalIF":8.6000,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Privacy-Enhanced Safe Reinforcement Learning for the Dispatch of a Local Energy Community\",\"authors\":\"Haoyuan Deng;Ershun Du;Yi Wang\",\"doi\":\"10.1109/TSG.2025.3536211\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.\",\"PeriodicalId\":13331,\"journal\":{\"name\":\"IEEE Transactions on Smart Grid\",\"volume\":\"16 3\",\"pages\":\"2169-2183\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2025-02-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Smart Grid\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10887028/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Smart Grid","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10887028/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

地方能源社区(LEC)已成为一个可行的以社区为重点的框架,通过整合不同的能源部门和管理地方分布式能源(DERs)来提高地方可靠性和能源效率。然而,与处理模型复杂性相关的困难,以及LEC内能源运营商之间相互作用引起的隐私问题,对实现协调调度的传统算法提出了挑战。为此,我们开发了一种新的隐私增强、安全、协调的调度框架,该框架集成了强化学习(RL)、扰动模块和安全模块。在共享之前,LEC内每个能源部门的私有状态被独立的摄动模块所隐藏。然后在隐藏状态空间上训练中央RL智能体,学习复杂不确定环境下协调调度的最优策略。此外,在操作员执行调度动作之前,安全模块会对调度动作进行评估和优化。这样,在保证LEC安全运行的同时,我们可以在不泄露任何部门私有状态的情况下获得最优策略。大量的实验验证了该方法的优越性能和可扩展性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Privacy-Enhanced Safe Reinforcement Learning for the Dispatch of a Local Energy Community
Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Smart Grid
IEEE Transactions on Smart Grid ENGINEERING, ELECTRICAL & ELECTRONIC-
CiteScore
22.10
自引率
9.40%
发文量
526
审稿时长
6 months
期刊介绍: The IEEE Transactions on Smart Grid is a multidisciplinary journal that focuses on research and development in the field of smart grid technology. It covers various aspects of the smart grid, including energy networks, prosumers (consumers who also produce energy), electric transportation, distributed energy resources, and communications. The journal also addresses the integration of microgrids and active distribution networks with transmission systems. It publishes original research on smart grid theories and principles, including technologies and systems for demand response, Advance Metering Infrastructure, cyber-physical systems, multi-energy systems, transactive energy, data analytics, and electric vehicle integration. Additionally, the journal considers surveys of existing work on the smart grid that propose new perspectives on the history and future of intelligent and active grids.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信