{"title":"本地能源社区调度的隐私增强安全强化学习","authors":"Haoyuan Deng;Ershun Du;Yi Wang","doi":"10.1109/TSG.2025.3536211","DOIUrl":null,"url":null,"abstract":"Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.","PeriodicalId":13331,"journal":{"name":"IEEE Transactions on Smart Grid","volume":"16 3","pages":"2169-2183"},"PeriodicalIF":8.6000,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Privacy-Enhanced Safe Reinforcement Learning for the Dispatch of a Local Energy Community\",\"authors\":\"Haoyuan Deng;Ershun Du;Yi Wang\",\"doi\":\"10.1109/TSG.2025.3536211\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.\",\"PeriodicalId\":13331,\"journal\":{\"name\":\"IEEE Transactions on Smart Grid\",\"volume\":\"16 3\",\"pages\":\"2169-2183\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2025-02-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Smart Grid\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10887028/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Smart Grid","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10887028/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Privacy-Enhanced Safe Reinforcement Learning for the Dispatch of a Local Energy Community
Local Energy Community (LEC) has emerged as a viable community-focus framework to enhance local reliability and energy efficiency by integrating different energy sectors and managing local distributed energy resources (DERs). However, the difficulties associated with handling model complexity, along with privacy concerns arising from interactions between energy operators within the LEC, pose challenges for traditional algorithms in achieving coordinated dispatch. To this end, we develop a novel privacy-enhanced, safe, coordinated dispatch framework that integrates reinforcement learning (RL), the perturbation module, and the safety module. The private states of each energy sector within the LEC are concealed by the independent perturbation module before sharing. A central RL agent is then trained on the concealed state space to learn the optimal policy for coordinated dispatch under the complex and uncertain environment. Furthermore, dispatch actions are evaluated and refined by the safety module before the operators execute them. In this way, we can obtain an optimal policy without disclosing any sector’s private state while ensuring the safe operation of the LEC. Extensive experiments are carried out to validate the superior performance and scalability of the proposed method.
期刊介绍:
The IEEE Transactions on Smart Grid is a multidisciplinary journal that focuses on research and development in the field of smart grid technology. It covers various aspects of the smart grid, including energy networks, prosumers (consumers who also produce energy), electric transportation, distributed energy resources, and communications. The journal also addresses the integration of microgrids and active distribution networks with transmission systems. It publishes original research on smart grid theories and principles, including technologies and systems for demand response, Advance Metering Infrastructure, cyber-physical systems, multi-energy systems, transactive energy, data analytics, and electric vehicle integration. Additionally, the journal considers surveys of existing work on the smart grid that propose new perspectives on the history and future of intelligent and active grids.