Zhifeng Qiu, Yanan Zhao, Wenbo Shi, Fengrui Su, Zhou Zhu
{"title":"基于注意机制的深度强化学习的配电网络拓扑控制","authors":"Zhifeng Qiu, Yanan Zhao, Wenbo Shi, Fengrui Su, Zhou Zhu","doi":"10.1109/CEECT55960.2022.10030642","DOIUrl":null,"url":null,"abstract":"As the distributed energy mainly based on wind and solar energy continues to be incorporated into the power grid, its automatic control and management has become a very complicated task, and it needs to seek more intelligent control technology. In this paper, a deep reinforcement learning method SAC (Soft Actor-Critic) combined with attention mechanism is proposed to manage power grid. This method changes the line connection and bus distribution of the substation by adjusting the topology structure of the power grid, so that it can transmit power efficiently. And by assigning different feature weights, the attention mechanism enables the neural network to focus on the input that is more relevant to the current target task from a large number of grid input feature states, which enhances the robustness and computational efficiency of the model. And Experiments have proved that our algorithm can automatically manage three different size distribution networks IEEE-5, IEEE-14 and L2RPN WCCI 2020 for three days without experts' help and make sure them run properly and safely.","PeriodicalId":187017,"journal":{"name":"2022 4th International Conference on Electrical Engineering and Control Technologies (CEECT)","volume":"153 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Distribution Network Topology Control Using Attention Mechanism-Based Deep Reinforcement Learning\",\"authors\":\"Zhifeng Qiu, Yanan Zhao, Wenbo Shi, Fengrui Su, Zhou Zhu\",\"doi\":\"10.1109/CEECT55960.2022.10030642\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the distributed energy mainly based on wind and solar energy continues to be incorporated into the power grid, its automatic control and management has become a very complicated task, and it needs to seek more intelligent control technology. In this paper, a deep reinforcement learning method SAC (Soft Actor-Critic) combined with attention mechanism is proposed to manage power grid. This method changes the line connection and bus distribution of the substation by adjusting the topology structure of the power grid, so that it can transmit power efficiently. And by assigning different feature weights, the attention mechanism enables the neural network to focus on the input that is more relevant to the current target task from a large number of grid input feature states, which enhances the robustness and computational efficiency of the model. And Experiments have proved that our algorithm can automatically manage three different size distribution networks IEEE-5, IEEE-14 and L2RPN WCCI 2020 for three days without experts' help and make sure them run properly and safely.\",\"PeriodicalId\":187017,\"journal\":{\"name\":\"2022 4th International Conference on Electrical Engineering and Control Technologies (CEECT)\",\"volume\":\"153 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 4th International Conference on Electrical Engineering and Control Technologies (CEECT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CEECT55960.2022.10030642\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 4th International Conference on Electrical Engineering and Control Technologies (CEECT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CEECT55960.2022.10030642","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Distribution Network Topology Control Using Attention Mechanism-Based Deep Reinforcement Learning
As the distributed energy mainly based on wind and solar energy continues to be incorporated into the power grid, its automatic control and management has become a very complicated task, and it needs to seek more intelligent control technology. In this paper, a deep reinforcement learning method SAC (Soft Actor-Critic) combined with attention mechanism is proposed to manage power grid. This method changes the line connection and bus distribution of the substation by adjusting the topology structure of the power grid, so that it can transmit power efficiently. And by assigning different feature weights, the attention mechanism enables the neural network to focus on the input that is more relevant to the current target task from a large number of grid input feature states, which enhances the robustness and computational efficiency of the model. And Experiments have proved that our algorithm can automatically manage three different size distribution networks IEEE-5, IEEE-14 and L2RPN WCCI 2020 for three days without experts' help and make sure them run properly and safely.