Hong Zhou, Shaorong Cai, Sicong Yu, Jianliang Gao, Li Jiang, Liang Lu
{"title":"基于强化学习的多直流电网无功电压优化研究","authors":"Hong Zhou, Shaorong Cai, Sicong Yu, Jianliang Gao, Li Jiang, Liang Lu","doi":"10.1109/AEEES51875.2021.9403010","DOIUrl":null,"url":null,"abstract":"The traditional DC reactive voltage regulation is mainly based on the single DC reactive voltage control, and it lacks the consideration of the interaction effect on the multi-DC reactive voltage. This paper presents a method of multi-DC reactive voltage optimization based on reinforcement learning. In the interaction between the action strategy and the multi-dc state, the Q-value function corresponding to each state-action is obtained, and the optimal reactive voltage control strategy is formed under various operating states of multi-DC. At the same time, because the Q-value function based on this method contains the global response information of the power grid, it can realize the unified coordination of reactive voltage between DC and DC, converter station filter and DC near region conventional units, and give the global optimal control strategy within the power grid. The effect of multi-DC reactive voltage optimization control is improved. Based on the actual data of power grid, the simulation results show the effectiveness and rationality of this method.","PeriodicalId":356667,"journal":{"name":"2021 3rd Asia Energy and Electrical Engineering Symposium (AEEES)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on Reactive Voltage Optimization of Multi-DC Sending Power Grid Based on Reinforcement Learning\",\"authors\":\"Hong Zhou, Shaorong Cai, Sicong Yu, Jianliang Gao, Li Jiang, Liang Lu\",\"doi\":\"10.1109/AEEES51875.2021.9403010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The traditional DC reactive voltage regulation is mainly based on the single DC reactive voltage control, and it lacks the consideration of the interaction effect on the multi-DC reactive voltage. This paper presents a method of multi-DC reactive voltage optimization based on reinforcement learning. In the interaction between the action strategy and the multi-dc state, the Q-value function corresponding to each state-action is obtained, and the optimal reactive voltage control strategy is formed under various operating states of multi-DC. At the same time, because the Q-value function based on this method contains the global response information of the power grid, it can realize the unified coordination of reactive voltage between DC and DC, converter station filter and DC near region conventional units, and give the global optimal control strategy within the power grid. The effect of multi-DC reactive voltage optimization control is improved. Based on the actual data of power grid, the simulation results show the effectiveness and rationality of this method.\",\"PeriodicalId\":356667,\"journal\":{\"name\":\"2021 3rd Asia Energy and Electrical Engineering Symposium (AEEES)\",\"volume\":\"14 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 3rd Asia Energy and Electrical Engineering Symposium (AEEES)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AEEES51875.2021.9403010\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 3rd Asia Energy and Electrical Engineering Symposium (AEEES)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AEEES51875.2021.9403010","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Research on Reactive Voltage Optimization of Multi-DC Sending Power Grid Based on Reinforcement Learning
The traditional DC reactive voltage regulation is mainly based on the single DC reactive voltage control, and it lacks the consideration of the interaction effect on the multi-DC reactive voltage. This paper presents a method of multi-DC reactive voltage optimization based on reinforcement learning. In the interaction between the action strategy and the multi-dc state, the Q-value function corresponding to each state-action is obtained, and the optimal reactive voltage control strategy is formed under various operating states of multi-DC. At the same time, because the Q-value function based on this method contains the global response information of the power grid, it can realize the unified coordination of reactive voltage between DC and DC, converter station filter and DC near region conventional units, and give the global optimal control strategy within the power grid. The effect of multi-DC reactive voltage optimization control is improved. Based on the actual data of power grid, the simulation results show the effectiveness and rationality of this method.