Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang
{"title":"基于DDPG算法的三相直流-交流逆变器强化学习控制器","authors":"Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang","doi":"10.1109/ICoPESA56898.2023.10141128","DOIUrl":null,"url":null,"abstract":"This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.","PeriodicalId":127339,"journal":{"name":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters\",\"authors\":\"Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang\",\"doi\":\"10.1109/ICoPESA56898.2023.10141128\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.\",\"PeriodicalId\":127339,\"journal\":{\"name\":\"2023 International Conference on Power Energy Systems and Applications (ICoPESA)\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Power Energy Systems and Applications (ICoPESA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICoPESA56898.2023.10141128\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICoPESA56898.2023.10141128","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters
This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.