Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang
{"title":"A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters","authors":"Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang","doi":"10.1109/ICoPESA56898.2023.10141128","DOIUrl":null,"url":null,"abstract":"This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.","PeriodicalId":127339,"journal":{"name":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICoPESA56898.2023.10141128","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.