基于DDPG算法的三相直流-交流逆变器强化学习控制器

Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang
{"title":"基于DDPG算法的三相直流-交流逆变器强化学习控制器","authors":"Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang","doi":"10.1109/ICoPESA56898.2023.10141128","DOIUrl":null,"url":null,"abstract":"This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.","PeriodicalId":127339,"journal":{"name":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters\",\"authors\":\"Jian Ye, Sen Mei, Huanyu Guo, Yingjie Hu, Xinan Zhang\",\"doi\":\"10.1109/ICoPESA56898.2023.10141128\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.\",\"PeriodicalId\":127339,\"journal\":{\"name\":\"2023 International Conference on Power Energy Systems and Applications (ICoPESA)\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Power Energy Systems and Applications (ICoPESA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICoPESA56898.2023.10141128\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Power Energy Systems and Applications (ICoPESA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICoPESA56898.2023.10141128","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

提出了一种基于强化学习(RL)算法的直流-交流逆变器控制器。与传统的PID控制方法相比,基于RL算法的控制器结构更简单。利用RL算法中的深度确定性策略梯度(deep deterministic policy gradient, DDPG)算法实现逆变器的无模型控制,使控制算法对不同类型的直流-交流逆变器具有自适应能力。它可以避免控制策略对系统模型的依赖。通过仿真,将基于DDPG算法的三相两电平直流-交流逆变器控制策略与传统PID控制进行了比较。仿真结果表明,总谐波失真(THD)降低了12%,电流跟踪性能提高了至少75%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A DDPG Algorithm Based Reinforcement Learning Controller for Three-Phase DC-AC Inverters
This paper proposes a DC-AC inverter controller based on reinforcement learning (RL) algorithm. Compared with the traditional PID control method, the structure of the RL algorithm based controller is simpler. The deep deterministic policy gradient (DDPG) algorithm in RL algorithm is used to realize model-free control of inverters, so that the control algorithm has adaptive ability to different types of DC-AC inverters. It can avoid the dependence of the control strategy on the system model. Through simulation, the control strategy of three-phase two-level DC-AC inverter based on DDPG algorithm is compared with the traditional PID control. The simulation results show that the total harmonic distortion (THD) is reduced by 12% and the current tracking performance is improved by at least 75%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信