Reinforcement Learning Based Weighting Factor Design of Model Predictive Control for Power Electronic Converters

Yihao Wan, T. Dragičević, N. Mijatovic, Chang Li, José Raúl Rodríguez Rodríguez
{"title":"Reinforcement Learning Based Weighting Factor Design of Model Predictive Control for Power Electronic Converters","authors":"Yihao Wan, T. Dragičević, N. Mijatovic, Chang Li, José Raúl Rodríguez Rodríguez","doi":"10.1109/PRECEDE51386.2021.9680964","DOIUrl":null,"url":null,"abstract":"Weighting factor design is one of the challenges for finite-set model predictive control (FS-MPC) controlled power electronic converters, which plays an important role in the balance of control objectives in the cost function to achieve desired performance. This paper investigates the application of reinforcement learning algorithm for the weighting factor design for FS-MPC regulated voltage source converter in uninterrupted power supply (UPS) system. The deep deterministic policy gradient (DDPG) agent is employed to learn the optimal weighting factor design policy. The reinforcement learning (RL) agent is trained in the system and the weighting factor is optimized based on reward calculation with the interactions between the agent and environment. The key performance metric, total harmonic distortion (THD), is incorporated in the reward function. Effectiveness of the proposed reinforcement learning based weighting factor design method is validated by simulations.","PeriodicalId":161011,"journal":{"name":"2021 IEEE International Conference on Predictive Control of Electrical Drives and Power Electronics (PRECEDE)","volume":"326 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Predictive Control of Electrical Drives and Power Electronics (PRECEDE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PRECEDE51386.2021.9680964","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

Weighting factor design is one of the challenges for finite-set model predictive control (FS-MPC) controlled power electronic converters, which plays an important role in the balance of control objectives in the cost function to achieve desired performance. This paper investigates the application of reinforcement learning algorithm for the weighting factor design for FS-MPC regulated voltage source converter in uninterrupted power supply (UPS) system. The deep deterministic policy gradient (DDPG) agent is employed to learn the optimal weighting factor design policy. The reinforcement learning (RL) agent is trained in the system and the weighting factor is optimized based on reward calculation with the interactions between the agent and environment. The key performance metric, total harmonic distortion (THD), is incorporated in the reward function. Effectiveness of the proposed reinforcement learning based weighting factor design method is validated by simulations.
基于强化学习的电力电子变流器模型预测控制加权因子设计
权重因子设计是有限集模型预测控制(FS-MPC)控制的电力电子变流器面临的挑战之一,它在控制目标的成本函数平衡中起着重要的作用。本文研究了强化学习算法在不间断电源(UPS)系统中FS-MPC稳压源变换器权重因子设计中的应用。采用深度确定性策略梯度(deep deterministic policy gradient, DDPG)智能体学习最优加权因子设计策略。在系统中训练强化学习(RL)智能体,并根据智能体与环境的相互作用进行奖励计算,优化其权重因子。关键绩效指标,总谐波失真(THD),被纳入奖励函数。仿真结果验证了基于强化学习的权重因子设计方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信