Yihao Wan, T. Dragičević, N. Mijatovic, Chang Li, José Raúl Rodríguez Rodríguez
{"title":"Reinforcement Learning Based Weighting Factor Design of Model Predictive Control for Power Electronic Converters","authors":"Yihao Wan, T. Dragičević, N. Mijatovic, Chang Li, José Raúl Rodríguez Rodríguez","doi":"10.1109/PRECEDE51386.2021.9680964","DOIUrl":null,"url":null,"abstract":"Weighting factor design is one of the challenges for finite-set model predictive control (FS-MPC) controlled power electronic converters, which plays an important role in the balance of control objectives in the cost function to achieve desired performance. This paper investigates the application of reinforcement learning algorithm for the weighting factor design for FS-MPC regulated voltage source converter in uninterrupted power supply (UPS) system. The deep deterministic policy gradient (DDPG) agent is employed to learn the optimal weighting factor design policy. The reinforcement learning (RL) agent is trained in the system and the weighting factor is optimized based on reward calculation with the interactions between the agent and environment. The key performance metric, total harmonic distortion (THD), is incorporated in the reward function. Effectiveness of the proposed reinforcement learning based weighting factor design method is validated by simulations.","PeriodicalId":161011,"journal":{"name":"2021 IEEE International Conference on Predictive Control of Electrical Drives and Power Electronics (PRECEDE)","volume":"326 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Predictive Control of Electrical Drives and Power Electronics (PRECEDE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PRECEDE51386.2021.9680964","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Weighting factor design is one of the challenges for finite-set model predictive control (FS-MPC) controlled power electronic converters, which plays an important role in the balance of control objectives in the cost function to achieve desired performance. This paper investigates the application of reinforcement learning algorithm for the weighting factor design for FS-MPC regulated voltage source converter in uninterrupted power supply (UPS) system. The deep deterministic policy gradient (DDPG) agent is employed to learn the optimal weighting factor design policy. The reinforcement learning (RL) agent is trained in the system and the weighting factor is optimized based on reward calculation with the interactions between the agent and environment. The key performance metric, total harmonic distortion (THD), is incorporated in the reward function. Effectiveness of the proposed reinforcement learning based weighting factor design method is validated by simulations.