{"title":"基于事件驱动的在线逼近器三相NPC变换器强化学习预测控制器设计","authors":"Xing Liu;Lin Qiu;Youtong Fang;Kui Wang;Yongdong Li;Jose Rodríguez","doi":"10.1109/TPEL.2024.3510731","DOIUrl":null,"url":null,"abstract":"This article is concerned with a two-step event-driven in reinforcement learning model-free predictive control problem leveraging online approximators for power converter systems, in which the limitations from system uncertainties and unnecessary switching loss are all addressed. To be specific, the key features of this technical note are: 1) a critic neural network to learn the performance function in real-time; 2) an actor neural network to approximate the predictive controller online and to minimize the learned performance function obtained from the critic network; 3) a two-step event-driven control protocol to attenuate the switching frequency (SF). Also, we further discuss the sensitivity of the proposal to parametric uncertainties and quantify its performance under low SF operation and unknown disturbances conditions. Further, the convergence analysis of the networks' weight estimation errors is manifested. Finally, we evaluate the suggested controller by means of various numerical examples, and the results found are promising and motivate further research in this field.","PeriodicalId":13267,"journal":{"name":"IEEE Transactions on Power Electronics","volume":"40 4","pages":"4914-4926"},"PeriodicalIF":6.5000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Event-Driven Based Reinforcement Learning Predictive Controller Design for Three-Phase NPC Converters Using Online Approximators\",\"authors\":\"Xing Liu;Lin Qiu;Youtong Fang;Kui Wang;Yongdong Li;Jose Rodríguez\",\"doi\":\"10.1109/TPEL.2024.3510731\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article is concerned with a two-step event-driven in reinforcement learning model-free predictive control problem leveraging online approximators for power converter systems, in which the limitations from system uncertainties and unnecessary switching loss are all addressed. To be specific, the key features of this technical note are: 1) a critic neural network to learn the performance function in real-time; 2) an actor neural network to approximate the predictive controller online and to minimize the learned performance function obtained from the critic network; 3) a two-step event-driven control protocol to attenuate the switching frequency (SF). Also, we further discuss the sensitivity of the proposal to parametric uncertainties and quantify its performance under low SF operation and unknown disturbances conditions. Further, the convergence analysis of the networks' weight estimation errors is manifested. Finally, we evaluate the suggested controller by means of various numerical examples, and the results found are promising and motivate further research in this field.\",\"PeriodicalId\":13267,\"journal\":{\"name\":\"IEEE Transactions on Power Electronics\",\"volume\":\"40 4\",\"pages\":\"4914-4926\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2024-12-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Power Electronics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10777523/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Power Electronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10777523/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Event-Driven Based Reinforcement Learning Predictive Controller Design for Three-Phase NPC Converters Using Online Approximators
This article is concerned with a two-step event-driven in reinforcement learning model-free predictive control problem leveraging online approximators for power converter systems, in which the limitations from system uncertainties and unnecessary switching loss are all addressed. To be specific, the key features of this technical note are: 1) a critic neural network to learn the performance function in real-time; 2) an actor neural network to approximate the predictive controller online and to minimize the learned performance function obtained from the critic network; 3) a two-step event-driven control protocol to attenuate the switching frequency (SF). Also, we further discuss the sensitivity of the proposal to parametric uncertainties and quantify its performance under low SF operation and unknown disturbances conditions. Further, the convergence analysis of the networks' weight estimation errors is manifested. Finally, we evaluate the suggested controller by means of various numerical examples, and the results found are promising and motivate further research in this field.
期刊介绍:
The IEEE Transactions on Power Electronics journal covers all issues of widespread or generic interest to engineers who work in the field of power electronics. The Journal editors will enforce standards and a review policy equivalent to the IEEE Transactions, and only papers of high technical quality will be accepted. Papers which treat new and novel device, circuit or system issues which are of generic interest to power electronics engineers are published. Papers which are not within the scope of this Journal will be forwarded to the appropriate IEEE Journal or Transactions editors. Examples of papers which would be more appropriately published in other Journals or Transactions include: 1) Papers describing semiconductor or electron device physics. These papers would be more appropriate for the IEEE Transactions on Electron Devices. 2) Papers describing applications in specific areas: e.g., industry, instrumentation, utility power systems, aerospace, industrial electronics, etc. These papers would be more appropriate for the Transactions of the Society which is concerned with these applications. 3) Papers describing magnetic materials and magnetic device physics. These papers would be more appropriate for the IEEE Transactions on Magnetics. 4) Papers on machine theory. These papers would be more appropriate for the IEEE Transactions on Power Systems. While original papers of significant technical content will comprise the major portion of the Journal, tutorial papers and papers of historical value are also reviewed for publication.