基于深度强化学习Agent的永磁同步电机DTC-SVM速度控制器

IF 1.9 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Aenugu Mastanaiah, Tejavathu Ramesh, Surla Vishnu Kanchana Naresh, Praveen Kumar Bonthagorla
{"title":"基于深度强化学习Agent的永磁同步电机DTC-SVM速度控制器","authors":"Aenugu Mastanaiah,&nbsp;Tejavathu Ramesh,&nbsp;Surla Vishnu Kanchana Naresh,&nbsp;Praveen Kumar Bonthagorla","doi":"10.1049/pel2.70130","DOIUrl":null,"url":null,"abstract":"<p>High-performance applications\nextensively use permanent magnet synchronous motor (PMSM) drives because of their high torque density and efficiency. However, conventional PI controllers employed in the outer speed control loop of direct torque control with space vector modulation (DTC-SVM) are limited by parameter sensitivity, poor adaptability under dynamic conditions, and the need for extensive manual tuning. To overcome these challenges, a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent is introduced, incorporating a customised reward function to ensure precise torque reference generation. The TD3 agent is trained in MATLAB/Simulink using random speed and load profiles and deployed on a TMS320F28379D digital signal processor. Real-Time validation is carried out using an OPAL-RT 4512 simulator under a hardware-in-the-loop (HIL) framework. The inner-loop DTC operates at 20 kHz for torque and flux control, while the TD3 agent regulates speed at 2 kHz. Experimental results on 4.5 kW and 7.5 kW PMSMs show a 50% reduction in settling time, elimination of overshoot, and stable current responses without requiring controller retuning. The proposed method demonstrates robust and adaptive performance, confirming its effectiveness for embedded motor drive applications.</p>","PeriodicalId":56302,"journal":{"name":"IET Power Electronics","volume":"18 1","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2025-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/pel2.70130","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning Agent Based Speed Controller for DTC-SVM of PMSM Drive\",\"authors\":\"Aenugu Mastanaiah,&nbsp;Tejavathu Ramesh,&nbsp;Surla Vishnu Kanchana Naresh,&nbsp;Praveen Kumar Bonthagorla\",\"doi\":\"10.1049/pel2.70130\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>High-performance applications\\nextensively use permanent magnet synchronous motor (PMSM) drives because of their high torque density and efficiency. However, conventional PI controllers employed in the outer speed control loop of direct torque control with space vector modulation (DTC-SVM) are limited by parameter sensitivity, poor adaptability under dynamic conditions, and the need for extensive manual tuning. To overcome these challenges, a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent is introduced, incorporating a customised reward function to ensure precise torque reference generation. The TD3 agent is trained in MATLAB/Simulink using random speed and load profiles and deployed on a TMS320F28379D digital signal processor. Real-Time validation is carried out using an OPAL-RT 4512 simulator under a hardware-in-the-loop (HIL) framework. The inner-loop DTC operates at 20 kHz for torque and flux control, while the TD3 agent regulates speed at 2 kHz. Experimental results on 4.5 kW and 7.5 kW PMSMs show a 50% reduction in settling time, elimination of overshoot, and stable current responses without requiring controller retuning. The proposed method demonstrates robust and adaptive performance, confirming its effectiveness for embedded motor drive applications.</p>\",\"PeriodicalId\":56302,\"journal\":{\"name\":\"IET Power Electronics\",\"volume\":\"18 1\",\"pages\":\"\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2025-10-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/pel2.70130\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Power Electronics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/pel2.70130\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Power Electronics","FirstCategoryId":"5","ListUrlMain":"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/pel2.70130","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

高性能应用广泛使用永磁同步电机(PMSM)驱动器,因为它们的高扭矩密度和效率。然而,基于空间矢量调制的直接转矩控制(DTC-SVM)的外转速控制环中采用的传统PI控制器存在参数灵敏度高、动态适应性差、需要大量人工整定等问题。为了克服这些挑战,引入了双延迟深度确定性策略梯度(TD3)代理,其中包含定制的奖励函数,以确保精确的扭矩参考生成。TD3代理在MATLAB/Simulink中使用随机速度和负载配置文件进行训练,并部署在TMS320F28379D数字信号处理器上。在硬件在环(HIL)框架下,使用OPAL-RT 4512模拟器进行实时验证。内环DTC工作在20千赫的扭矩和磁链控制,而TD3代理调节速度在2千赫。在4.5 kW和7.5 kW永磁同步电动机上的实验结果表明,在不需要控制器返回的情况下,沉降时间减少了50%,消除了超调,并且电流响应稳定。该方法具有鲁棒性和自适应性能,验证了其在嵌入式电机驱动应用中的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Deep Reinforcement Learning Agent Based Speed Controller for DTC-SVM of PMSM Drive

Deep Reinforcement Learning Agent Based Speed Controller for DTC-SVM of PMSM Drive

High-performance applications extensively use permanent magnet synchronous motor (PMSM) drives because of their high torque density and efficiency. However, conventional PI controllers employed in the outer speed control loop of direct torque control with space vector modulation (DTC-SVM) are limited by parameter sensitivity, poor adaptability under dynamic conditions, and the need for extensive manual tuning. To overcome these challenges, a Twin Delayed Deep Deterministic Policy Gradient (TD3) agent is introduced, incorporating a customised reward function to ensure precise torque reference generation. The TD3 agent is trained in MATLAB/Simulink using random speed and load profiles and deployed on a TMS320F28379D digital signal processor. Real-Time validation is carried out using an OPAL-RT 4512 simulator under a hardware-in-the-loop (HIL) framework. The inner-loop DTC operates at 20 kHz for torque and flux control, while the TD3 agent regulates speed at 2 kHz. Experimental results on 4.5 kW and 7.5 kW PMSMs show a 50% reduction in settling time, elimination of overshoot, and stable current responses without requiring controller retuning. The proposed method demonstrates robust and adaptive performance, confirming its effectiveness for embedded motor drive applications.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Power Electronics
IET Power Electronics ENGINEERING, ELECTRICAL & ELECTRONIC-
CiteScore
5.50
自引率
10.00%
发文量
195
审稿时长
5.1 months
期刊介绍: IET Power Electronics aims to attract original research papers, short communications, review articles and power electronics related educational studies. The scope covers applications and technologies in the field of power electronics with special focus on cost-effective, efficient, power dense, environmental friendly and robust solutions, which includes: Applications: Electric drives/generators, renewable energy, industrial and consumable applications (including lighting, welding, heating, sub-sea applications, drilling and others), medical and military apparatus, utility applications, transport and space application, energy harvesting, telecommunications, energy storage management systems, home appliances. Technologies: Circuits: all type of converter topologies for low and high power applications including but not limited to: inverter, rectifier, dc/dc converter, power supplies, UPS, ac/ac converter, resonant converter, high frequency converter, hybrid converter, multilevel converter, power factor correction circuits and other advanced topologies. Components and Materials: switching devices and their control, inductors, sensors, transformers, capacitors, resistors, thermal management, filters, fuses and protection elements and other novel low-cost efficient components/materials. Control: techniques for controlling, analysing, modelling and/or simulation of power electronics circuits and complete power electronics systems. Design/Manufacturing/Testing: new multi-domain modelling, assembling and packaging technologies, advanced testing techniques. Environmental Impact: Electromagnetic Interference (EMI) reduction techniques, Electromagnetic Compatibility (EMC), limiting acoustic noise and vibration, recycling techniques, use of non-rare material. Education: teaching methods, programme and course design, use of technology in power electronics teaching, virtual laboratory and e-learning and fields within the scope of interest. Special Issues. Current Call for papers: Harmonic Mitigation Techniques and Grid Robustness in Power Electronic-Based Power Systems - https://digital-library.theiet.org/files/IET_PEL_CFP_HMTGRPEPS.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信