深度强化学习在永磁同步电机电流跟踪和速度控制中的综合评价

IF 8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Yiming Zhang , Jingxiang Li , Hao Zhou , Chin-Boon Chng , Chee-Kong Chui , Shengdun Zhao
{"title":"深度强化学习在永磁同步电机电流跟踪和速度控制中的综合评价","authors":"Yiming Zhang ,&nbsp;Jingxiang Li ,&nbsp;Hao Zhou ,&nbsp;Chin-Boon Chng ,&nbsp;Chee-Kong Chui ,&nbsp;Shengdun Zhao","doi":"10.1016/j.engappai.2025.110551","DOIUrl":null,"url":null,"abstract":"<div><div>Permanent Magnet Synchronous Motors (PMSMs) are indispensable in industrial applications, requiring precise control to ensure optimal performance. Traditional model-based methods, such as Proportional-Integral (PI) control and Model Predictive Control (MPC), face inherent limitations in robustness and adaptability under complex conditions. Deep Reinforcement Learning (DRL), as a model-free, data-driven approach, offers a transformative solution for PMSM control. This study proposes a DRL-based current control strategy and systematically evaluates the performance of three representative DRL algorithms: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C) in PMSM control tasks. Key contributions include hyperparameter sensitivity analysis, transfer learning for improved training efficiency, and the application of DRL to multi-objective speed control under varying operational scenarios. Experimental results reveal the hyperparameter sensitivities of different DRL algorithms and provide theoretical insights. The findings demonstrate that transfer learning significantly improves DRL training efficiency and control performance. DRL outperforms traditional controllers in current and speed control, achieving superior dynamic response, tracking accuracy, and adaptability to complex conditions. This study offers new insights into the application of DRL in industrial PMSM control and serves as a reference for its further optimization and practical deployment.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"149 ","pages":"Article 110551"},"PeriodicalIF":8.0000,"publicationDate":"2025-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comprehensive evaluation of deep reinforcement learning for permanent magnet synchronous motor current tracking and speed control applications\",\"authors\":\"Yiming Zhang ,&nbsp;Jingxiang Li ,&nbsp;Hao Zhou ,&nbsp;Chin-Boon Chng ,&nbsp;Chee-Kong Chui ,&nbsp;Shengdun Zhao\",\"doi\":\"10.1016/j.engappai.2025.110551\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Permanent Magnet Synchronous Motors (PMSMs) are indispensable in industrial applications, requiring precise control to ensure optimal performance. Traditional model-based methods, such as Proportional-Integral (PI) control and Model Predictive Control (MPC), face inherent limitations in robustness and adaptability under complex conditions. Deep Reinforcement Learning (DRL), as a model-free, data-driven approach, offers a transformative solution for PMSM control. This study proposes a DRL-based current control strategy and systematically evaluates the performance of three representative DRL algorithms: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C) in PMSM control tasks. Key contributions include hyperparameter sensitivity analysis, transfer learning for improved training efficiency, and the application of DRL to multi-objective speed control under varying operational scenarios. Experimental results reveal the hyperparameter sensitivities of different DRL algorithms and provide theoretical insights. The findings demonstrate that transfer learning significantly improves DRL training efficiency and control performance. DRL outperforms traditional controllers in current and speed control, achieving superior dynamic response, tracking accuracy, and adaptability to complex conditions. This study offers new insights into the application of DRL in industrial PMSM control and serves as a reference for its further optimization and practical deployment.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"149 \",\"pages\":\"Article 110551\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-03-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625005512\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625005512","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

永磁同步电机(pmms)在工业应用中不可或缺,需要精确控制以确保最佳性能。传统的基于模型的方法,如比例积分控制(PI)和模型预测控制(MPC),在复杂条件下的鲁棒性和适应性方面存在固有的局限性。深度强化学习(DRL)作为一种无模型、数据驱动的方法,为永磁同步电机控制提供了一种变革性的解决方案。本研究提出了一种基于DRL的电流控制策略,并系统地评估了三种代表性DRL算法:深度q -网络(DQN)、近端策略优化(PPO)和优势行为者批评家(A2C)在PMSM控制任务中的性能。关键贡献包括超参数灵敏度分析、提高训练效率的迁移学习,以及DRL在不同作战场景下的多目标速度控制应用。实验结果揭示了不同DRL算法的超参数敏感性,并提供了理论见解。研究结果表明,迁移学习显著提高了DRL训练效率和控制性能。DRL在电流和速度控制方面优于传统控制器,实现了卓越的动态响应、跟踪精度和对复杂条件的适应性。该研究为DRL在工业永磁同步电机控制中的应用提供了新的见解,并为其进一步优化和实际部署提供了参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Comprehensive evaluation of deep reinforcement learning for permanent magnet synchronous motor current tracking and speed control applications
Permanent Magnet Synchronous Motors (PMSMs) are indispensable in industrial applications, requiring precise control to ensure optimal performance. Traditional model-based methods, such as Proportional-Integral (PI) control and Model Predictive Control (MPC), face inherent limitations in robustness and adaptability under complex conditions. Deep Reinforcement Learning (DRL), as a model-free, data-driven approach, offers a transformative solution for PMSM control. This study proposes a DRL-based current control strategy and systematically evaluates the performance of three representative DRL algorithms: Deep Q-Network (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C) in PMSM control tasks. Key contributions include hyperparameter sensitivity analysis, transfer learning for improved training efficiency, and the application of DRL to multi-objective speed control under varying operational scenarios. Experimental results reveal the hyperparameter sensitivities of different DRL algorithms and provide theoretical insights. The findings demonstrate that transfer learning significantly improves DRL training efficiency and control performance. DRL outperforms traditional controllers in current and speed control, achieving superior dynamic response, tracking accuracy, and adaptability to complex conditions. This study offers new insights into the application of DRL in industrial PMSM control and serves as a reference for its further optimization and practical deployment.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信