{"title":"一类非线性系统的强化学习优化逆死区控制","authors":"Wenxia Sun, Shuaihua Ma, Bin Li, Guoxing Wen","doi":"10.1002/acs.3913","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>In this article, an optimized inverse dead-zone control using reinforcement learning (RL) is developed for a class of nonlinear dynamic systems. The dead-zone is frequently occurred in the nonlinear control system, and it can affect the control performance and even cause the system instable. Hence, it is very requisite to consider the effect of dead-zone in the design of control strategy. In this proposed optimized inverse dead-zone control, the basic idea is to find the optimized control as input and the adaptive algorithm to estimate the unknown parameters for the inverse dead-zone function, so that the available dead-zone input for system control can be derived. Comparing with traditional methods, on the one hand, the proposed dead zone inverse method is with fewer adaptive parameters, on the other hand, the RL under identifier-critic-actor architecture is with the simplified algorithm. Finally, theoretical and simulation results manifest the feasibility of the proposed method.</p>\n </div>","PeriodicalId":50347,"journal":{"name":"International Journal of Adaptive Control and Signal Processing","volume":"38 12","pages":"3855-3864"},"PeriodicalIF":3.9000,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimized Inverse Dead-Zone Control Using Reinforcement Learning for a Class of Nonlinear Systems\",\"authors\":\"Wenxia Sun, Shuaihua Ma, Bin Li, Guoxing Wen\",\"doi\":\"10.1002/acs.3913\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>In this article, an optimized inverse dead-zone control using reinforcement learning (RL) is developed for a class of nonlinear dynamic systems. The dead-zone is frequently occurred in the nonlinear control system, and it can affect the control performance and even cause the system instable. Hence, it is very requisite to consider the effect of dead-zone in the design of control strategy. In this proposed optimized inverse dead-zone control, the basic idea is to find the optimized control as input and the adaptive algorithm to estimate the unknown parameters for the inverse dead-zone function, so that the available dead-zone input for system control can be derived. Comparing with traditional methods, on the one hand, the proposed dead zone inverse method is with fewer adaptive parameters, on the other hand, the RL under identifier-critic-actor architecture is with the simplified algorithm. Finally, theoretical and simulation results manifest the feasibility of the proposed method.</p>\\n </div>\",\"PeriodicalId\":50347,\"journal\":{\"name\":\"International Journal of Adaptive Control and Signal Processing\",\"volume\":\"38 12\",\"pages\":\"3855-3864\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2024-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Adaptive Control and Signal Processing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/acs.3913\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Adaptive Control and Signal Processing","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/acs.3913","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Optimized Inverse Dead-Zone Control Using Reinforcement Learning for a Class of Nonlinear Systems
In this article, an optimized inverse dead-zone control using reinforcement learning (RL) is developed for a class of nonlinear dynamic systems. The dead-zone is frequently occurred in the nonlinear control system, and it can affect the control performance and even cause the system instable. Hence, it is very requisite to consider the effect of dead-zone in the design of control strategy. In this proposed optimized inverse dead-zone control, the basic idea is to find the optimized control as input and the adaptive algorithm to estimate the unknown parameters for the inverse dead-zone function, so that the available dead-zone input for system control can be derived. Comparing with traditional methods, on the one hand, the proposed dead zone inverse method is with fewer adaptive parameters, on the other hand, the RL under identifier-critic-actor architecture is with the simplified algorithm. Finally, theoretical and simulation results manifest the feasibility of the proposed method.
期刊介绍:
The International Journal of Adaptive Control and Signal Processing is concerned with the design, synthesis and application of estimators or controllers where adaptive features are needed to cope with uncertainties.Papers on signal processing should also have some relevance to adaptive systems. The journal focus is on model based control design approaches rather than heuristic or rule based control design methods. All papers will be expected to include significant novel material.
Both the theory and application of adaptive systems and system identification are areas of interest. Papers on applications can include problems in the implementation of algorithms for real time signal processing and control. The stability, convergence, robustness and numerical aspects of adaptive algorithms are also suitable topics. The related subjects of controller tuning, filtering, networks and switching theory are also of interest. Principal areas to be addressed include:
Auto-Tuning, Self-Tuning and Model Reference Adaptive Controllers
Nonlinear, Robust and Intelligent Adaptive Controllers
Linear and Nonlinear Multivariable System Identification and Estimation
Identification of Linear Parameter Varying, Distributed and Hybrid Systems
Multiple Model Adaptive Control
Adaptive Signal processing Theory and Algorithms
Adaptation in Multi-Agent Systems
Condition Monitoring Systems
Fault Detection and Isolation Methods
Fault Detection and Isolation Methods
Fault-Tolerant Control (system supervision and diagnosis)
Learning Systems and Adaptive Modelling
Real Time Algorithms for Adaptive Signal Processing and Control
Adaptive Signal Processing and Control Applications
Adaptive Cloud Architectures and Networking
Adaptive Mechanisms for Internet of Things
Adaptive Sliding Mode Control.