{"title":"Adaptive Finite-Time RL Control for Stochastic Non-Linear Systems With Full State Constraints and Dead Zone Output","authors":"Hongyao Li, Fuli Wang","doi":"10.1002/acs.3980","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>In this article, the finite-time control problem of adaptive neural network (NN) reinforcement learning (RL) is investigated for the continuous time stochastic non-linear systems with full state constraints and dead zone output. Firstly, the adaptive estimation and smooth approximation technique are introduced to solve the difficulty arising from the dead zone non-linearity. Moreover, to overcome the problem of calculating the explosion caused by the repeated differentiation of the virtual control signals, a finite-time command filter is constructed. Combining the backstepping technique and the identifier-actor-critic RL strategy, an adaptive neural finite-time RL control scheme is proposed for the considered system by constructing the tangent-type time-varying barrier Lyapunov functions (BLFs), which optimizes the tracking performance while ensuring all states do not violate the constraints. Under the proposed control strategy, it is guaranteed that all signals are bounded in probability, and the output of the system can track the reference signal within a finite-time. Finally, the simulation results verify the effectiveness of the proposed scheme.</p>\n </div>","PeriodicalId":50347,"journal":{"name":"International Journal of Adaptive Control and Signal Processing","volume":"39 4","pages":"818-828"},"PeriodicalIF":3.9000,"publicationDate":"2025-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Adaptive Control and Signal Processing","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/acs.3980","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
In this article, the finite-time control problem of adaptive neural network (NN) reinforcement learning (RL) is investigated for the continuous time stochastic non-linear systems with full state constraints and dead zone output. Firstly, the adaptive estimation and smooth approximation technique are introduced to solve the difficulty arising from the dead zone non-linearity. Moreover, to overcome the problem of calculating the explosion caused by the repeated differentiation of the virtual control signals, a finite-time command filter is constructed. Combining the backstepping technique and the identifier-actor-critic RL strategy, an adaptive neural finite-time RL control scheme is proposed for the considered system by constructing the tangent-type time-varying barrier Lyapunov functions (BLFs), which optimizes the tracking performance while ensuring all states do not violate the constraints. Under the proposed control strategy, it is guaranteed that all signals are bounded in probability, and the output of the system can track the reference signal within a finite-time. Finally, the simulation results verify the effectiveness of the proposed scheme.
期刊介绍:
The International Journal of Adaptive Control and Signal Processing is concerned with the design, synthesis and application of estimators or controllers where adaptive features are needed to cope with uncertainties.Papers on signal processing should also have some relevance to adaptive systems. The journal focus is on model based control design approaches rather than heuristic or rule based control design methods. All papers will be expected to include significant novel material.
Both the theory and application of adaptive systems and system identification are areas of interest. Papers on applications can include problems in the implementation of algorithms for real time signal processing and control. The stability, convergence, robustness and numerical aspects of adaptive algorithms are also suitable topics. The related subjects of controller tuning, filtering, networks and switching theory are also of interest. Principal areas to be addressed include:
Auto-Tuning, Self-Tuning and Model Reference Adaptive Controllers
Nonlinear, Robust and Intelligent Adaptive Controllers
Linear and Nonlinear Multivariable System Identification and Estimation
Identification of Linear Parameter Varying, Distributed and Hybrid Systems
Multiple Model Adaptive Control
Adaptive Signal processing Theory and Algorithms
Adaptation in Multi-Agent Systems
Condition Monitoring Systems
Fault Detection and Isolation Methods
Fault Detection and Isolation Methods
Fault-Tolerant Control (system supervision and diagnosis)
Learning Systems and Adaptive Modelling
Real Time Algorithms for Adaptive Signal Processing and Control
Adaptive Signal Processing and Control Applications
Adaptive Cloud Architectures and Networking
Adaptive Mechanisms for Internet of Things
Adaptive Sliding Mode Control.