IET Control Theory and Applications最新文献

{"title":"Closed-loop stability analysis of deep reinforcement learning controlled systems with experimental validation","authors":"Mohammed Basheer Mohiuddin,&nbsp;Igor Boiko,&nbsp;Rana Azzam,&nbsp;Yahya Zweiri","doi":"10.1049/cth2.12712","DOIUrl":"https://doi.org/10.1049/cth2.12712","url":null,"abstract":"<p>Trained deep reinforcement learning (DRL) based controllers can effectively control dynamic systems where classical controllers can be ineffective and difficult to tune. However, the lack of closed-loop stability guarantees of systems controlled by trained DRL agents hinders their adoption in practical applications. This research study investigates the closed-loop stability of dynamic systems controlled by trained DRL agents using Lyapunov analysis based on a linear-quadratic polynomial approximation of the trained agent. In addition, this work develops an understanding of the system's stability margin to determine operational boundaries and critical thresholds of the system's physical parameters for effective operation. The proposed analysis is verified on a DRL-controlled system for several simulated and experimental scenarios. The DRL agent is trained using a detailed dynamic model of a non-linear system and then tested on the corresponding real-world hardware platform without any fine-tuning. Experiments are conducted on a wide range of system states and physical parameters and the results have confirmed the validity of the proposed stability analysis (https://youtu.be/QlpeD5sTlPU).</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12712","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Finite-time control of DC–AC boost converter: The limit cycle approach","authors":"Meysam Azhdari,&nbsp;Tahereh Binazadeh","doi":"10.1049/cth2.12705","DOIUrl":"https://doi.org/10.1049/cth2.12705","url":null,"abstract":"<p>This paper proposes a novel finite-time limit cycle controller for DC to AC conversion in power boost converters. The stable limit cycle is categorized as a positive limit set. Achieving the control law, based on the concepts of set stability and finite-time stability, is a challenging problem. To fulfill the control objective, a novel sliding manifold is suggested concerning the structure of the wanted limit cycle which facilitates conditions for the development of finite-time stability for the limit cycle. By utilizing the sliding mode control method, a control strategy is proposed that guarantees the desired stable limit cycle is created in the phase plane of the closed-loop system and the phase trajectories reach it in a finite time and remain on it for all future times. This ensures the finite-time generation of the biased sinusoidal oscillations in the output of the power boost converter from a DC input source. The simulation results of a practical boost converter have validated the effectiveness and feasibility of the presented algorithm.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12705","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142435903","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Optimising the tumour elimination payoff in cancer therapy","authors":"Nigel J. Burroughs,&nbsp;Mathilde L. C. Leuridan","doi":"10.1049/cth2.12701","DOIUrl":"https://doi.org/10.1049/cth2.12701","url":null,"abstract":"<p>A new payoff function is proposed for cancer treatment optimisation, the tumour elimination payoff (TEP), that incorporates the increase in lifespan if tumour elimination is achieved. The TEP is discounted by drug toxicity and by potential risks, such as metastasis and mutation. An approximation is used for the probability of tumour elimination, <span></span><math>\u0000 <semantics>\u0000 <msup>\u0000 <mi>e</mi>\u0000 <mrow>\u0000 <mo>−</mo>\u0000 <mi>α</mi>\u0000 <mi>N</mi>\u0000 <mo>(</mo>\u0000 <mi>T</mi>\u0000 <mo>)</mo>\u0000 </mrow>\u0000 </msup>\u0000 <annotation>$e^{-alpha N(T)}$</annotation>\u0000 </semantics></math>, giving a terminal payoff with an exponential dependence on the final tumour size <span></span><math>\u0000 <semantics>\u0000 <mrow>\u0000 <mi>N</mi>\u0000 <mo>(</mo>\u0000 <mi>T</mi>\u0000 <mo>)</mo>\u0000 </mrow>\u0000 <annotation>$N(T)$</annotation>\u0000 </semantics></math>. The optimal solutions for this payoff for simple tumour growth models, (logistic and Gompertz growth), are determined. Using Pontryagin's maximum principle it is proved that bang–bang optimal solutions exist with a single switch; specifically delayed treatment and treat-and-stop solutions at maximum tolerated dose (MTD) exist. There is also a singular arc with constant tumour size. Solutions either have a high probability, respectively, low probability of tumour elimination; these correspond to a post-treatment high probability of cure, and a high probability of relapse, respectively. Optimising over the time horizon <span></span><math>\u0000 <semantics>\u0000 <mi>T</mi>\u0000 <annotation>$T$</annotation>\u0000 </semantics></math> results in solutions that are either MTD throughout or no treatment, that is, treatment is either beneficial or detrimental. For the logistic growth model, the treatment benefit phase diagram is derived with respect to the patient's expected increase in lifespan and tumour size.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12701","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123363","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Enhanced precision in robot arm positioning: A nonlinear damping approach for flexible joint manipulators","authors":"Amir Hossein Jafari,&nbsp;Rached Dhaouadi,&nbsp;Reza Jafari","doi":"10.1049/cth2.12707","DOIUrl":"https://doi.org/10.1049/cth2.12707","url":null,"abstract":"<p>This article introduces an advanced nonlinear controller designed for optimizing the performance of a single-link robot arm featuring a flexible joint. The proposed nonlinear control strategy incorporates a Proportional-Integral (PI) controller in conjunction with a nonlinear velocity feedback component, aimed at providing effective nonlinear damping and suppressing vibrations. To validate the controller's performance, extensive simulations are conducted utilizing machine learning techniques within the Python environment. The performance of the proposed nonlinear damping controller is benchmarked against a conventional linear cascaded P-PI control structure, with both controllers fine-tuned using the Nelder-Mead algorithm. Simulation results demonstrate that the nonlinear damping controller yields substantial improvements in the dynamic behavior of the robot axis arm, showcasing superior step and sinusoidal position tracking performance, along with active vibration damping capabilities. This research contributes valuable insights into the enhanced nonlinear control strategies for flexible-joint robot arms, offering promising advancements in their overall dynamic performance.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12707","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142435822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Coordinated finite-time control of multiple motors with saturation constraints","authors":"Changfan Zhang,&nbsp;Junming Zhang,&nbsp;Jing He,&nbsp;Lin Jia,&nbsp;Yang Zhou","doi":"10.1049/cth2.12684","DOIUrl":"https://doi.org/10.1049/cth2.12684","url":null,"abstract":"<p>A multi-motor coordinated tracking control strategy based on a disturbance sliding-mode observer and an anti-saturation non-singular fast-terminal sliding mode is proposed to address the issues of slow convergence and controller output saturation in multi-motor coordinated control systems. Firstly, a mathematical model of a multi-motor traction system considering uncertain parameter perturbations, external disturbances, and dead zones was established. Secondly, a disturbance sliding-mode observer was designed based on the mathematical model to eliminate motor disturbances and estimate the torque. The observer's forward compensation was added to design a total-consensus-based fast non-singular terminal sliding-mode controller. Then, a fast anti-saturation auxiliary system with fast finite-time convergence was constructed. Finally, a comparative experiment was conducted with traditional anti-saturation sliding-mode control to demonstrate that the proposed method had faster convergence, stronger disturbance rejection, and better tracking performance in the presence of multi-motor parameter perturbations, unknown disturbances, and input saturation.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12684","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141968010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Reinforcement learning-based finite-time cross-media tracking control for a cross-media vehicle under unknown dynamics and disturbances","authors":"Shichong Wu,&nbsp;Lingli Xie,&nbsp;Jun Xian,&nbsp;Fei Liao,&nbsp;Wenhua Wu,&nbsp;Mingqing Lu,&nbsp;Xian Yi","doi":"10.1049/cth2.12693","DOIUrl":"https://doi.org/10.1049/cth2.12693","url":null,"abstract":"<p>This study proposes a reinforcement learning-based finite-time cross-media tracking control approach for a slender body cross-media vehicle encountering unknown hydrodynamics, wind, and wave disturbances. Initially, a reinforcement learning framework consisting of the actor neural network and critic neural network is constructed. The critic neural network monitors the actions of the actor neural network and approximates the cost function, while the actor neural network estimates the unknown hydrodynamics and disturbances, minimising the cost function to optimise performance. Subsequently, the command filter featuring finite-time convergence is formulated, effectively managing the corresponding filter error through a proposed error compensating signal. By integrating these techniques, a reinforcement learning-based finite-time control strategy is developed, circumventing the singularity issue inherent in traditional finite-time backstepping strategies. Comparative analysis with existing methods demonstrates the strong robustness of the proposed scheme against unknown hydrodynamics and disturbances, ensuring finite-time convergence of the system's states and optimising controller performance. Finally, simulations confirm the effectiveness and superiority of the presented approach.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12693","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141584114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Finite-time control for a quadcopter UAV in the application of wildfire monitoring","authors":"Joewell Mawanza,&nbsp;John Agee,&nbsp;Ernest Bhero","doi":"10.1049/cth2.12696","DOIUrl":"https://doi.org/10.1049/cth2.12696","url":null,"abstract":"<p>This article investigates the problem of monitoring wildfires using a quadcopter uncrewed aerial vehicle (UAV) subject to external perturbations and nonlinear uncertainties. A finite-time control scheme is designed for the quadcopter UAV to monitor the elliptical propagation of a wildfire. The control scheme is composed of an improved nonsingular fast terminal sliding mode control (NFTSMC) and a higher order sliding mode observer (HOSMO). The HOSMO is constructed first to estimate external perturbations, nonlinear uncertainties, and incomplete system states resulting from the system's uncertainties. Then, a novel NFTSMC is developed that utilizes the estimated system states. The Lyapunov theorem is used to demonstrate that the quadcopter UAV can elliptically monitor a wildfire, and the tracking error can rapidly converge to zero within a finite time. Comparative simulation results are presented to illustrate the effectiveness of the proposed control scheme.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12696","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141967973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Attack detection method for encrypted wave-variable-based bilateral control systems","authors":"Tetsuro Miyazaki,&nbsp;Naoto Shono,&nbsp;Kaoru Teranishi,&nbsp;Takahiro Kanno,&nbsp;Toshihiro Kawase,&nbsp;Kiminao Kogiso,&nbsp;Kenji Kawashima","doi":"10.1049/cth2.12697","DOIUrl":"https://doi.org/10.1049/cth2.12697","url":null,"abstract":"<p>This study presents an energy-based attack detection method involving an encrypted bilateral control system using wave variables. In the considered bilateral control system, the leader and follower receive the follower's force information and the leader's velocity information, respectively, through the wave variables. The considered attack model multiplies the wave variables by an attack parameter, which is possible due to the malleability of the encryption scheme. The bilateral control system will be destabilized if the attacker chooses a relatively large parameter value. This motivates in developing a passivity observer for each leader and follower side to compute the total energy and constructing an energy-based detection method that can be incorporated into the encrypted bilateral control system and is summarized in the presented theorem. Furthermore, this study provides a specific design for reasonable threshold parameters concerning the control system energy. The theorem and the experimental validation confirm that the developed encrypted wave-variable-based bilateral control system with the proposed attack detector is secure and effective as a countermeasure against malleability-based attacks.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12697","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141584004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Adaptive fuzzy disturbance suppression for constrained nonlinear systems under faulty condition","authors":"Meiying Yang,&nbsp;Li Tang","doi":"10.1049/cth2.12683","DOIUrl":"10.1049/cth2.12683","url":null,"abstract":"<p>For a class of full-states constraints nonlinear system with actuator failure, an adaptive fuzzy disturbance observer tracking design is carried out by using Lyapunov function and the dynamic surface method. The integral explosion problem is avoided by using the dynamic surface design method. Because the disturbance of the system is unknown, a nonlinear fuzzy disturbance observer is designed to estimate the unknown disturbance. And the unknown nonlinear function is approximated fuzzy logic systems. Based on the Lyapunov function method and backstepping approach, the stability of considered systems are analysed. And the proposed method can guarantee that all the signals in the closed-loop system are bounded and the system output can track the desired signal to the small neighbourhood range. In addition, the fuzzy disturbance observer can estimate the unknown disturbance state well. Finally, several sets of simulation examples are given and compared with other method, and the experimental results are quantitatively analysed. Then, the robustness and superiority of the proposed control scheme are verified and demonstrated.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12683","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141344446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A mismatched composite disturbance observer-based adaptive tracking controller for robotic manipulators","authors":"Zhongtao Liu,&nbsp;Weikai He,&nbsp;Xiangbao Li,&nbsp;Cungen Liu,&nbsp;Huaizhi Shao,&nbsp;Peng Fu","doi":"10.1049/cth2.12690","DOIUrl":"10.1049/cth2.12690","url":null,"abstract":"<p>The paper is devoted to the adaptive tracking control based on the mismatched disturbance observer for motor-driven robotic manipulators. A novel mismatched disturbance observer is introduced, which does not make bounded derivative assumptions on mismatched disturbances in the robotic manipulator system. Additionally, a new adaptive tracking controller for a motor-driven robotic manipulator based on the mismatched disturbance observer is designed, which guarantees that all closed-loop signals are globally uniformly bounded and the tracking error is asymptotic stable. Finally, the simulation comparisons are carried out between the proposed and existing control strategies to demonstrate the superiority of the developed controller.</p>","PeriodicalId":50382,"journal":{"name":"IET Control Theory and Applications","volume":null,"pages":null},"PeriodicalIF":2.2,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/cth2.12690","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141340377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}