{"title":"平移耦合双柔性梁系统的滑模强化学习振动控制","authors":"Zhi-cheng Qiu, Si-wen Chen","doi":"10.1016/j.ejcon.2025.101239","DOIUrl":null,"url":null,"abstract":"<div><div>The coupled vibration control of a translational double flexible beam system with high nonlinearity and strong coupling is studied. The dynamic model of the system is established based on the finite element method (FEM), and the model parameters are identified by acquiring the experimental data of the system. To overcome the chattering problem of sliding mode control (SMC), a sliding mode reinforcement learning control (SMRLC) method is investigated. Taking the sliding surface as the state input, the asynchronous advantage actor-critic (A3C) algorithm is adopted to learn the optimal control policy through repeated trial and error interaction with the environment, so as to achieve robust control performance. The identification model of the double flexible beam system is used to pre-learn the SMRLC scheme to balance the learning efficiency and precision, and the effectiveness of the pre-learned SMRLC method is further verified by numerical simulation. The experimental setup is constructed, and the vibration control experiments of the first two bending modes are conducted, including set-point vibration control and simultaneous translation and vibration control under trapezoidal trajectory. SMRLC is compared with PD control and SMC. The experimental results demonstrate that the designed SMRLC method can effectively reduce the chattering of control signals and suppress the large and small amplitude vibration of the double flexible beam system, and there is no saturation in the control value.</div></div>","PeriodicalId":50489,"journal":{"name":"European Journal of Control","volume":"84 ","pages":"Article 101239"},"PeriodicalIF":2.5000,"publicationDate":"2025-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sliding mode reinforcement learning vibration control of a translational coupled double flexible beam system\",\"authors\":\"Zhi-cheng Qiu, Si-wen Chen\",\"doi\":\"10.1016/j.ejcon.2025.101239\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The coupled vibration control of a translational double flexible beam system with high nonlinearity and strong coupling is studied. The dynamic model of the system is established based on the finite element method (FEM), and the model parameters are identified by acquiring the experimental data of the system. To overcome the chattering problem of sliding mode control (SMC), a sliding mode reinforcement learning control (SMRLC) method is investigated. Taking the sliding surface as the state input, the asynchronous advantage actor-critic (A3C) algorithm is adopted to learn the optimal control policy through repeated trial and error interaction with the environment, so as to achieve robust control performance. The identification model of the double flexible beam system is used to pre-learn the SMRLC scheme to balance the learning efficiency and precision, and the effectiveness of the pre-learned SMRLC method is further verified by numerical simulation. The experimental setup is constructed, and the vibration control experiments of the first two bending modes are conducted, including set-point vibration control and simultaneous translation and vibration control under trapezoidal trajectory. SMRLC is compared with PD control and SMC. The experimental results demonstrate that the designed SMRLC method can effectively reduce the chattering of control signals and suppress the large and small amplitude vibration of the double flexible beam system, and there is no saturation in the control value.</div></div>\",\"PeriodicalId\":50489,\"journal\":{\"name\":\"European Journal of Control\",\"volume\":\"84 \",\"pages\":\"Article 101239\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2025-04-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European Journal of Control\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0947358025000688\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Control","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0947358025000688","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Sliding mode reinforcement learning vibration control of a translational coupled double flexible beam system
The coupled vibration control of a translational double flexible beam system with high nonlinearity and strong coupling is studied. The dynamic model of the system is established based on the finite element method (FEM), and the model parameters are identified by acquiring the experimental data of the system. To overcome the chattering problem of sliding mode control (SMC), a sliding mode reinforcement learning control (SMRLC) method is investigated. Taking the sliding surface as the state input, the asynchronous advantage actor-critic (A3C) algorithm is adopted to learn the optimal control policy through repeated trial and error interaction with the environment, so as to achieve robust control performance. The identification model of the double flexible beam system is used to pre-learn the SMRLC scheme to balance the learning efficiency and precision, and the effectiveness of the pre-learned SMRLC method is further verified by numerical simulation. The experimental setup is constructed, and the vibration control experiments of the first two bending modes are conducted, including set-point vibration control and simultaneous translation and vibration control under trapezoidal trajectory. SMRLC is compared with PD control and SMC. The experimental results demonstrate that the designed SMRLC method can effectively reduce the chattering of control signals and suppress the large and small amplitude vibration of the double flexible beam system, and there is no saturation in the control value.
期刊介绍:
The European Control Association (EUCA) has among its objectives to promote the development of the discipline. Apart from the European Control Conferences, the European Journal of Control is the Association''s main channel for the dissemination of important contributions in the field.
The aim of the Journal is to publish high quality papers on the theory and practice of control and systems engineering.
The scope of the Journal will be wide and cover all aspects of the discipline including methodologies, techniques and applications.
Research in control and systems engineering is necessary to develop new concepts and tools which enhance our understanding and improve our ability to design and implement high performance control systems. Submitted papers should stress the practical motivations and relevance of their results.
The design and implementation of a successful control system requires the use of a range of techniques:
Modelling
Robustness Analysis
Identification
Optimization
Control Law Design
Numerical analysis
Fault Detection, and so on.