{"title":"主动悬架系统0 ~ 500hz全频带振动抑制的强化学习和H∞混合控制框架","authors":"Zhehui Zhu, Lijun Zhang, Chengfu Shang, Siqi Chen","doi":"10.1016/j.aei.2025.103844","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid development of intelligent vehicles, active suspension systems have become crucial for enhancing ride comfort and handling stability. However, most existing control strategies focus on low-frequency vibrations below 20 Hz while neglecting high-frequency oscillations induced by discrete control signals and hardware delays. These high-frequency vibrations can degrade system performance and compromise operational safety. To address this issue, this study proposes a dual-layer control framework integrating mixed-sensitivity H∞ robust control with a reinforcement learning (RL)-based adaptive compensator. The robust controller ensures system stability and accelerates policy convergence, whereas the RL agent provides an adaptive weighting policy that complements the robust controller in real time. A safety supervision mechanism is also incorporated to monitor control actions and override potentially unsafe outputs by reverting to robust controller commands when necessary. Furthermore, a novel 0–500 Hz vibration evaluation framework is developed to comprehensively assess suspension performance, covering conventional suspension control metrics and vibration responses within the in-cabin structure-borne noise frequency band (50–500 Hz). Simulation results on a quarter-car model with a rigid ring tire and a strut-top-mount bushing indicate that the proposed RL-H∞ method achieves a 10.42 % reduction in body acceleration from 0 to 20 Hz. Compared with pure RL-based control, it achieves a 20.11 % improvement in vibration suppression within the 50–500 Hz band. Under complex and varying road excitations, the proposed RL-H∞ controller consistently demonstrates robust vibration suppression across the 0–500 Hz frequency range. By addressing vibration responses in the in-cabin acoustic control band, this study provides a solid theoretical and methodological basis for the integrated optimization of suspension control and in-cabin road noise mitigation in intelligent vehicles.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"69 ","pages":"Article 103844"},"PeriodicalIF":9.9000,"publicationDate":"2025-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A reinforcement learning and H∞ hybrid control framework for 0–500 Hz full-band vibration suppression in active suspension systems\",\"authors\":\"Zhehui Zhu, Lijun Zhang, Chengfu Shang, Siqi Chen\",\"doi\":\"10.1016/j.aei.2025.103844\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>With the rapid development of intelligent vehicles, active suspension systems have become crucial for enhancing ride comfort and handling stability. However, most existing control strategies focus on low-frequency vibrations below 20 Hz while neglecting high-frequency oscillations induced by discrete control signals and hardware delays. These high-frequency vibrations can degrade system performance and compromise operational safety. To address this issue, this study proposes a dual-layer control framework integrating mixed-sensitivity H∞ robust control with a reinforcement learning (RL)-based adaptive compensator. The robust controller ensures system stability and accelerates policy convergence, whereas the RL agent provides an adaptive weighting policy that complements the robust controller in real time. A safety supervision mechanism is also incorporated to monitor control actions and override potentially unsafe outputs by reverting to robust controller commands when necessary. Furthermore, a novel 0–500 Hz vibration evaluation framework is developed to comprehensively assess suspension performance, covering conventional suspension control metrics and vibration responses within the in-cabin structure-borne noise frequency band (50–500 Hz). Simulation results on a quarter-car model with a rigid ring tire and a strut-top-mount bushing indicate that the proposed RL-H∞ method achieves a 10.42 % reduction in body acceleration from 0 to 20 Hz. Compared with pure RL-based control, it achieves a 20.11 % improvement in vibration suppression within the 50–500 Hz band. Under complex and varying road excitations, the proposed RL-H∞ controller consistently demonstrates robust vibration suppression across the 0–500 Hz frequency range. By addressing vibration responses in the in-cabin acoustic control band, this study provides a solid theoretical and methodological basis for the integrated optimization of suspension control and in-cabin road noise mitigation in intelligent vehicles.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"69 \",\"pages\":\"Article 103844\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034625007372\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625007372","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A reinforcement learning and H∞ hybrid control framework for 0–500 Hz full-band vibration suppression in active suspension systems
With the rapid development of intelligent vehicles, active suspension systems have become crucial for enhancing ride comfort and handling stability. However, most existing control strategies focus on low-frequency vibrations below 20 Hz while neglecting high-frequency oscillations induced by discrete control signals and hardware delays. These high-frequency vibrations can degrade system performance and compromise operational safety. To address this issue, this study proposes a dual-layer control framework integrating mixed-sensitivity H∞ robust control with a reinforcement learning (RL)-based adaptive compensator. The robust controller ensures system stability and accelerates policy convergence, whereas the RL agent provides an adaptive weighting policy that complements the robust controller in real time. A safety supervision mechanism is also incorporated to monitor control actions and override potentially unsafe outputs by reverting to robust controller commands when necessary. Furthermore, a novel 0–500 Hz vibration evaluation framework is developed to comprehensively assess suspension performance, covering conventional suspension control metrics and vibration responses within the in-cabin structure-borne noise frequency band (50–500 Hz). Simulation results on a quarter-car model with a rigid ring tire and a strut-top-mount bushing indicate that the proposed RL-H∞ method achieves a 10.42 % reduction in body acceleration from 0 to 20 Hz. Compared with pure RL-based control, it achieves a 20.11 % improvement in vibration suppression within the 50–500 Hz band. Under complex and varying road excitations, the proposed RL-H∞ controller consistently demonstrates robust vibration suppression across the 0–500 Hz frequency range. By addressing vibration responses in the in-cabin acoustic control band, this study provides a solid theoretical and methodological basis for the integrated optimization of suspension control and in-cabin road noise mitigation in intelligent vehicles.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.