A reinforcement learning and H∞ hybrid control framework for 0–500 Hz full-band vibration suppression in active suspension systems

IF 9.9 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Zhehui Zhu, Lijun Zhang, Chengfu Shang, Siqi Chen
{"title":"A reinforcement learning and H∞ hybrid control framework for 0–500 Hz full-band vibration suppression in active suspension systems","authors":"Zhehui Zhu,&nbsp;Lijun Zhang,&nbsp;Chengfu Shang,&nbsp;Siqi Chen","doi":"10.1016/j.aei.2025.103844","DOIUrl":null,"url":null,"abstract":"<div><div>With the rapid development of intelligent vehicles, active suspension systems have become crucial for enhancing ride comfort and handling stability. However, most existing control strategies focus on low-frequency vibrations below 20 Hz while neglecting high-frequency oscillations induced by discrete control signals and hardware delays. These high-frequency vibrations can degrade system performance and compromise operational safety. To address this issue, this study proposes a dual-layer control framework integrating mixed-sensitivity H∞ robust control with a reinforcement learning (RL)-based adaptive compensator. The robust controller ensures system stability and accelerates policy convergence, whereas the RL agent provides an adaptive weighting policy that complements the robust controller in real time. A safety supervision mechanism is also incorporated to monitor control actions and override potentially unsafe outputs by reverting to robust controller commands when necessary. Furthermore, a novel 0–500 Hz vibration evaluation framework is developed to comprehensively assess suspension performance, covering conventional suspension control metrics and vibration responses within the in-cabin structure-borne noise frequency band (50–500 Hz). Simulation results on a quarter-car model with a rigid ring tire and a strut-top-mount bushing indicate that the proposed RL-H∞ method achieves a 10.42 % reduction in body acceleration from 0 to 20 Hz. Compared with pure RL-based control, it achieves a 20.11 % improvement in vibration suppression within the 50–500 Hz band. Under complex and varying road excitations, the proposed RL-H∞ controller consistently demonstrates robust vibration suppression across the 0–500 Hz frequency range. By addressing vibration responses in the in-cabin acoustic control band, this study provides a solid theoretical and methodological basis for the integrated optimization of suspension control and in-cabin road noise mitigation in intelligent vehicles.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"69 ","pages":"Article 103844"},"PeriodicalIF":9.9000,"publicationDate":"2025-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625007372","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

With the rapid development of intelligent vehicles, active suspension systems have become crucial for enhancing ride comfort and handling stability. However, most existing control strategies focus on low-frequency vibrations below 20 Hz while neglecting high-frequency oscillations induced by discrete control signals and hardware delays. These high-frequency vibrations can degrade system performance and compromise operational safety. To address this issue, this study proposes a dual-layer control framework integrating mixed-sensitivity H∞ robust control with a reinforcement learning (RL)-based adaptive compensator. The robust controller ensures system stability and accelerates policy convergence, whereas the RL agent provides an adaptive weighting policy that complements the robust controller in real time. A safety supervision mechanism is also incorporated to monitor control actions and override potentially unsafe outputs by reverting to robust controller commands when necessary. Furthermore, a novel 0–500 Hz vibration evaluation framework is developed to comprehensively assess suspension performance, covering conventional suspension control metrics and vibration responses within the in-cabin structure-borne noise frequency band (50–500 Hz). Simulation results on a quarter-car model with a rigid ring tire and a strut-top-mount bushing indicate that the proposed RL-H∞ method achieves a 10.42 % reduction in body acceleration from 0 to 20 Hz. Compared with pure RL-based control, it achieves a 20.11 % improvement in vibration suppression within the 50–500 Hz band. Under complex and varying road excitations, the proposed RL-H∞ controller consistently demonstrates robust vibration suppression across the 0–500 Hz frequency range. By addressing vibration responses in the in-cabin acoustic control band, this study provides a solid theoretical and methodological basis for the integrated optimization of suspension control and in-cabin road noise mitigation in intelligent vehicles.
主动悬架系统0 ~ 500hz全频带振动抑制的强化学习和H∞混合控制框架
随着智能汽车的快速发展,主动悬架系统已成为提高车辆乘坐舒适性和操纵稳定性的关键。然而,大多数现有的控制策略侧重于20hz以下的低频振动,而忽略了由离散控制信号和硬件延迟引起的高频振荡。这些高频振动会降低系统性能,危及操作安全。为了解决这一问题,本研究提出了一种将混合灵敏度H∞鲁棒控制与基于强化学习(RL)的自适应补偿器相结合的双层控制框架。鲁棒控制器保证了系统的稳定性并加速了策略的收敛,而RL代理提供了一个自适应的加权策略,可以实时地补充鲁棒控制器。安全监督机制也被纳入监控控制行为,并在必要时通过恢复到鲁棒控制器命令来覆盖潜在的不安全输出。此外,开发了一个新的0-500 Hz振动评估框架,以全面评估悬架性能,涵盖传统的悬架控制指标和舱内结构噪声频带(50-500 Hz)内的振动响应。仿真结果表明,采用RL-H∞方法可以在0 ~ 20 Hz范围内将车身加速度降低10.42%。与纯基于rl的控制相比,在50-500 Hz频段内,该方法的振动抑制效果提高了20.11%。在复杂和变化的道路激励下,所提出的RL-H∞控制器在0-500 Hz频率范围内始终表现出鲁棒的振动抑制。通过对车内噪声控制带振动响应的研究,为智能汽车悬架控制与车内道路噪声的综合优化提供了坚实的理论和方法基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信