Dynamic Event-Triggered Optimal Control for Heterogeneous Vehicle Platoon Based on Integral Reinforcement Learning

IF 6.7 2区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Yongming Li;Ying Xu;Kewen Li
{"title":"Dynamic Event-Triggered Optimal Control for Heterogeneous Vehicle Platoon Based on Integral Reinforcement Learning","authors":"Yongming Li;Ying Xu;Kewen Li","doi":"10.1109/TNSE.2025.3540993","DOIUrl":null,"url":null,"abstract":"This article investigates the issue of data-based distributed optimal control for third-order heterogeneous vehicle platoon system (HVPS) with input saturation under switching topology. In the control design, the integral reinforcement learning (IRL) algorithm is used to learn the online solution of the Hamilton-Jacobi-Bellman (HJB) equation with unknown dynamics. Combining IRL algorithm and critic neural network (CNN), a distributed adaptive optimal control approach is designed based on dynamic event-triggered (DET) mechanism. By the aid of topology-dependent Lyapunov function and the average dwell time method, the developed optimal control method demonstrates that all the signals in the considered system are uniformly ultimately bounded (UUB), the closed-loop system can achieve Nash equilibrium and string stability can be ensured. In addition, Zeno behavior can also be avoided. Finally, to illustrate the effectiveness of the developed optimal control approach, a simulation example is given.","PeriodicalId":54229,"journal":{"name":"IEEE Transactions on Network Science and Engineering","volume":"12 3","pages":"1885-1897"},"PeriodicalIF":6.7000,"publicationDate":"2025-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Network Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10882955/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

This article investigates the issue of data-based distributed optimal control for third-order heterogeneous vehicle platoon system (HVPS) with input saturation under switching topology. In the control design, the integral reinforcement learning (IRL) algorithm is used to learn the online solution of the Hamilton-Jacobi-Bellman (HJB) equation with unknown dynamics. Combining IRL algorithm and critic neural network (CNN), a distributed adaptive optimal control approach is designed based on dynamic event-triggered (DET) mechanism. By the aid of topology-dependent Lyapunov function and the average dwell time method, the developed optimal control method demonstrates that all the signals in the considered system are uniformly ultimately bounded (UUB), the closed-loop system can achieve Nash equilibrium and string stability can be ensured. In addition, Zeno behavior can also be avoided. Finally, to illustrate the effectiveness of the developed optimal control approach, a simulation example is given.
本文研究了开关拓扑结构下具有输入饱和的三阶异构车辆排系统(HVPS)的基于数据的分布式最优控制问题。在控制设计中,使用积分强化学习(IRL)算法来学习具有未知动态的汉密尔顿-雅各比-贝尔曼(HJB)方程的在线解。结合 IRL 算法和批评神经网络(CNN),设计了一种基于动态事件触发(DET)机制的分布式自适应优化控制方法。借助拓扑依赖的 Lyapunov 函数和平均停留时间法,所开发的最优控制方法证明了所考虑系统中的所有信号都是均匀终极有界(UUB)的,闭环系统可以达到纳什均衡,并能确保串稳定性。此外,还可以避免 Zeno 行为。最后,为了说明所开发的优化控制方法的有效性,给出了一个仿真实例。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Network Science and Engineering
IEEE Transactions on Network Science and Engineering Engineering-Control and Systems Engineering
CiteScore
12.60
自引率
9.10%
发文量
393
期刊介绍: The proposed journal, called the IEEE Transactions on Network Science and Engineering (TNSE), is committed to timely publishing of peer-reviewed technical articles that deal with the theory and applications of network science and the interconnections among the elements in a system that form a network. In particular, the IEEE Transactions on Network Science and Engineering publishes articles on understanding, prediction, and control of structures and behaviors of networks at the fundamental level. The types of networks covered include physical or engineered networks, information networks, biological networks, semantic networks, economic networks, social networks, and ecological networks. Aimed at discovering common principles that govern network structures, network functionalities and behaviors of networks, the journal seeks articles on understanding, prediction, and control of structures and behaviors of networks. Another trans-disciplinary focus of the IEEE Transactions on Network Science and Engineering is the interactions between and co-evolution of different genres of networks.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信