Safety-Aware Pursuit-Evasion Game Based on Control Barrier Function and Reinforcement Learning

IF 8.7 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Yupeng Jia;Xiran Cui;Yi Dong;Xiaoming Hu
{"title":"Safety-Aware Pursuit-Evasion Game Based on Control Barrier Function and Reinforcement Learning","authors":"Yupeng Jia;Xiran Cui;Yi Dong;Xiaoming Hu","doi":"10.1109/TSMC.2025.3546968","DOIUrl":null,"url":null,"abstract":"This article considers the pursuit-evasion game of two dynamic systems, which are subject to safety constraints, and in order to additionally guarantee the safety of the system, we propose safety-aware pursuit and escape strategies by combining control barrier function (CBF) and off-policy learning technique. Different from existing pursuit and evader strategies, a safeguarding control law is first designed based on CBF to prioritize the safety of pursuer’s and evader’s trajectories, and then bounded game strategies are proposed by elaborately designing a new cost function. We also provide the sufficient condition for the stability of the closed-loop system with the state denoted by position difference, under which, the pursuer is able to capture the evader. It is worth mentioning that our strategies do not require the knowledge of system dynamics, which are essentially online learning-based ones, featured with the ability of satisfying the safety constraints in the pursuit-evasion game.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 8","pages":"5440-5450"},"PeriodicalIF":8.7000,"publicationDate":"2025-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11029272/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

This article considers the pursuit-evasion game of two dynamic systems, which are subject to safety constraints, and in order to additionally guarantee the safety of the system, we propose safety-aware pursuit and escape strategies by combining control barrier function (CBF) and off-policy learning technique. Different from existing pursuit and evader strategies, a safeguarding control law is first designed based on CBF to prioritize the safety of pursuer’s and evader’s trajectories, and then bounded game strategies are proposed by elaborately designing a new cost function. We also provide the sufficient condition for the stability of the closed-loop system with the state denoted by position difference, under which, the pursuer is able to capture the evader. It is worth mentioning that our strategies do not require the knowledge of system dynamics, which are essentially online learning-based ones, featured with the ability of satisfying the safety constraints in the pursuit-evasion game.
基于控制障碍函数和强化学习的安全意识追逃博弈
本文考虑了两个受安全约束的动态系统的追逃博弈问题,为了进一步保证系统的安全,结合控制障碍函数(CBF)和脱策略学习技术,提出了安全感知的追逃策略。与现有的追捕和逃避策略不同,首先基于CBF设计了一种保障控制律,优先考虑了追捕和逃避者轨迹的安全,然后通过精心设计新的成本函数提出了有界博弈策略。给出了以位置差表示状态的闭环系统稳定的充分条件,在此条件下,跟踪者能够捕获逃避者。值得一提的是,我们的策略不需要系统动力学知识,本质上是基于在线学习的系统动力学知识,具有满足追逃博弈安全约束的能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Systems Man Cybernetics-Systems
IEEE Transactions on Systems Man Cybernetics-Systems AUTOMATION & CONTROL SYSTEMS-COMPUTER SCIENCE, CYBERNETICS
CiteScore
18.50
自引率
11.50%
发文量
812
审稿时长
6 months
期刊介绍: The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信