{"title":"Safety-Aware Pursuit-Evasion Game Based on Control Barrier Function and Reinforcement Learning","authors":"Yupeng Jia;Xiran Cui;Yi Dong;Xiaoming Hu","doi":"10.1109/TSMC.2025.3546968","DOIUrl":null,"url":null,"abstract":"This article considers the pursuit-evasion game of two dynamic systems, which are subject to safety constraints, and in order to additionally guarantee the safety of the system, we propose safety-aware pursuit and escape strategies by combining control barrier function (CBF) and off-policy learning technique. Different from existing pursuit and evader strategies, a safeguarding control law is first designed based on CBF to prioritize the safety of pursuer’s and evader’s trajectories, and then bounded game strategies are proposed by elaborately designing a new cost function. We also provide the sufficient condition for the stability of the closed-loop system with the state denoted by position difference, under which, the pursuer is able to capture the evader. It is worth mentioning that our strategies do not require the knowledge of system dynamics, which are essentially online learning-based ones, featured with the ability of satisfying the safety constraints in the pursuit-evasion game.","PeriodicalId":48915,"journal":{"name":"IEEE Transactions on Systems Man Cybernetics-Systems","volume":"55 8","pages":"5440-5450"},"PeriodicalIF":8.7000,"publicationDate":"2025-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Systems Man Cybernetics-Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11029272/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
This article considers the pursuit-evasion game of two dynamic systems, which are subject to safety constraints, and in order to additionally guarantee the safety of the system, we propose safety-aware pursuit and escape strategies by combining control barrier function (CBF) and off-policy learning technique. Different from existing pursuit and evader strategies, a safeguarding control law is first designed based on CBF to prioritize the safety of pursuer’s and evader’s trajectories, and then bounded game strategies are proposed by elaborately designing a new cost function. We also provide the sufficient condition for the stability of the closed-loop system with the state denoted by position difference, under which, the pursuer is able to capture the evader. It is worth mentioning that our strategies do not require the knowledge of system dynamics, which are essentially online learning-based ones, featured with the ability of satisfying the safety constraints in the pursuit-evasion game.
期刊介绍:
The IEEE Transactions on Systems, Man, and Cybernetics: Systems encompasses the fields of systems engineering, covering issue formulation, analysis, and modeling throughout the systems engineering lifecycle phases. It addresses decision-making, issue interpretation, systems management, processes, and various methods such as optimization, modeling, and simulation in the development and deployment of large systems.