{"title":"Collaborative Safety-Critical Control in Coupled Networked Systems","authors":"Brooks A. Butler;Philip E. Paré","doi":"10.1109/OJCSYS.2025.3614070","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3614070","url":null,"abstract":"As modern systems become increasingly connected with complex dynamic coupling relationships, developing safe control methods for such interconnected systems becomes paramount. In this paper, we explore the relationship of node-level safety definitions for individual agents to local neighborhood dynamics. We define a collaborative control barrier function and provide conditions under which sets defined by these functions will be forward invariant. We use collaborative control barrier functions to construct a novel decentralized algorithm for the safe control of collaborating network agents and provide conditions under which the algorithm is guaranteed to return a viable set of safe control actions for all agents. We then illustrate these results on a networked susceptible-infected-susceptible (SIS) model.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"433-446"},"PeriodicalIF":0.0,"publicationDate":"2025-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11176994","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cautious Optimization via Data Informativity","authors":"Jaap Eising;Jorge Cortés","doi":"10.1109/OJCSYS.2025.3612784","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3612784","url":null,"abstract":"This paper deals with the problem of accurately determining guaranteed suboptimal values of an unknown cost function on the basis of noisy measurements. We consider a set-valued variant to regression where, instead of finding a best estimate of the cost function, we reason over all functions compatible with the measurements and apply robust methods explicitly in terms of the data. Our treatment provides data-based conditions under which closed-form expressions of upper bounds of the unknown function can be obtained, and regularity properties like convexity and Lipschitzness can be established. These results allow us to perform point- and set-wise verification of suboptimality, and tackle the cautious optimization of the unknown function in both one-shot and online scenarios. We showcase the versatility of the proposed methods in two control-relevant problems: data-driven contraction analysis of unknown nonlinear systems and suboptimal regulation with unknown dynamics and cost. Simulations illustrate our results.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"400-417"},"PeriodicalIF":0.0,"publicationDate":"2025-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11175185","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145351997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Prajakta Surve;Shaunak D. Bopardikar;Alexander Von Moll;Isaac Weintraub;David W. Casbeer
{"title":"Mutual Support by Sensor-Attacker Team for a Passive Target","authors":"Prajakta Surve;Shaunak D. Bopardikar;Alexander Von Moll;Isaac Weintraub;David W. Casbeer","doi":"10.1109/OJCSYS.2025.3612246","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3612246","url":null,"abstract":"We introduce a pursuit game played between a team of a sensor and an attacker and a mobile target in the unbounded Euclidean plane. The target is faster than the sensor, but slower than the attacker. The sensor’s objective is to keep the target within a sensing radius so that the attacker can capture the target, whereas the target seeks to escape by reaching beyond the sensing radius from the sensor without getting captured by the attacker. We assume that as long as the target is within the sensing radius from the sensor, the sensor-attacker team is able to measure the target’s instantaneous position and velocity. We pose and solve this problem as a <italic>Game of Kind</i> in which the target uses an open-loop strategy (passive target). Aside from the novel formulation, our contributions are four-fold. First, we present optimal strategies for both the sensor and the attacker, according to their respective objectives. Specifically, we design a sensor strategy that maximizes the duration for which the target remains within its sensing range, while the attacker uses proportional navigation to capture the target. Second, we characterize the <italic>sensable region</i> – the region in the plane in which the target remains within the sensing radius of the sensor during the game – and show that capture is guaranteed if and only if the Apollonius circle between the attacker and the target is fully contained within this region. Third, we derive a lower bound on the target’s speed below which capture is guaranteed, and an upper bound on the target speed above which there exists an escape strategy for the target, from an arbitrary initial orientation between the agents. Fourth, for a given initial orientation between the agents, we present a sharper upper bound on the target speed above which there exists an escape strategy for the target.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"418-432"},"PeriodicalIF":0.0,"publicationDate":"2025-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11173712","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shuo Liu;Zhe Huang;Jun Zeng;Koushil Sreenath;Calin A. Belta
{"title":"Learning-Enabled Iterative Convex Optimization for Safety-Critical Model Predictive Control","authors":"Shuo Liu;Zhe Huang;Jun Zeng;Koushil Sreenath;Calin A. Belta","doi":"10.1109/OJCSYS.2025.3612245","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3612245","url":null,"abstract":"Safety remains a central challenge in control of dynamical systems, particularly when the boundaries of unsafe sets are complex (e.g., nonconvex, nonsmooth) or unknown. This paper proposes a learning-enabled framework for safety-critical Model Predictive Control (MPC) that integrates Discrete-Time High-Order Control Barrier Functions (DHOCBFs) with iterative convex optimization. Unlike existing methods that primarily address CBFs of relative degree one with fully known unsafe set boundaries, our approach generalizes to arbitrary relative degrees and addresses scenarios where only samples are available for the unsafe set boundaries. We extract pixels from unsafe set boundaries and train a neural network to approximate local linearizations. The learned models are incorporated into the linearized DHOCBF constraints at each time step within the MPC framework. An iterative convex optimization procedure is developed to accelerate computation while maintaining formal safety guarantees. The benefits of computational performance and safe avoidance of obstacles with diverse shapes are examined and confirmed through numerical results. By bridging model-based control with learning-based environment modeling, this framework advances safe autonomy for discrete-time systems operating in complex and partially known settings.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"482-500"},"PeriodicalIF":0.0,"publicationDate":"2025-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11174009","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Compositional Shield Synthesis for Safe Reinforcement Learning in Partial Observability","authors":"Steven Carr;Georgios Bakirtzis;Ufuk Topcu","doi":"10.1109/OJCSYS.2025.3611725","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3611725","url":null,"abstract":"Agents controlled by the output of reinforcement learning (RL) algorithms often transition to unsafe states, particularly in uncertain and partially observable environments. Partially observable Markov decision processes (POMDPs) provide a natural setting for studying such scenarios with limited sensing. <italic>Shields</i> filter undesirable actions to ensure safe RL by preserving safety requirements in the agents’ policy. However, synthesizing holistic shields is computationally expensive in complex deployment scenarios. We propose the <italic>compositional</i> synthesis of shields by modeling safety requirements by parts, thereby improving scalability. In particular, problem formulations in the form of POMDPs using RL algorithms illustrate that an RL agent equipped with the resulting compositional shielding, beyond being safe, converges to higher values of expected reward. By using subproblem formulations, we preserve and improve the ability of shielded agents to require fewer training episodes than unshielded agents, especially in sparse-reward settings. Concretely, we find that compositional shield synthesis allows an RL agent to remain safe in environments two orders of magnitude larger than other state-of-the-art model-based approaches.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"373-384"},"PeriodicalIF":0.0,"publicationDate":"2025-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11172329","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daigo Shishika;Alexander Von Moll;Dipankar Maity;Michael Dorothy
{"title":"Deception in Turret Defense Game: Information Limiting Strategy to Induce Dilemma","authors":"Daigo Shishika;Alexander Von Moll;Dipankar Maity;Michael Dorothy","doi":"10.1109/OJCSYS.2025.3611726","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3611726","url":null,"abstract":"Can deception exist in differential games? We provide a case study for a Turret-Attacker differential game, where two Attackers seek to score points by reaching a target region while a Turret tries to minimize the score by aligning itself with the Attackers before they reach the target. In contrast to the original problem solved with complete information, we assume that the Turret only has partial information about the maximum speed of the Attackers. We investigate whether there is any incentive for the Attackers to move slower than their maximum speed in order to “deceive” the Turret into taking suboptimal actions. We first describe the existence of a dilemma that the Turret may face. Then we derive a set of initial conditions from which the Attackers can force the Turret into a situation where it must take a guess.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"385-399"},"PeriodicalIF":0.0,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11169496","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Representation of Piecewise Quadratic Functions by Neural Networks","authors":"Dieter Teichrib;Moritz Schulze Darup","doi":"10.1109/OJCSYS.2025.3607844","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3607844","url":null,"abstract":"Neural networks (NNs) are commonly used to approximate functions based on data samples, as they are a universal function approximator for a large class of functions. However, choosing a suitable topology in terms of depth, width and activation function for NNs that allow for low error approximations is a non-trivial task. For the approximation of continuous piecewise affine (PWA) functions, this task has been solved by showing that for every PWA function, there exist NNs with rectified linear unit (relu) and maxout activation that allow an exact representation of the PWA function. This connection between PWA functions and NNs has led to some valuable insights into the representation capabilities of NNs. Moreover, the connection was used in control for approximating the PWA optimal control law of model predictive control (MPC) for linear systems. We show that a similar connection exists between NNs and continuous piecewise quadratic (PWQ) functions by deriving topologies for NNs that allow an exact representation of arbitrary PWQ functions with a polyhedral domain partition. Furthermore, we demonstrate that the proposed NNs can efficiently approximate the PWQ optimal value function for linear MPC.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"447-462"},"PeriodicalIF":0.0,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11153811","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145352169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tim Walter;Hannah Markgraf;Jonathan Külz;Matthias Althoff
{"title":"Leveraging Analytic Gradients in Provably Safe Reinforcement Learning","authors":"Tim Walter;Hannah Markgraf;Jonathan Külz;Matthias Althoff","doi":"10.1109/OJCSYS.2025.3607845","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3607845","url":null,"abstract":"The deployment of autonomous robots in safety-critical applications requires safety guarantees. Provably safe reinforcement learning is an active field of research that aims to provide such guarantees using safeguards. These safeguards should be integrated during training to reduce the sim-to-real gap. While there are several approaches for safeguarding sampling-based reinforcement learning, analytic gradient-based reinforcement learning often achieves superior performance from fewer environment interactions. However, there is no safeguarding approach for this learning paradigm yet. Our work addresses this gap by developing the first effective safeguard for analytic gradient-based reinforcement learning. We analyse existing, differentiable safeguards, adapt them through modified mappings and gradient formulations, and integrate them into a state-of-the-art learning algorithm and a differentiable simulation. Using numerical experiments on three control tasks, we evaluate how different safeguards affect learning. The results demonstrate safeguarded training without compromising performance. Additional visuals are provided at timwalter.github.io/safe-agb-rl.github.io.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"463-481"},"PeriodicalIF":0.0,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11154003","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145351918","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dejan Milutinović;Alexander Von Moll;Satyanarayana Gupta Manyam;David W. Casbeer;Isaac E. Weintraub;Meir Pachter
{"title":"Cooperative Pursuit-Evasion Games With a Flat Sphere Condition","authors":"Dejan Milutinović;Alexander Von Moll;Satyanarayana Gupta Manyam;David W. Casbeer;Isaac E. Weintraub;Meir Pachter","doi":"10.1109/OJCSYS.2025.3604640","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3604640","url":null,"abstract":"In planar pursuit-evasion differential games considering a faster pursuer and a slower evader, the interception points resulting from equilibrium strategies lie on the Apollonius circle. This property is instrumental for leveraging geometric approaches for solving multiple pursuit-evasion scenarios in the plane. In this paper, we study a pursuit-evasion differential game on a sphere and generalize the planar Apollonius circle to the spherical domain. For the differential game, we provide equilibrium strategies for all initial positions of the pursuer and evader, including a special case when they are on the opposite sides of the sphere and on the same line with the center of the sphere when there are infinitely many geodesics between the two players. In contrast to planar scenarios, on the sphere we find that the interception point from the equilibrium strategies can leave the Apollonius domain boundary. We present a condition to ensure the intercept point remains on the boundary of the Apollonius domain. This condition allows for generalizing planar pursuit-evasion strategies to the sphere, and we show how these results are applied by analyzing the scenarios of target guarding and two-pursuer, single evader differential games on the sphere.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"360-372"},"PeriodicalIF":0.0,"publicationDate":"2025-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11145945","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145141640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Moritz Wenzel;Edoardo De Din;Marcel Zimmer;Andrea Benigni
{"title":"Gaussian Process Supported Stochastic MPC for Distribution Grids","authors":"Moritz Wenzel;Edoardo De Din;Marcel Zimmer;Andrea Benigni","doi":"10.1109/OJCSYS.2025.3601836","DOIUrl":"https://doi.org/10.1109/OJCSYS.2025.3601836","url":null,"abstract":"The efficacy of control systems for distribution grids can be influenced by different sources of uncertainty. Stochastic Model Predictive Control (SMPC) can be employed to compensate for such uncertainties by integrating their probability distribution into the control problem. An efficient SMPC algorithm for online control applications is the stochastic tube SMPC, which is able to treat the evaluation of the chance constraints analytically. However, this approach is efficient only when the calculation of the constraint back-off is applied to a linear model. To address this issue, this work employs Gaussian Processes to approximate the nonlinear part of the power flow equations based on offline training, which is integrated into the SMPC formulation. The resulting SMPC is first validated and then tested on a benchmark system, comparing the results with Deterministic MPC and SMPC that excludes Gaussian Processes. The proposed SMPC proves to be more efficient in terms of cost minimization, reference tracking and voltage violationreduction.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"4 ","pages":"332-348"},"PeriodicalIF":0.0,"publicationDate":"2025-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11134570","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145027992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}