AutomaticaPub Date : 2024-11-20DOI: 10.1016/j.automatica.2024.111993
Yirui Cong , Xiangke Wang , Xiangyun Zhou
{"title":"Stability of linear set-membership filters with respect to initial conditions: An observation-information perspective","authors":"Yirui Cong , Xiangke Wang , Xiangyun Zhou","doi":"10.1016/j.automatica.2024.111993","DOIUrl":"10.1016/j.automatica.2024.111993","url":null,"abstract":"<div><div>The issue of filter stability with respect to (w.r.t.) the initial condition refers to the unreliable filtering process caused by improper prior information of the initial state. This paper focuses on analyzing and resolving the stability issue w.r.t. the initial condition of the classical Set-Membership Filters (SMFs) for linear time-invariant systems, which has not yet been well understood in the literature. To this end, we propose a new concept — the Observation-Information Tower (OIT), which describes how the measurements affect the estimate in a set-intersection manner without relying on the initial condition. The proposed OIT enables a rigorous stability analysis, a new SMFing framework, as well as an efficient filtering algorithm. Specifically, based on the OIT, explicit necessary and sufficient conditions for stability w.r.t. the initial condition are provided for the classical SMFing framework. Furthermore, the OIT inspires a stability-guaranteed SMFing framework, which fully handles the stability issue w.r.t. the initial condition. Finally, with the OIT-inspired framework, we develop a fast and stable constrained zonotopic SMF, which significantly overcomes the wrapping effect.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"172 ","pages":"Article 111993"},"PeriodicalIF":4.8,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142719599","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-11-20DOI: 10.1016/j.automatica.2024.111994
Hao Fu, Prashanth Krishnamurthy, Farshad Khorrami
{"title":"Combining switching mechanism with re-initialization and anomaly detection for resiliency of cyber–physical systems","authors":"Hao Fu, Prashanth Krishnamurthy, Farshad Khorrami","doi":"10.1016/j.automatica.2024.111994","DOIUrl":"10.1016/j.automatica.2024.111994","url":null,"abstract":"<div><div>Cyber–physical systems (CPS) play a pivotal role in numerous critical real-world applications that have stringent requirements for safety. To enhance the CPS resiliency against attacks, redundancy can be integrated in real-time controller implementations by designing strategies that switch among multiple controllers. However, existing switching strategies typically overlook remediation measures for compromised controllers, opting instead to simply exclude them. Such a solution reduces the CPS redundancy since only a subset of controllers are used. To address this gap, this work proposes a multi-controller switching strategy with periodic re-initialization to remove attacks. Controllers that finish re-initialization can be reused by the switching strategy, preserving the CPS redundancy and resiliency. The proposed switching strategy is designed to ensure that at each switching moment, a controller that has just completed re-initialization is available, minimizing the likelihood of compromise. Additionally, the controller’s working period decreases with the number of involved controllers, reducing the controller’s exposure time to attacks. An anomaly detector is used to detect CPS attacks during the controller’s working period. Upon alarm activation, the current control signal is set to a predefined value, and a switch to an alternative controller occurs at the earliest switching moment. Our switching strategy is shown to be still effective even if the anomaly detector fails to detect (stealthy) attacks. The efficacy of our strategy is analyzed through three derived conditions under a proposed integrated attack-defense model for mean-square boundedness of the CPS states. Simulation results on a third-order system and a single-machine infinite-bus (SMIB) system confirm that our approach significantly bolsters CPS resiliency by leveraging the advantages of re-initialization, anomaly detection, and switching mechanisms.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"172 ","pages":"Article 111994"},"PeriodicalIF":4.8,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142719597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-11-19DOI: 10.1016/j.automatica.2024.111987
Carrie Ann Weidner , Emily A. Reed , Jonathan Monroe , Benjamin Sheller , Sean O’Neil , Eliav Maas , Edmond A. Jonckheere , Frank C. Langbein , Sophie Schirmer
{"title":"Robust quantum control in closed and open systems: Theory and practice","authors":"Carrie Ann Weidner , Emily A. Reed , Jonathan Monroe , Benjamin Sheller , Sean O’Neil , Eliav Maas , Edmond A. Jonckheere , Frank C. Langbein , Sophie Schirmer","doi":"10.1016/j.automatica.2024.111987","DOIUrl":"10.1016/j.automatica.2024.111987","url":null,"abstract":"<div><div>Robust control of quantum systems is an increasingly relevant field of study amidst the second quantum revolution, but there remains a gap between taming quantum physics and robust control in its modern analytical form that culminated in fundamental performance bounds. With certain exceptions such as quantum optical systems that can be modeled as linear stochastic differential equations, quantum systems are not amenable to linear, time-invariant, measurement-based robust control techniques, and thus novel gap-bridging techniques must be developed. This survey is written for control theorists to provide a review of the current state of quantum control and outline the challenges faced in trying to apply modern robust control to quantum systems. We present issues that arise when applying classical robust control theory to quantum systems, typical methods used by quantum physicists to explore such systems and their robustness, as well as a discussion of open problems to be addressed in the field. We focus on general, practical applications and recent work to enable control researchers to contribute to advancing this burgeoning field.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"172 ","pages":"Article 111987"},"PeriodicalIF":4.8,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142719692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-30DOI: 10.1016/j.automatica.2024.111976
Panos Parpas, Corey Muir
{"title":"Predict globally, correct locally: Parallel-in-time optimization of neural networks","authors":"Panos Parpas, Corey Muir","doi":"10.1016/j.automatica.2024.111976","DOIUrl":"10.1016/j.automatica.2024.111976","url":null,"abstract":"<div><div>The training of neural networks can be formulated as an optimal control problem of a dynamical system. The initial conditions of the dynamical system are given by the data. The objective of the control problem is to transform the initial conditions in a form that can be easily classified or regressed using linear methods. This link between optimal control of dynamical systems and neural networks has proved beneficial both from a theoretical and from a practical point of view. Several researchers have exploited this link to investigate the stability of different neural network architectures and develop memory efficient training algorithms. In this paper, we also adopt the dynamical systems view of neural networks, but our aim is different from earlier works. Instead, we develop a novel distributed optimization algorithm. The proposed algorithm addresses the most significant obstacle for distributed algorithms for neural network optimization: the network weights cannot be updated until the forward propagation of the data, and backward propagation of the gradients are complete. Using the dynamical systems point of view, we interpret the layers of a (residual) neural network as the discretized dynamics of a dynamical system and exploit the relationship between the co-states (adjoints) of the optimal control problem and backpropagation. We then develop a parallel-in-time method that updates the parameters of the network without waiting for the forward or back propagation algorithms to complete in full. We establish the convergence of the proposed algorithm. Preliminary numerical results suggest that the algorithm is competitive and more efficient than the state-of-the-art.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111976"},"PeriodicalIF":4.8,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-28DOI: 10.1016/j.automatica.2024.111970
Sarah H.Q. Li , Assalé Adjé , Pierre-Loïc Garoche , Behçet Açıkmeşe
{"title":"Set-based value operators for non-stationary and uncertain Markov decision processes","authors":"Sarah H.Q. Li , Assalé Adjé , Pierre-Loïc Garoche , Behçet Açıkmeşe","doi":"10.1016/j.automatica.2024.111970","DOIUrl":"10.1016/j.automatica.2024.111970","url":null,"abstract":"<div><div>This paper analyzes finite-state Markov Decision Processes (MDPs) with nonstationary and uncertain parameters via set-based fixed point theory. Given compact parameter ambiguity sets, we demonstrate that a family of contraction operators, including the Bellman operator and the policy evaluation operator, can be extended to set-based contraction operators with a unique fixed point—a compact value function set. For non-stationary MDPs, we show that while the value function trajectory diverges, its Hausdorff distance from this fixed point converges to zero. In parameter uncertain MDPs, the fixed point’s extremum value functions are equivalent to the min–max value function in robust dynamic programming under the rectangularity condition. Furthermore, we show that the rectangularity condition is a sufficient condition for the fixed point to contain its own extremum value functions. Finally, we derive novel guarantees for probabilistic path planning in capricious wind fields and stratospheric station-keeping.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111970"},"PeriodicalIF":4.8,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142526131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-25DOI: 10.1016/j.automatica.2024.111977
Jared Town , Zachary Morrison , Rushikesh Kamalapurkar
{"title":"Nonuniqueness and convergence to equivalent solutions in observer-based inverse reinforcement learning","authors":"Jared Town , Zachary Morrison , Rushikesh Kamalapurkar","doi":"10.1016/j.automatica.2024.111977","DOIUrl":"10.1016/j.automatica.2024.111977","url":null,"abstract":"<div><div>A key challenge in solving the deterministic inverse reinforcement learning (IRL) problem online and in real-time is the existence of multiple solutions. Nonuniqueness necessitates the study of the notion of equivalent solutions, <em>i.e.</em>, solutions that result in a different cost functional but same feedback matrix. While <em>offline</em> algorithms that result in convergence to equivalent solutions have been developed in the literature, online, real-time techniques that address nonuniqueness are not available. In this paper, a regularized history stack observer that converges to approximately equivalent solutions of the IRL problem is developed. Novel data-richness conditions are developed to facilitate the analysis and simulation results are provided to demonstrate the effectiveness of the developed technique.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111977"},"PeriodicalIF":4.8,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142525967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-25DOI: 10.1016/j.automatica.2024.111919
Wenwu Fan, Junlin Xiong
{"title":"Successive over relaxation for model-free LQR control of discrete-time Markov jump systems","authors":"Wenwu Fan, Junlin Xiong","doi":"10.1016/j.automatica.2024.111919","DOIUrl":"10.1016/j.automatica.2024.111919","url":null,"abstract":"<div><div>This paper aims to solve the model-free linear quadratic regulator problem for discrete-time Markov jump linear systems without requiring an initial stabilizing control policy. We propose both model-based and model-free successive over relaxation algorithms to learn the optimal control policy of discrete-time Markov jump linear systems. The model-free value iteration algorithm is a special case of our model-free algorithm when the relaxation factor equals one. A sufficient condition on the relaxation factor is provided to guarantee the convergence of our algorithms. Moreover, it is proved that our model-free algorithm can obtain an approximate optimal solution when the transition probability matrix is unknown. Finally, a numerical example is used to illustrate our results.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111919"},"PeriodicalIF":4.8,"publicationDate":"2024-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142525966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-22DOI: 10.1016/j.automatica.2024.111947
Tian-Yu Zhang , Guang-Hong Yang , Dan Ye
{"title":"Asymmetrical vulnerability of heterogeneous multi-agent systems under false-data injection attacks","authors":"Tian-Yu Zhang , Guang-Hong Yang , Dan Ye","doi":"10.1016/j.automatica.2024.111947","DOIUrl":"10.1016/j.automatica.2024.111947","url":null,"abstract":"<div><div>This paper investigates the vulnerability of heterogeneous multi-agent systems (MASs) in face of perfect false-data injection (FDI) attacks that stealthily destabilize the synchronization processes of agents. In contrast to homogeneous dynamics, heterogeneous dynamics can be asymmetrically worsened by attackers, which is a greater challenge for MAS security. First of all, the existence conditions of perfect FDI attacks in different agents are established based on the spectral radius of heterogeneous system matrices. Then, it is proven that the attack targets against communication links are determined by the characteristic space of different agents. Since the attack properties including the attack existence and targets are different in each agent, heterogeneous MASs have the asymmetrical vulnerability under perfect FDI attacks. Finally, a sufficient condition and a necessary condition are obtained to achieve perfect FDI attacks with minimum attack targets. A numerical simulation of heterogeneous MASs is presented to demonstrate the effectiveness of perfect FDI attacks.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111947"},"PeriodicalIF":4.8,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142525968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-10-21DOI: 10.1016/j.automatica.2024.111946
Luis Ovalle , Andres Gonzalez , Leonid Fridman , Salah Laghrouche , Hussein Obeid
{"title":"Analysis of barrier function based adaptive sliding mode control in the presence of deterministic noise","authors":"Luis Ovalle , Andres Gonzalez , Leonid Fridman , Salah Laghrouche , Hussein Obeid","doi":"10.1016/j.automatica.2024.111946","DOIUrl":"10.1016/j.automatica.2024.111946","url":null,"abstract":"<div><div>Barrier function-based adaptive sliding mode control (BFASMC) is analyzed in presence of deterministic measurement noise. It is shown that, considering only boundedness of the measurement noise, it is impossible to select the controller parameters to track some perturbation with unknown bound. Nonetheless, under the assumption of continuity of the noise, the tracking of such a perturbation is possible; however, the barrier function width depends on the bound of the noise. If Lipschitz continuity of the noise is assumed, then it follows that the width of the barrier function can be chosen arbitrarily.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111946"},"PeriodicalIF":4.8,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142525969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Stabilization for fast sampling discrete-time singularly perturbed singular Markovian systems","authors":"Yingqi Zhang , Haoqi Liang , Yuanqing Xia , Jingjing Yan","doi":"10.1016/j.automatica.2024.111981","DOIUrl":"10.1016/j.automatica.2024.111981","url":null,"abstract":"<div><div>This paper considers the problems of stabilization and <span><math><msub><mrow><mi>H</mi></mrow><mrow><mi>∞</mi></mrow></msub></math></span> control for fast sampling discrete-time singularly perturbed singular Markovian systems (SPSMSs). The system equivalent approach is initially introduced to transform the discrete fast sampling SPSMS model into the augmented SPSMS for the convenience of designing system controller. Secondly, sufficient condition on stochastically mean square admissibility is established for the fast sampling SPSMS. By separating matrix variables and singularly perturbed parameter, a state feedback controller is also provided to ensure stochastically mean square admissibility of the fast sampling augmented SPSMS. Then, the results are extended to <span><math><msub><mrow><mi>H</mi></mrow><mrow><mi>∞</mi></mrow></msub></math></span> performance analysis and controller design in the presence of the external disturbances. The derived criteria can be converted to the feasible problems based on convex optimization, and the upper bound of singular perturbation parameter is also calculated. Besides, a discretized electrical circuit system is provided to verify the effectiveness and the superiority of the proposed approach.</div></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":"171 ","pages":"Article 111981"},"PeriodicalIF":4.8,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142526134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}