{"title":"Guarantees for data-driven control of nonlinear systems using semidefinite programming: A survey","authors":"Tim Martin , Thomas B. Schön , Frank Allgöwer","doi":"10.1016/j.arcontrol.2023.100911","DOIUrl":"10.1016/j.arcontrol.2023.100911","url":null,"abstract":"<div><p><span><span>This survey presents recent research on determining control-theoretic properties and designing controllers with rigorous guarantees using semidefinite programming and for nonlinear systems for which no mathematical models but measured trajectories are available. Data-driven control techniques have been developed to circumvent a time-consuming modelling by first principles and because of the increasing availability of data. Recently, this research field has gained increased attention by the application of Willems’ fundamental lemma, which provides a fertile ground for the development of data-driven control schemes with guarantees for linear time-invariant systems. While the fundamental lemma can be generalized to further system classes, there does not exist a comparable data-based system representation for nonlinear systems. At the same time, nonlinear systems constitute the majority of practical systems. Moreover, they include additional challenges such as data-based </span>surrogate models that prevent system analysis and </span>controller design<span> by convex optimization. Therefore, a variety of data-driven control approaches has been developed with different required prior insights into the system to ensure a guaranteed inference. In this survey, we will discuss developments in the context of data-driven control for nonlinear systems. In particular, we will focus on methods based on system representations providing guarantees from finite data, while the analysis and the controller design boil down to convex optimization problems<span> given as semidefinite programming. Thus, these approaches achieve reasonable advances compared to the state-of-the-art system analysis and controller design by models from system identification. Specifically, the paper covers system representations based on extensions of Willems’ fundamental lemma, set membership, kernel techniques, the Koopman operator, and feedback linearization.</span></span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100911"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135455293","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Handbook of linear data-driven predictive control: Theory, implementation and design","authors":"P.C.N. Verheijen, V. Breschi, M. Lazar","doi":"10.1016/j.arcontrol.2023.100914","DOIUrl":"10.1016/j.arcontrol.2023.100914","url":null,"abstract":"<div><p>Data-driven predictive control (DPC) has gained an increased interest as an alternative to model predictive control in recent years, since it requires less system knowledge for implementation and reliable data is commonly available in smart engineering systems. Several data-driven predictive control algorithms have been developed recently, which largely follow similar approaches, but with specific formulations and tuning parameters. This review aims to provide a structured and accessible guide on linear data-driven predictive control methods and practices for people in both academia and the industry seeking to approach and explore this field. To do so, we first discuss standard methods, such as subspace predictive control (SPC), and data-enabled predictive control (DeePC), but we also include newer hybrid approaches to DPC, such as <span><math><mi>γ</mi></math></span>–data-driven predictive control and generalized data-driven predictive control. For all presented data-driven predictive controllers we provide a detailed analysis regarding the underlying theory, implementation details and design guidelines, including an overview of methods to guarantee closed-loop stability and promising extensions towards handling nonlinear systems. The performance of the reviewed DPC approaches is compared via simulations on two benchmark examples from the literature, allowing us to provide a comprehensive overview of the different techniques in the presence of noisy data.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100914"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578823000780/pdfft?md5=6b2e8bdfe4a714ce8d0101396d9d6243&pid=1-s2.0-S1367578823000780-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135563271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Lyapunov stability tests for linear time-delay systems","authors":"Sabine Mondi'e, A. Egorov, M. A. Gómez","doi":"10.48550/arXiv.2207.12462","DOIUrl":"https://doi.org/10.48550/arXiv.2207.12462","url":null,"abstract":"An overview of stability conditions in terms of the Lyapunov matrix for time-delay systems is presented. The main results and proof are presented in details for the case of systems with multiple delays. The state of the art, ongoing research and potential extensions to other classes of delay systems are discussed.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"6 1","pages":"68-80"},"PeriodicalIF":9.4,"publicationDate":"2022-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88237882","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Linear quantum systems: a tutorial","authors":"Guofeng Zhang, Z. Dong","doi":"10.48550/arXiv.2205.04080","DOIUrl":"https://doi.org/10.48550/arXiv.2205.04080","url":null,"abstract":"The purpose of this tutorial is to give a brief introduction to linear quantum control systems. The mathematical model of linear quantum control systems is presented first, then some fundamental control-theoretic notions such as stability, controllability and observability are given, which are closely related to several important concepts in quantum information science such as decoherence-free subsystems, quantum nondemolition variables, and back-action evasion measurements. After that, quantum Gaussian states are introduced, in particular, an information-theoretic uncertainty relation is presented which often gives a better bound for mixed Gaussian states than the well-known Heisenberg uncertainty relation. The quantum Kalman filter is presented for quantum linear systems, which is the quantum analogy of the Kalman filter for classical (namely, non-quantum-mechanical) linear systems. The quantum Kalman canonical decomposition for quantum linear systems is recorded, and its application is illustrated by means of a recent experiment. As single- and multi-photon states are useful resources in quantum information technology, the response of quantum linear systems to these types of input is presented. Finally, coherent feedback control of quantum linear systems is briefly introduced, and a recent experiment is used to demonstrate the effectiveness of quantum linear systems and networks theory.","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"49 1","pages":"274-294"},"PeriodicalIF":9.4,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86791145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Special section on estimation and control of quantum systems","authors":"Ian R. Petersen, Daoyi Dong","doi":"10.1016/j.arcontrol.2022.10.001","DOIUrl":"10.1016/j.arcontrol.2022.10.001","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 241-242"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76791807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Special Section on Analysis and control design for neurodynamics","authors":"Sérgio Pequito, Erfan Nozari, Fabio Pasqualetti","doi":"10.1016/j.arcontrol.2022.09.007","DOIUrl":"10.1016/j.arcontrol.2022.09.007","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 324-326"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81845504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Quantum covariance and filtering","authors":"John E. Gough","doi":"10.1016/j.arcontrol.2022.05.003","DOIUrl":"10.1016/j.arcontrol.2022.05.003","url":null,"abstract":"<div><p>We give a tutorial exposition of the analogue of the filtering equation for quantum systems<span><span> focusing on the quantum probabilistic framework and developing the ideas from the classical theory. Quantum covariances and </span>conditional expectations on von Neumann algebras play an essential part in the presentation.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 262-273"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85633362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Control of cooperative manipulator-endowed systems under high-level tasks and uncertain dynamics","authors":"Christos K. Verginis , Dimos V. Dimarogonas","doi":"10.1016/j.arcontrol.2022.09.004","DOIUrl":"10.1016/j.arcontrol.2022.09.004","url":null,"abstract":"<div><p>This paper considers the problem of distributed motion- and task-planning of multi-agent and multi-agent-object systems under temporal-logic-based tasks and uncertain dynamics. We focus on manipulator-endowed robotic agents that can interact with their surroundings. We present first continuous control algorithms for multi-agent navigation and cooperative object manipulation that exhibit the following properties. First, they are distributed in the sense that each agent calculates its own control signal from local interaction with the other agents and the environment. Second, they guarantee safety properties in terms of inter-agent collision avoidance and obstacle avoidance. Third, they adapt on-the-fly to dynamic uncertainties and are robust to exogenous disturbances. The aforementioned algorithms allow the abstraction of the underlying system to a finite-state representation. Inspired by formal-verification techniques, we use such a representation to derive plans for the agents that satisfy the given temporal-logic tasks. Various simulation results and hardware experiments verify the efficiency of the proposed algorithms.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 219-240"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578822000980/pdfft?md5=49c495bc749b8e5fedb05c72da854f6e&pid=1-s2.0-S1367578822000980-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89804076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio
{"title":"Reinforcement learning in spacecraft control applications: Advances, prospects, and challenges","authors":"Massimo Tipaldi , Raffaele Iervolino , Paolo Roberto Massenio","doi":"10.1016/j.arcontrol.2022.07.004","DOIUrl":"10.1016/j.arcontrol.2022.07.004","url":null,"abstract":"<div><p>This paper presents and analyzes Reinforcement Learning (RL) based approaches to solve spacecraft control<span> problems. Different application fields are considered, e.g., guidance, navigation and control systems for spacecraft landing on celestial bodies, constellation orbital control, and maneuver planning in orbit transfers. It is discussed how RL solutions can address the emerging needs of designing spacecraft with highly autonomous on-board capabilities and implementing controllers (i.e., RL agents) robust to system uncertainties and adaptive to changing environments. For each application field, the RL framework core elements (e.g., the reward function, the RL algorithm and the environment model used for the RL agent training) are discussed with the aim of providing some guidelines in the formulation of spacecraft control problems via a RL framework. At the same time, the adoption of RL in real space projects is also analyzed. Different open points are identified and discussed, e.g., the availability of high-fidelity simulators for the RL agent training and the verification of RL-based solutions. This way, recommendations for future work are proposed with the aim of reducing the technological gap between the solutions proposed by the academic community and the needs/requirements of the space industry.</span></p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"54 ","pages":"Pages 1-23"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78437945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Synchronization and pinning control of stochastic coevolving networks","authors":"Fabio Della Rossa , Pietro De Lellis","doi":"10.1016/j.arcontrol.2022.04.005","DOIUrl":"10.1016/j.arcontrol.2022.04.005","url":null,"abstract":"<div><p>Network dynamical systems are often characterized by the interlaced evolution of the node and edge dynamics, which are driven by both deterministic and stochastic factors. This manuscript offers a general mathematical model of coevolving network, which associates a state variable to each node and edge in the network, and describes their evolution through coupled stochastic differential equations. We study the emergence of synchronization, be it spontaneous or induced by a pinning control action, and provide sufficient conditions for local and global convergence. We enable the use of the Master Stability Function approach for studying coevolving networks, thereby obtaining conditions for almost sure local exponential convergence, whereas global conditions are derived using a Lyapunov-based approach. The theoretical results are then leveraged to design synchronization and pinning control protocols in two select applications. In the first one, the edge dynamics are tailored to induce spontaneous synchronization, whereas in the second the pinning edges are activated/deactivated and their weights modulated to drive the network towards the pinner’s trajectory in a distributed fashion.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"53 ","pages":"Pages 147-160"},"PeriodicalIF":9.4,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"54182229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}