{"title":"Real Time Li-Ion Battery Bank Parameters Estimation via Universal Adaptive Stabilization","authors":"Shayok Mukhopadhyay;Hafiz M. Usman;Habibur Rehman","doi":"10.1109/OJCSYS.2022.3206710","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3206710","url":null,"abstract":"This paper proposes an accurate and efficient Universal Adaptive Stabilizer (UAS) based online parameters estimation technique for a 400 V Li-ion battery bank. The battery open circuit voltage, parameters modeling the transient response, and series resistance are all estimated in a single real-time test. In contrast to earlier UAS based work on individual battery packs, this work does not require prior offline experimentation or any post-processing. Real time fast convergence of parameters' estimates with minimal experimental effort enables update of battery parameters during run-time. The proposed strategy is mathematically validated and its performance is demonstrated on a 400 V, 6.6 Ah Li-ion battery bank powering an induction motor driven prototype electric vehicle (EV) traction system.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"268-293"},"PeriodicalIF":0.0,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09893763.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50348786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yu Wang;Hussein Sibai;Mark Yen;Sayan Mitra;Geir E. Dullerud
{"title":"Differentially Private Algorithms for Statistical Verification of Cyber-Physical Systems","authors":"Yu Wang;Hussein Sibai;Mark Yen;Sayan Mitra;Geir E. Dullerud","doi":"10.1109/OJCSYS.2022.3207108","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3207108","url":null,"abstract":"Statistical model checking is a class of sequential algorithms that can verify specifications of interest on an ensemble of cyber-physical systems (e.g., whether 99% of cars from a batch meet a requirement on their functionality). These algorithms infer the probability that given specifications are satisfied by the systems with provable statistical guarantees by drawing sufficient numbers of independent and identically distributed samples. During the process of statistical model checking, the values of the samples (e.g., a user's car trajectory) may be inferred by intruders, causing privacy concerns in consumer-level applications (e.g., automobiles and medical devices). This paper addresses the privacy of statistical model checking algorithms from the point of view of differential privacy. These algorithms are sequential, drawing samples until a condition on their values is met. We show that revealing the number of samples drawn can violate privacy. We also show that the standard exponential mechanism that randomizes the output of an algorithm to achieve differential privacy fails to do so in the context of sequential algorithms. Instead, we relax the conservative requirement in differential privacy that the sensitivity of the output of the algorithm should be bounded to any perturbation for any data set. We propose a new notion of differential privacy which we call \u0000<italic>expected differential privacy</i>\u0000 (EDP). Then, we propose a novel expected sensitivity analysis for the sequential algorithm and propose a corresponding exponential mechanism that randomizes the termination time to achieve the EDP. We apply the proposed exponential mechanism to statistical model checking algorithms to preserve the privacy of the samples they draw. The utility of the proposed algorithm is demonstrated in a case study.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"294-305"},"PeriodicalIF":0.0,"publicationDate":"2022-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09893303.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50381126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Online Optimization of Dynamical Systems With Deep Learning Perception","authors":"Liliaokeawawa Cothren;Gianluca Bianchin;Emiliano Dall'Anese","doi":"10.1109/OJCSYS.2022.3205871","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3205871","url":null,"abstract":"This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or only partially known. In particular, we focus on the design of data-driven controllers to regulate a dynamical system to the solution of a constrained convex optimization problem where: i) the state must be estimated from nonlinear and possibly high-dimensional data; and ii) the cost of the optimization problem – which models control objectives associated with inputs and states of the system – is not available and must be learned from data. We propose a data-driven feedback controller that is based on adaptations of a projected gradient-flow method; the controller includes neural networks as integral components for the estimation of the unknown functions. Leveraging stability theory for perturbed systems, we derive sufficient conditions to guarantee exponential input-to-state stability (ISS) of the control loop. In particular, we show that the interconnected system is ISS with respect to the approximation errors of the neural network and unknown disturbances affecting the system. The transient bounds combine the universal approximation property of deep neural networks with the ISS characterization. Illustrative numerical results are presented in the context of robotics and control of epidemics.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"306-321"},"PeriodicalIF":0.0,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09891838.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50348787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Neural Network Optimal Feedback Control With Guaranteed Local Stability","authors":"Tenavi Nakamura-Zimmerer;Qi Gong;Wei Kang","doi":"10.1109/OJCSYS.2022.3205863","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3205863","url":null,"abstract":"Recent research shows that supervised learning can be an effective tool for designing near-optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of neural network controllers is still not well understood. In particular, some neural networks with high test accuracy can fail to even locally stabilize the dynamic system. To address this challenge we propose several novel neural network architectures, which we show guarantee local asymptotic stability while retaining the approximation capacity to learn the optimal feedback policy semi-globally. The proposed architectures are compared against standard neural network feedback controllers through numerical simulations of two high-dimensional nonlinear optimal control problems: stabilization of an unstable Burgers-type partial differential equation, and altitude and course tracking for an unmanned aerial vehicle. The simulations demonstrate that standard neural networks can fail to stabilize the dynamics even when trained well, while the proposed architectures are always at least locally stabilizing and can achieve near-optimal performance.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"210-222"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09887885.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50348954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Efficient Learning of Hyperrectangular Invariant Sets Using Gaussian Processes","authors":"Michael Enqi Cao;Matthieu Bloch;Samuel Coogan","doi":"10.1109/OJCSYS.2022.3206083","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3206083","url":null,"abstract":"We present a method for efficiently computing reachable sets and forward invariant sets for continuous-time systems with dynamics that include unknown components. Our main assumption is that, given any hyperrectangle of states, lower and upper bounds for the unknown components are available. With this assumption, the theory of mixed monotone systems allows us to formulate an efficient method for computing a hyperrectangular set that over-approximates the reachable set of the system. We then show a related approach that leads to sufficient conditions for identifying hyperrectangular sets that are forward invariant for the dynamics. We additionally show that set estimates tighten as the bounds on the unknown behavior tighten. Finally, we derive a method for satisfying our main assumption by modeling the unknown components as state-dependent Gaussian processes, providing bounds that are correct with high probability. A key benefit of our approach is to enable tractable computations for systems up to moderately high dimension that are subject to low dimensional uncertainty modeled as Gaussian processes, a class of systems that often appears in practice. We demonstrate our results on several examples, including a case study of a planar multirotor aerial vehicle.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"223-236"},"PeriodicalIF":0.0,"publicationDate":"2022-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09888053.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50381124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Finite Sample Identification of Low-Order LTI Systems via Nuclear Norm Regularization","authors":"Yue Sun;Samet Oymak;Maryam Fazel","doi":"10.1109/OJCSYS.2022.3200015","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3200015","url":null,"abstract":"This paper studies the problem of identifying low-order linear time-invariant systems via Hankel nuclear norm (HNN) regularization. This regularization encourages the Hankel matrix to be low-rank, which corresponds to the dynamical system being of low order. We provide novel statistical analysis for this regularization, and contrast it with the unregularized ordinary least-squares (OLS) estimator. Our analysis leads to new finite-sample error bounds on estimating the impulse response and the Hankel matrix associated with the linear system using HNN regularization. We design a suitable input excitation, and show that we can recover the system using a number of observations that scales optimally with the true system order and achieves strong statistical estimation rates. Complementing these, we also demonstrate that the input design indeed matters by proving that intuitive choices, such as i.i.d. Gaussian input, lead to sub-optimal sample complexity. To better understand the benefits of regularization, we also revisit the OLS estimator. Besides refining existing bounds, we experimentally identify when HNN regularization improves over OLS: (1) For low-order systems with slow impulse-response decay, OLS method performs poorly in terms of sample complexity, (2) the Hankel matrix returned by regularization has a more clear singular value gap that makes determining the system order easier, (3) HNN regularization is less sensitive to hyperparameter choice. To choose the regularization parameter, we also outline a simple joint train-validation procedure.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"237-254"},"PeriodicalIF":0.0,"publicationDate":"2022-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09870857.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50381125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Sherrit, M. Badescu, John B. Steeves, William E. Krieger, Clifford A. Klein, Otto R. Polanco, C. Weisberg, D. Van Buren, J. Sauvageau, K. Coste
{"title":"Characterization of Multilayer Piezoelectric Stacks Down to 100K","authors":"S. Sherrit, M. Badescu, John B. Steeves, William E. Krieger, Clifford A. Klein, Otto R. Polanco, C. Weisberg, D. Van Buren, J. Sauvageau, K. Coste","doi":"10.1117/12.2634962","DOIUrl":"https://doi.org/10.1117/12.2634962","url":null,"abstract":"A variety of applications require precision control at cryogenic temperatures. The next-generation of telescopes are looking to increase apertures in space telescopes and observations in the mid through far infrared regions enabling new science ranging from exoplanet characterization to precision astronomical observations to further refine astrophysics models. Concepts include segmented telescopes which are capable of observations in UV through IR bands, thus driving the need for UV surface performance at cryogenic temperatures. These telescope’s segments will require actuators for controlled surface displacements capable of operation at cryogenic temperatures ( $le 150text{K}$ ). The work reported in this paper is directed at understanding piezoelectric stack actuator operation down to cryogenic temperatures (100 K) which will provide actuator designers the needed information to model and predict performance. The data reported down to 100 K includes; resonance data, displacement voltage (S vs E) and capacitor voltage (D vs E) curves, stiffness, hysteresis, blocking force, DC resistance measurements, thermal strains and the coefficients of thermal expansion as a function of the electrical boundary conditions. Open-loop control drive strategies and errors are also reported. We apply this data to a surface parallel actuator mirror design.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"2 1","pages":"65-82"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47036631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Stable Reinforcement Learning for Optimal Frequency Control: A Distributed Averaging-Based Integral Approach","authors":"Yan Jiang;Wenqi Cui;Baosen Zhang;Jorge Cortés","doi":"10.1109/OJCSYS.2022.3202202","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3202202","url":null,"abstract":"Frequency control plays a pivotal role in reliable power system operations. It is conventionally performed in a hierarchical way that first rapidly stabilizes the frequency deviations and then slowly recovers the nominal frequency. However, as the generation mix shifts from synchronous generators to renewable resources, power systems experience larger and faster frequency fluctuations due to the loss of inertia, which adversely impacts the frequency stability. This has motivated active research in algorithms that jointly address frequency degradation and economic efficiency in a fast timescale, among which the distributed averaging-based integral (DAI) control is a notable one that sets controllable power injections directly proportional to the integrals of frequency deviation and economic inefficiency signals. Nevertheless, DAI does not typically consider the transient performance of the system following power disturbances and has been restricted to quadratic operational cost functions. This paper aims to leverage nonlinear optimal controllers to simultaneously achieve optimal transient frequency control and find the most economic power dispatch for frequency restoration. To this end, we integrate reinforcement learning (RL) to the classic DAI, which results in RL-DAI control. Specifically, we use RL to learn a neural network-based control policy mapping from the integral variables of DAI to the controllable power injections which provides optimal transient frequency control, while DAI inherently ensures the frequency restoration and optimal economic dispatch. Compared to existing methods, we provide provable guarantees on the stability of the learned controllers and extend the set of allowable cost functions to a much larger class. Simulations on the 39-bus New England system illustrate our results.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"194-209"},"PeriodicalIF":0.0,"publicationDate":"2022-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09869334.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50255798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust and Safe Autonomous Navigation for Systems With Learned SE(3) Hamiltonian Dynamics","authors":"Zhichao Li;Thai Duong;Nikolay Atanasov","doi":"10.1109/OJCSYS.2022.3201554","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3201554","url":null,"abstract":"Stability and safety are critical properties for successful deployment of automatic control systems. As a motivating example, consider autonomous mobile robot navigation in a complex environment. A control design that generalizes to different operational conditions requires a model of the system dynamics, robustness to modeling errors, and satisfaction of safety constraints, such as collision avoidance. This paper develops a neural ordinary differential equation network to learn the dynamics of a Hamiltonian system from trajectory data. The learned Hamiltonian model is used to synthesize an energy-shaping passivity-based controller and analyze its \u0000<italic>robustness</i>\u0000 to uncertainty in the learned model and its \u0000<italic>safety</i>\u0000 with respect to constraints imposed by the environment. Given a desired reference path for the system, we extend our design using a virtual reference governor to achieve tracking control. The governor state serves as a regulation point that moves along the reference path adaptively, balancing the system energy level, model uncertainty bounds, and distance to safety violation to guarantee robustness and safety. Our Hamiltonian dynamics learning and tracking control techniques are demonstrated on simulated hexarotor and quadrotor robots navigating in cluttered 3D environments.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"164-179"},"PeriodicalIF":0.0,"publicationDate":"2022-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09866842.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50348953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Online Convex Optimization for Data-Driven Control of Dynamical Systems","authors":"Marko Nonhoff;Matthias A. Müller","doi":"10.1109/OJCSYS.2022.3200021","DOIUrl":"https://doi.org/10.1109/OJCSYS.2022.3200021","url":null,"abstract":"We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and time-varying cost functions. To this end, we make use of a single persistently exciting input-output sequence of the system and results from behavioral systems theory which enable it to handle unknown linear time-invariant systems. Moreover, we consider noisy output feedback instead of full state measurements and allow general economic cost functions. Our analysis of the closed loop reveals that the algorithm is able to achieve sublinear regret, where the measurement noise only adds an additional constant term to the regret upper bound. In order to do so, we derive a data-driven characterization of the steady-state manifold of an unknown system. Moreover, our algorithm is able to asymptotically exactly estimate the measurement noise. The effectiveness and applicational aspects of the proposed method are illustrated by means of a detailed simulation example in thermal control.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"1 ","pages":"180-193"},"PeriodicalIF":0.0,"publicationDate":"2022-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9683993/09863672.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50255797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}