AutomaticaPub Date : 2024-09-13DOI: 10.1016/j.automatica.2024.111906
Le Yin , Wenjing Xie , Shiyuan Wang , Victor Sreeram
{"title":"Simultaneous input and state estimation: From a unified least-squares perspective","authors":"Le Yin , Wenjing Xie , Shiyuan Wang , Victor Sreeram","doi":"10.1016/j.automatica.2024.111906","DOIUrl":"10.1016/j.automatica.2024.111906","url":null,"abstract":"<div><p>This paper presents a unified least-squares approach to simultaneous input and state estimation (SISE) of discrete-time linear systems. Although input estimators for systems with and without direct feedthrough are generally designed in two different ways, i.e., one with and another without a delay, the proposed approach unifies the two cases using a receding horizon estimation strategy. Moreover, regularization terms representing input information are incorporated and discarded to accommodate the model-based and model-free scenarios, respectively. The present work first investigates the general case where prior input information is available for systems with direct feedthrough and addresses important issues including the existence, optimality and stability of the derived estimators. Then, the problem of whether and under what conditions the existing studies for different systems can be related together is investigated. By setting different design parameters, the proposed estimation framework includes important literature results as its special cases, making it possible to generalize the SISE problems in various contexts. Besides, unlike the previous studies that only considered recursive SISE formulations, the present study develops a batch SISE (BSISE) formulation that addresses the optimal filtering and smoothing problems cohesively. The present work provides a unified approach to input and state estimation where the availability of the input information ranges from exactly known to completely unknown and the systems may have either zero, non-full-rank or full-rank direct feedthrough. The optimization-based formulation and its Bayesian interpretation open a variety of possible extensions and inspire new developments.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S000510982400400X/pdfft?md5=b40f04f0fd092022bbf0099a495e3752&pid=1-s2.0-S000510982400400X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-13DOI: 10.1016/j.automatica.2024.111895
Jing Zhou , Jun Shang , Tongwen Chen
{"title":"On vulnerability of Kalman filtering with holistic estimation performance loss","authors":"Jing Zhou , Jun Shang , Tongwen Chen","doi":"10.1016/j.automatica.2024.111895","DOIUrl":"10.1016/j.automatica.2024.111895","url":null,"abstract":"<div><p>This article addresses the problem of optimal deception attacks against remote state estimation, where the measurement data is transmitted through an unreliable wireless channel. A malicious adversary can intercept and tamper with raw data to maximize estimation quality degradation and deceive <span><math><msup><mrow><mi>χ</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span> detectors. In contrast to prior studies that concentrate on greedy attack performance, we consider a more general scenario where attackers aim to maximize the sum of estimation errors within a fixed interval. It is demonstrated that the optimal attack policy, based on information-theoretic principles, is a linear combination of minimum mean-square error estimates of historical prediction errors. The combination coefficients are then obtained by solving a convex optimization problem. Furthermore, the proposed attack approach is extended to deceive multiple-step <span><math><msup><mrow><mi>χ</mi></mrow><mrow><mn>2</mn></mrow></msup></math></span> detectors of varying widths with strict/relaxed stealthiness by slightly adjusting some linear equality constraints. The effectiveness of the proposed approach is validated through numerical examples and comparative studies with existing methods.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003893/pdfft?md5=c632a5d58dc4f4ee7231f09e5214d947&pid=1-s2.0-S0005109824003893-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-13DOI: 10.1016/j.automatica.2024.111904
Jia-Qi Tang, Jun-Min Wang, Wen Kang
{"title":"Sampled-data control of an unstable cascaded heat–heat system with different reaction coefficients","authors":"Jia-Qi Tang, Jun-Min Wang, Wen Kang","doi":"10.1016/j.automatica.2024.111904","DOIUrl":"10.1016/j.automatica.2024.111904","url":null,"abstract":"<div><p>The present paper is devoted to sampled-data control design of a PDE–PDE cascade system. These PDEs are governed by heat equations with different reaction coefficients. In order to stabilize the cascaded heat–heat system, we start with the design of continuous-time feedback control law. Then sampled-data control is further proposed for practical reasons. Sufficient conditions are derived for guaranteeing the exponential stability and well-posedness of the corresponding closed-loop system via Lyapunov method and modal decomposition method. Numerical examples illustrate the efficiency of the proposed method.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003984/pdfft?md5=a6af6e82a9f7e4ff8686ad7ea72a32c5&pid=1-s2.0-S0005109824003984-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-13DOI: 10.1016/j.automatica.2024.111900
Gui-Hua Zhao , Shu-Jun Liu
{"title":"Decentralized adaptive finite-time stabilization for a class of non-local Lipschitzian large-scale stochastic nonlinear systems","authors":"Gui-Hua Zhao , Shu-Jun Liu","doi":"10.1016/j.automatica.2024.111900","DOIUrl":"10.1016/j.automatica.2024.111900","url":null,"abstract":"<div><p>In this paper, finite-time stabilization is investigated for a class of non-local Lipschitzian large-scale stochastic nonlinear systems with two types of uncertainties, including parametric uncertainties and uncertain interactions. First, we present a new stochastic finite-time stability theorem on stochastic adaptive finite-time control, by which we obtain an existing finite-time stability result for the interconnected stochastic nonlinear systems. Then, for a class of large-scale stochastic nonlinear systems with uncertainties, an adaptive finite-time controller is constructively designed. It is proved by the developed finite-time stability theorem that there exists a global weak solution to the closed-loop system, the trivial weak solution of the closed-loop system is globally stable in probability and the states of the system almost surely converge to the origin in finite time. At last, a simulation example is given to show the effectiveness of the proposed design procedure.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003947/pdfft?md5=c08ad9bc9d7925af5944832ba398b624&pid=1-s2.0-S0005109824003947-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111902
Leontine Aarnoudse , Alexey Pavlov , Tom Oomen
{"title":"Nonlinear iterative learning control for discriminating between disturbances","authors":"Leontine Aarnoudse , Alexey Pavlov , Tom Oomen","doi":"10.1016/j.automatica.2024.111902","DOIUrl":"10.1016/j.automatica.2024.111902","url":null,"abstract":"<div><p>Disturbances in iterative learning control (ILC) may be amplified if these vary from one iteration to the next, and reducing this amplification typically reduces the convergence speed. The aim of this paper is to resolve this trade-off and achieve fast convergence, robustness and small converged errors in ILC. A nonlinear learning approach is presented that uses the difference in amplitude characteristics of repeating and varying disturbances to adapt the learning gain. Monotonic convergence of the nonlinear ILC algorithm is established, resulting in a systematic design procedure. Application of the proposed algorithm demonstrates both fast convergence and small errors.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003960/pdfft?md5=b42bdfad4b4e5f22cd3879db048cba9e&pid=1-s2.0-S0005109824003960-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111885
Yuxin Wu, Deyuan Meng
{"title":"Data informativity for tracking control of learning systems: Test and design conditions","authors":"Yuxin Wu, Deyuan Meng","doi":"10.1016/j.automatica.2024.111885","DOIUrl":"10.1016/j.automatica.2024.111885","url":null,"abstract":"<div><p>How to develop control design methods directly based on the input and output data, instead of utilizing the system model, becomes a practically important topic in the control community. This paper explores the data informativity for the data-based control design methods, with a special focus on accomplishing the tracking objective for iterative learning control (ILC) systems. With the data collected under a certain test framework for ILC systems, a necessary and sufficient condition on the data informativity is provided for trackability of the desired reference, which is a premise for the realization of the perfect tracking objective. Based on the informative data for trackability, three classes of data-based ILC updating laws are designed to reach the perfect tracking objective for a group of ILC systems compatible with the informative data. Moreover, the data informativity for <span><math><mi>δ</mi></math></span>-trackability of the desired reference is discussed with the focus on the more general <span><math><mi>δ</mi></math></span>-tracking objective, under which a data-based ILC updating law is presented by only resorting to the informative data for <span><math><mi>δ</mi></math></span>-trackability. In addition, for ILC systems with noises, the collected noisy data are leveraged to further exploit an ILC updating law to achieve the robust tracking objective. All the developed data-based ILC updating laws are applicable for any linear ILC system despite whether it is irregular or not, where the specific system model is not required.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003790/pdfft?md5=1cf1f278bc9040a4af566f4a3cb5ef02&pid=1-s2.0-S0005109824003790-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111886
Xiongtao Shi , Yanjie Li , Chenglong Du , Chaoyang Chen , Guangdeng Zong , Weihua Gui
{"title":"Reinforcement learning-based optimal control for Markov jump systems with completely unknown dynamics","authors":"Xiongtao Shi , Yanjie Li , Chenglong Du , Chaoyang Chen , Guangdeng Zong , Weihua Gui","doi":"10.1016/j.automatica.2024.111886","DOIUrl":"10.1016/j.automatica.2024.111886","url":null,"abstract":"<div><p>In this paper, the optimal control problem of a class of unknown Markov jump systems (MJSs) is investigated via the parallel policy iteration-based reinforcement learning (PPI-RL) algorithms. First, by solving the linear parallel Lyapunov equation, a model-based PPI-RL algorithm is studied to learn the solution of nonlinear coupled algebraic Riccati equation (CARE) of MJSs with known dynamics, thereby updating the optimal control gain. Then, a novel partially model-free PPI-RL algorithm is proposed for the scenario that the dynamics of the MJS is partially unknown, in which the optimal solution of CARE is learned via the mixed input–output data of all modes. Furthermore, for the MJS with completely unknown dynamics, a completely model-free PPI-RL algorithm is developed to get the optimal control gain by removing the dependence of model information in the process of solving the optimal solution of CARE. It is proved that the proposed PPI-RL algorithms converge to the unique optimal solution of CARE for MJSs with known, partially unknown, and completely unknown dynamics, respectively. Finally, simulation results are illustrated to show the feasibility and effectiveness of the PPI-RL algorithms.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003807/pdfft?md5=884f0aad8f5e53b8556ad35ca7c525f6&pid=1-s2.0-S0005109824003807-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111893
Yongyuan Yu , Renren Zhang
{"title":"Controllability and Pareto improvability on Nash equilibriums in game-based control systems","authors":"Yongyuan Yu , Renren Zhang","doi":"10.1016/j.automatica.2024.111893","DOIUrl":"10.1016/j.automatica.2024.111893","url":null,"abstract":"<div><p>To investigate objects driven by external input and players’ interests, the game-based control system (GBCS) was established. In this system, the high-level leader does not participate directly but regulates the low-level game to make followers’ Nash equilibrium(NE) “better”. This article focuses on a specific type of GBCSs with rational players, where the open-loop NE is unique under any given initial state and macro-regulation. We discuss two kinds of regulations on NEs: achieving reachability among NEs through macro-regulation and Pareto improvability on NEs that can benefit at least one follower without harming anyone else. These regulations help reduce the widespread inconsistency between individual and collective rationality. Moreover, conditions are provided to determine controllability and Pareto improvability on NEs. Finally, an example on opinion dynamics is presented to demonstrate the effectiveness of obtained theoretical results.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S000510982400387X/pdfft?md5=cef51a4d64d7ae2b1e84f254902d78bc&pid=1-s2.0-S000510982400387X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111881
Agustín G. Yabo
{"title":"Optimal control strategies in a generic class of bacterial growth models with multiple substrates","authors":"Agustín G. Yabo","doi":"10.1016/j.automatica.2024.111881","DOIUrl":"10.1016/j.automatica.2024.111881","url":null,"abstract":"<div><p>Optimal control strategies are studied through the application of the Pontryagin’s Maximum Principle for a class of non-linear differential systems that are commonly used to describe resource allocation during bacterial growth. The approach is inspired by the optimality of numerous regulatory mechanisms in bacterial cells. In this context, we aim to predict natural feedback loops as optimal control solutions so as to gain insight on the behavior of microorganisms from a control-theoretical perspective. The problem is posed in terms of a control function <span><math><mrow><msub><mrow><mi>u</mi></mrow><mrow><mn>0</mn></mrow></msub><mrow><mo>(</mo><mi>t</mi><mo>)</mo></mrow></mrow></math></span> representing the fraction of the cell dedicated to protein synthesis, and <span><math><mi>n</mi></math></span> additional controls <span><math><mrow><msub><mrow><mi>u</mi></mrow><mrow><mi>i</mi></mrow></msub><mrow><mo>(</mo><mi>t</mi><mo>)</mo></mrow></mrow></math></span> modeling the fraction of the cell responsible for the consumption of the available nutrient sources in the medium. By studying the necessary conditions for optimality, it is possible to prove that the solutions follow a bang–singular–bang structure, and that they are characterized by a sequential uptake pattern known as diauxic growth, which prioritizes the consumption of richer substrates over poor nutrients. Numerical simulations obtained through an optimal control solver confirm the theoretical results. Finally, we provide an application to batch cultivation of E. coli growing on glucose and lactose. For that, we propose a state feedback law that is based on the optimal control, and we calibrate the obtained closed-loop model to experimental data.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003753/pdfft?md5=4b5a18dc60bfd905fc283f6a25f01d94&pid=1-s2.0-S0005109824003753-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
AutomaticaPub Date : 2024-09-07DOI: 10.1016/j.automatica.2024.111897
Yibo Wang, Keyou You, Dexian Huang, Chao Shang
{"title":"Data-driven output prediction and control of stochastic systems: An innovation-based approach","authors":"Yibo Wang, Keyou You, Dexian Huang, Chao Shang","doi":"10.1016/j.automatica.2024.111897","DOIUrl":"10.1016/j.automatica.2024.111897","url":null,"abstract":"<div><p>Recent years have witnessed a booming interest in data-driven control of dynamical systems. However, the implicit data-driven output predictors are vulnerable to uncertainty such as process disturbance and measurement noise, causing unreliable predictions and unexpected control actions. In this brief, we put forward a new data-driven approach to output prediction of stochastic linear time-invariant (LTI) systems. By utilizing the innovation form, the uncertainty in stochastic LTI systems is recast as innovations that can be readily estimated from input–output data without knowing system matrices. In this way, by applying the fundamental lemma to the innovation form, we propose a new innovation-based data-driven output predictor (OP) of stochastic LTI systems, which bypasses the need for identifying state–space matrices explicitly and building a state estimator. The boundedness of the second moment of prediction errors in closed-loop is established under mild conditions. The proposed data-driven OP can be integrated into optimal control design for better performance. Numerical simulations demonstrate the outperformance of the proposed innovation-based methods in output prediction and control design over existing formulations.</p></div>","PeriodicalId":55413,"journal":{"name":"Automatica","volume":null,"pages":null},"PeriodicalIF":4.8,"publicationDate":"2024-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0005109824003911/pdfft?md5=d01ded28d040db1c663391881e4966c0&pid=1-s2.0-S0005109824003911-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}