{"title":"Some big issues with small noise limits in Markov decision processes","authors":"Vivek S. Borkar","doi":"10.1016/j.sysconle.2024.105972","DOIUrl":"10.1016/j.sysconle.2024.105972","url":null,"abstract":"<div><div>Using the framework of Markov decision processes (equivalently, controlled Markov chains) as a test case, we point out some non-robustness issues that arise in small noise limits in stochastic control. This is used to motivate a novel formulation of multi-chain Markov decision processes.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105972"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Aperiodic sampled-data-based control for switched linear systems: An improved sampling-dependent event-triggered mechanism","authors":"Lijun Gao, Suo Yang","doi":"10.1016/j.sysconle.2024.105990","DOIUrl":"10.1016/j.sysconle.2024.105990","url":null,"abstract":"<div><div>This paper is contributing to designing a novel event-triggered control (ETC) policy for switched linear systems, where control systems obtain sampling information only at sampling instants. First, by allowing the length of any sampling interval to exceed the minimum DT of all system modes, an innovative aperiodic sampling programme is presented to avoid the high-frequency sampling. Then, based on the proposed aperiodic sampling method, three improvements are presented: (1) a novel aperiodic sampled-data-based event-triggered mechanism (ASETM) is developed, which is more flexible in scheduling communication resources than periodic sampled-data-based event-triggered mechanism (PSETM); (2) a multiple discontinuous Lyapunov function (MDLF) with adjustable sampling-dependent parameters is constructed, which covers the multiple Lyapunov function (MLF) as a special case and further increases the design flexibility; (3) the state-feedback controller gains and event-triggering parameters are sampling-dependent, which broadens the feasible solution range of matrix inequalities. It is shown that by choosing an appropriate aperiodic sampling intervals sequence and sampling-dependent parameters, a tighter bound on the mode-dependent average dwell time (MDADT) and larger sampling intervals can be achieved. Finally, an example is adopted to illustrate the effectiveness of the proposed approach.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105990"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributed state estimation for interdependent and switching multi-agent systems","authors":"Camilla Fioravanti , Andrea Gasparri , Stefano Panzieri , Gabriele Oliva","doi":"10.1016/j.sysconle.2024.105984","DOIUrl":"10.1016/j.sysconle.2024.105984","url":null,"abstract":"<div><div>This paper addresses the problem of multi-agent distributed state estimation in switching networks over directed graphs. Specifically, we consider a novel estimation setting for a linear continuous-time system that is broken down into subsystems, each of which is locally estimated by the corresponding agent. This task is undertaken despite the complexities due to interdependencies on both cyber and physical levels, and due to the fact that the system is <em>switching</em>, i.e., the different subsystems/agents can activate (e.g., to accomplish some specific task) or deactivate (e.g., due to a fault) during a transient that ends with a cutoff time, unknown to the agents, after which the topology becomes fixed. In particular, by exploiting the <em>negativizability</em> property – the pair <span><math><mrow><mo>(</mo><mi>A</mi><mo>,</mo><mi>C</mi><mo>)</mo></mrow></math></span> is negativizable if there is a feedback gain <span><math><mi>K</mi></math></span> such that <span><math><mrow><mi>A</mi><mo>−</mo><mi>K</mi><mi>C</mi></mrow></math></span> is negative definite – each agent is able to locally perform the calculation of its own estimation gain matrix. The paper is complemented by the convergence analysis of the estimation error executed by leveraging on nonsmooth analysis and simulations to prove the effectiveness of the proposed results.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 105984"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143182998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M.d.R. de Pinho , M. Margarida A. Ferreira , Georgi Smirnov
{"title":"Optimal control problem with nonregular mixed constraints via penalty functions","authors":"M.d.R. de Pinho , M. Margarida A. Ferreira , Georgi Smirnov","doi":"10.1016/j.sysconle.2024.106010","DOIUrl":"10.1016/j.sysconle.2024.106010","url":null,"abstract":"<div><div>Below we deduce necessary conditions of optimality for problems with nonregular mixed constraints (see Dmitruk(2009), Dmitruk and Osmolovskii(2022)) using the method of penalty functions similar to the one we previously used to solve optimization problems for control sweeping processes (see, e.g., de Pinho et al. (2022)), with pure state constraints de Pinho et al.,2024 and with regular mixed constraints (de Pinho et al.,2024).</div><div>We intentionally consider a global minimum and the simplest boundary conditions.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106010"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lina Wang , Zicong Xia , Yang Liu , Shun-ichi Azuma , Weihua Gui
{"title":"Minimal finite-time observability of Markovian jump Boolean networks","authors":"Lina Wang , Zicong Xia , Yang Liu , Shun-ichi Azuma , Weihua Gui","doi":"10.1016/j.sysconle.2024.106007","DOIUrl":"10.1016/j.sysconle.2024.106007","url":null,"abstract":"<div><div>In this paper, the finite-time observability and minimal finite-time observability problems of Markovian jump Boolean networks (MJBNs) are addressed. The signal space is partitioned to facilitate the observability analysis, followed by novel criteria for the finite-time observability of MJBNs. To reduce measurement costs, a minimal finite-time observability problem is formulated, involving the injection of the minimum number of sensors necessary for an unobservable MJBN to achieve finite-time observability. By introducing an indicator matrix, the minimal finite-time observability problem is converted into a 0–1 programming problem, and a collaborative neurodynamic optimization approach with multiple recurrent neural networks is developed for obtaining a global optimal solution. Two illustrative examples, including a biological simulation, are provided to demonstrate the theoretical results.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106007"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Recursive identification of nonlinear nonparametric systems under event-triggered observations","authors":"Xiaotao Ren , Wenxiao Zhao , Han Zhang","doi":"10.1016/j.sysconle.2024.106013","DOIUrl":"10.1016/j.sysconle.2024.106013","url":null,"abstract":"<div><div>In the paper, recursive identification of the nonlinear nonparametric system is considered, where measurements for identification are subject to an event-triggered scheme and the system itself is of a finite impulse response (FIR) type. First, an adaptive event detector is designed and the measurements for identification are transmitted depending whether the value of the detector is 1 or 0. Second, a recursive identification algorithm is proposed with the help of a kernel-based stochastic approximation algorithm with expanding truncations (SAAWET). Third, under some reasonable assumptions, the estimates are proved to be strongly consistent, i.e., converging almost surely to the values of the unknown function in the system at any fixed points, and the transmission rate of the detector is analyzed as well. Finally, numerical examples are given to justify the theoretical results.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"196 ","pages":"Article 106013"},"PeriodicalIF":2.1,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143183647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zelin Yang, Jian-An Wang, Jie Zhang, Mingjie Li, Hui Shi
{"title":"Event-dependent intermittent synchronization of complex networks based on discrete-time state observation","authors":"Zelin Yang, Jian-An Wang, Jie Zhang, Mingjie Li, Hui Shi","doi":"10.1016/j.sysconle.2025.106025","DOIUrl":"10.1016/j.sysconle.2025.106025","url":null,"abstract":"<div><div>This paper studies the synchronization issue of complex networks via event-dependent intermittent discrete-time observation control (EIDOC) for the first time. Three non-negative real domains are characterized by introducing two boundary functions. The work and rest time of intermittent control rely on the relationship between the Lyapunov function trajectory and non-negative regions. The proposed aperiodically intermittent control is based on discrete-time state observation rather than continuous observation during the work interval. Some sufficient criteria are derived for ensuring synchronization of the network. The theoretical results are employed to deal with single pendulum systems, and numerical simulation have demonstrated the effectiveness of the derived method.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"197 ","pages":"Article 106025"},"PeriodicalIF":2.1,"publicationDate":"2025-01-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143171855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Corrigendum to “Remarks on input to state stability of perturbed gradient flows, motivated by model-free feedback control learning” [Syst. Control Lett. 161 (2022) 105138]","authors":"Eduardo D. Sontag","doi":"10.1016/j.sysconle.2024.105952","DOIUrl":"10.1016/j.sysconle.2024.105952","url":null,"abstract":"","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"194 ","pages":"Article 105952"},"PeriodicalIF":2.1,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142742951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Corrigendum to “Compensation of spatially-varying state delay for a first-order hyperbolic PIDE using boundary control” [Syst. Control Lett. 157 (2021) 105050]","authors":"Jing Zhang , Jie Qi","doi":"10.1016/j.sysconle.2024.105964","DOIUrl":"10.1016/j.sysconle.2024.105964","url":null,"abstract":"","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"194 ","pages":"Article 105964"},"PeriodicalIF":2.1,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142742952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vincent Andrieu , Lucas Brivadis , Jean-Paul Gauthier , Ludovic Sacchelli , Ulysse Serres
{"title":"Exponential stabilizability and observability at the target imply semiglobal exponential stabilizability by templated output feedback","authors":"Vincent Andrieu , Lucas Brivadis , Jean-Paul Gauthier , Ludovic Sacchelli , Ulysse Serres","doi":"10.1016/j.sysconle.2024.105971","DOIUrl":"10.1016/j.sysconle.2024.105971","url":null,"abstract":"<div><div>For nonlinear analytic control systems, we introduce a new paradigm for dynamic output feedback stabilization. We propose to periodically sample the usual observer based control law, and to reshape it so that it coincides with a “control template” on each time period. By choosing a control template making the system observable, we prove that this method allows to bypass the uniform observability assumption that is used in most nonlinear separation principles. We prove the genericity of control templates by adapting a universality theorem of Sussmann.</div></div>","PeriodicalId":49450,"journal":{"name":"Systems & Control Letters","volume":"195 ","pages":"Article 105971"},"PeriodicalIF":2.1,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142757734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}