Andrea Monti, Benita Nortmann, Thulasi Mylvaganam, Mario Sassano
{"title":"Feedback and Open-Loop Nash Equilibria for LQ Infinite-Horizon Discrete-Time Dynamic Games","authors":"Andrea Monti, Benita Nortmann, Thulasi Mylvaganam, Mario Sassano","doi":"10.1137/23m1579960","DOIUrl":"https://doi.org/10.1137/23m1579960","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1417-1436, June 2024. <br/> Abstract. We consider dynamic games defined over an infinite horizon, characterized by linear, discrete-time dynamics and quadratic cost functionals. Considering such linear-quadratic dynamic games, we focus on their solutions in terms of Nash equilibrium strategies. Both feedback (F-NE) and open-loop (OL-NE) Nash equilibrium solutions are considered. The contributions of the paper are threefold. First, our detailed study reveals some interesting structural insights in relation to F-NE solutions. Second, as a stepping stone toward our consideration of OL-NE strategies, we consider a specific infinite-horizon discrete-time (single-player) optimal control problem, wherein the dynamics are influenced by a known exogenous input and draw connections between its solution obtained via dynamic programming and Pontryagin’s minimum principle. Finally, we exploit the latter result to provide a characterization of OL-NE strategies of the class of infinite-horizon dynamic games. The results and key observations made throughout the paper are illustrated via a numerical example.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"129 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140936172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimal Moral-Hazard-Free Reinsurance Under Extended Distortion Premium Principles","authors":"Zhuo Jin, Zuo Quan Xu, Bin Zou","doi":"10.1137/23m1556046","DOIUrl":"https://doi.org/10.1137/23m1556046","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1390-1416, June 2024. <br/> Abstract. We study an optimal reinsurance problem under a diffusion risk model for an insurer who aims to minimize the probability of lifetime ruin. To rule out moral hazard issues, we only consider moral-hazard-free reinsurance contracts by imposing the incentive compatibility constraint on indemnity functions. The reinsurance premium is calculated under an extended distortion premium principle, in which the distortion function is not necessarily concave or continuous. We first show that an optimal reinsurance contract always exists and then derive two sufficient and necessary conditions to characterize it. Due to the presence of the incentive compatibility constraint and the nonconcavity of the distortion, the optimal contract is obtained as a solution to a double obstacle problem. At last, we apply the general result to study four examples and obtain the optimal contract in (semi-)closed form.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"133 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140936173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
René Hosfeld, Birgit Jacob, Felix L. Schwenninger, Marius Tucsnak
{"title":"Input-to-State Stability for Bilinear Feedback Systems","authors":"René Hosfeld, Birgit Jacob, Felix L. Schwenninger, Marius Tucsnak","doi":"10.1137/23m155788x","DOIUrl":"https://doi.org/10.1137/23m155788x","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1369-1389, June 2024. <br/> Abstract. Input-to-state stability estimates with respect to small initial conditions and input functions for infinite-dimensional systems with bilinear feedback are shown. We apply the obtained results to controlled versions of a viscous Burger equation with Dirichlet boundary conditions, a Schrödinger equation, a Navier–Stokes system, and a semilinear wave equation.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"114 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140936161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Nabile Boussaïd, Marco Caponigro, Thomas Chambrion
{"title":"Switching Controls for Conservative Bilinear Quantum Systems with Discrete Spectrum","authors":"Nabile Boussaïd, Marco Caponigro, Thomas Chambrion","doi":"10.1137/23m1588494","DOIUrl":"https://doi.org/10.1137/23m1588494","url":null,"abstract":"SIAM Journal on Control and Optimization, Ahead of Print. <br/>Abstract. We analyze attainable sets of single-input bilinear conservative systems with piecewise constant controls. Under the assumption that the ambient space admits a Hilbert basis made of eigenvectors of the drift operator, we show that the closure of the attainable set does not depend on the set of admissible controls, provided the controls can take at least two or three values.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"20 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140882806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Simon Buchwald, Gabriele Ciaramella, Julien Salomon
{"title":"Gauss–Newton Oriented Greedy Algorithms for the Reconstruction of Operators in Nonlinear Dynamics","authors":"Simon Buchwald, Gabriele Ciaramella, Julien Salomon","doi":"10.1137/23m1552929","DOIUrl":"https://doi.org/10.1137/23m1552929","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1343-1368, June 2024. <br/> Abstract. This paper is devoted to the development and convergence analysis of greedy reconstruction algorithms based on the strategy presented in [Y. Maday and J. Salomon, Joint Proceedings of the 48th IEEE Conference on Decision and Control and the 28th Chinese Control Conference, 2009, pp. 375–379]. These procedures allow the design of a sequence of control functions that ease the identification of unknown operators in nonlinear dynamical systems. The original strategy of greedy reconstruction algorithms is based on an offline/online decomposition of the reconstruction process and an ansatz for the unknown operator obtained by an a priori chosen set of linearly independent matrices. In the previous work [S. Buchwald, G. Ciaramella, and J. Salomon, SIAM J. Control Optim., 59 (2021), pp. 4511–4537], convergence results were obtained in the case of linear identification problems. We tackle here the more general case of nonlinear systems. More precisely, we introduce a new greedy algorithm based on the linearized system. We show that the controls obtained with this new algorithm lead to the local convergence of the classical Gauss–Newton method applied to the online nonlinear identification problem. We then extend this result to the controls obtained on nonlinear systems where a local convergence result is also proved. The main convergence results are obtained for dynamical systems with linear and bilinear control structures.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"32 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140834708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive Stabilization of Noncooperative Stochastic Differential Games","authors":"Nian Liu, Lei Guo","doi":"10.1137/22m1530549","DOIUrl":"https://doi.org/10.1137/22m1530549","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1317-1342, June 2024. <br/>Abstract. In this paper, we consider the adaptive stabilization problem for a basic class of linear-quadratic noncooperative stochastic differential games when the systems matrices are unknown to the regulator and the players. This is a typical problem of game-based control systems (GBCS) introduced and studied recently, which have a hierarchical decision-making structure: there is a controller at the upper level acting as a global regulator which makes its decision first, and the players at the lower level are assumed to play a typical zero-sum differential games. The main purpose of the paper is to study how the adaptive regulator can be designed to make the GBCS globally stable and at the same time to ensure a Nash equilibrium reached by the players, where the adaptive strategies of the players are assumed to be constructed based on the standard least squares estimators. The design of the global regulator is an integration of the weighted least squares parameter estimator, random regularization and diminishing excitation methods. Under the assumption that the system matrix pair [math] is controllable and there exists a stabilizing solution for the corresponding algebraic Riccati equation, it is shown that the closed-loop adaptive GBCS will be globally stable, and at the same time reach a Nash equilibrium by the players.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"38 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140834704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Luis Almeida, Alexis Léculier, Grégoire Nadin, Yannick Privat
{"title":"Optimal Control of Bistable Traveling Waves: Looking for the Best Spatial Distribution of a Killing Action to Block a Pest Invasion","authors":"Luis Almeida, Alexis Léculier, Grégoire Nadin, Yannick Privat","doi":"10.1137/22m1528410","DOIUrl":"https://doi.org/10.1137/22m1528410","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 1291-1315, April 2024. <br/> Abstract. Some pests and vectors of many vector-borne diseases (like mosquitoes for malaria and dengue) are known to invade any homogeneous and favorable territory, following a traveling wave type dynamic. The density of individuals in the field is commonly modeled as the solution of a bistable reaction-diffusion equation on an unbounded domain. In this work, we are interested in finding an optimal strategy to block such a solution by means of a population elimination action in a prescribed subdomain (modeling, for instance, the effect of a mechanical action or an insecticide applied in a certain region to reduce the number of individuals in the population). We propose a complete description of the solutions of this problem, based on the precise analysis of the optimality conditions and on arguments for comparison between the possible strategies.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"79 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140635249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Local Time Pushed Mixed Equilibrium Strategies for Time-Inconsistent Stopping Problems","authors":"Andi Bodnariu, Sören Christensen, Kristoffer Lindensjö","doi":"10.1137/22m1506651","DOIUrl":"https://doi.org/10.1137/22m1506651","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 1261-1290, April 2024. <br/> Abstract. We consider the game-theoretic approach to time-inconsistent stopping of a one-dimensional diffusion where the time-inconsistency is due to the presence of a nonexponential (weighted) discount function. In particular, we study (weak) equilibria for this problem in a novel class of mixed (i.e., randomized) stopping times based on a local time construction of the stopping intensity. For a general formulation of the problem we provide a verification theorem giving sufficient conditions for mixed (and pure) equilibria in terms of a set of variational inequalities, including a smooth fit condition. We apply the theory to prove the existence of (mixed) equilibria in a recently studied real options problem in which no pure equilibria exist.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"56 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140598725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Phase Theory of Multi-Input Multi-Output Linear Time-Invariant Systems","authors":"Wei Chen, Dan Wang, Sei Zhen Khong, Li Qiu","doi":"10.1137/22m148968x","DOIUrl":"https://doi.org/10.1137/22m148968x","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 1235-1260, April 2024. <br/> Abstract. In this paper, we define the phase response for a class of multi-input multi-output (MIMO) linear time-invariant (LTI) systems whose frequency responses are (semi-)sectorial at all frequencies. The newly defined phase subsumes the well-known notion of positive real systems and is closely related to the notion of negative imaginary systems. We formulate a small phase theorem for feedback stability, which complements the small gain theorem. The small phase theorem lays the foundation of a phase theory of MIMO systems. We also discuss time-domain interpretations of phase-bounded systems via both energy signal analysis and power signal analysis.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"243 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140598727","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic Programming in Probability Spaces via Optimal Transport","authors":"Antonio Terpin, Nicolas Lanzetti, Florian Dörfler","doi":"10.1137/23m1560902","DOIUrl":"https://doi.org/10.1137/23m1560902","url":null,"abstract":"SIAM Journal on Control and Optimization, Volume 62, Issue 2, Page 1183-1206, April 2024. <br/> Abstract. We study discrete-time finite-horizon optimal control problems in probability spaces, whereby the state of the system is a probability measure. We show that, in many instances, the solution of dynamic programming in probability spaces results from two ingredients: (i) the solution of dynamic programming in the “ground space” (i.e., the space on which the probability measures live) and (ii) the solution of an optimal transport problem. From a multi-agent control perspective, a separation principle holds: “low-level control of the agents of the fleet” (how does one reach the destination?) and “fleet-level control” (who goes where?) are decoupled.","PeriodicalId":49531,"journal":{"name":"SIAM Journal on Control and Optimization","volume":"10 1","pages":""},"PeriodicalIF":2.2,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140598824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}