{"title":"动态系统上熵模型预测最优输运","authors":"Kaito Ito, K. Kashima","doi":"10.48550/arXiv.2301.06492","DOIUrl":null,"url":null,"abstract":"We consider the optimal control problem of steering an agent population to a desired distribution over an infinite horizon. This is an optimal transport problem over dynamical systems, which is challenging due to its high computational cost. In this paper, by using entropy regularization, we propose Sinkhorn MPC, which is a dynamical transport algorithm integrating model predictive control (MPC) and the so-called Sinkhorn algorithm. The notable feature of the proposed method is that it achieves cost-effective transport in real time by performing control and transport planning simultaneously, which is illustrated in numerical examples. Moreover, under some assumption on iterations of the Sinkhorn algorithm integrated in MPC, we reveal the global convergence property for Sinkhorn MPC thanks to the entropy regularization. Furthermore, focusing on a quadratic control cost, without the aforementioned assumption we show the ultimate boundedness and the local asymptotic stability for Sinkhorn MPC.","PeriodicalId":13196,"journal":{"name":"IEEE Robotics Autom. Mag.","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Entropic Model Predictive Optimal Transport over Dynamical Systems\",\"authors\":\"Kaito Ito, K. Kashima\",\"doi\":\"10.48550/arXiv.2301.06492\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We consider the optimal control problem of steering an agent population to a desired distribution over an infinite horizon. This is an optimal transport problem over dynamical systems, which is challenging due to its high computational cost. In this paper, by using entropy regularization, we propose Sinkhorn MPC, which is a dynamical transport algorithm integrating model predictive control (MPC) and the so-called Sinkhorn algorithm. The notable feature of the proposed method is that it achieves cost-effective transport in real time by performing control and transport planning simultaneously, which is illustrated in numerical examples. Moreover, under some assumption on iterations of the Sinkhorn algorithm integrated in MPC, we reveal the global convergence property for Sinkhorn MPC thanks to the entropy regularization. Furthermore, focusing on a quadratic control cost, without the aforementioned assumption we show the ultimate boundedness and the local asymptotic stability for Sinkhorn MPC.\",\"PeriodicalId\":13196,\"journal\":{\"name\":\"IEEE Robotics Autom. Mag.\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Robotics Autom. Mag.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2301.06492\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics Autom. Mag.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2301.06492","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Entropic Model Predictive Optimal Transport over Dynamical Systems
We consider the optimal control problem of steering an agent population to a desired distribution over an infinite horizon. This is an optimal transport problem over dynamical systems, which is challenging due to its high computational cost. In this paper, by using entropy regularization, we propose Sinkhorn MPC, which is a dynamical transport algorithm integrating model predictive control (MPC) and the so-called Sinkhorn algorithm. The notable feature of the proposed method is that it achieves cost-effective transport in real time by performing control and transport planning simultaneously, which is illustrated in numerical examples. Moreover, under some assumption on iterations of the Sinkhorn algorithm integrated in MPC, we reveal the global convergence property for Sinkhorn MPC thanks to the entropy regularization. Furthermore, focusing on a quadratic control cost, without the aforementioned assumption we show the ultimate boundedness and the local asymptotic stability for Sinkhorn MPC.