部分观测的扩展平均场控制问题

IF 1.3 3区数学 Q4 AUTOMATION & CONTROL SYSTEMS

Esaim-Control Optimisation and Calculus of Variations Pub Date : 2022-02-01 DOI:10.1051/cocv/2022010

Tianyang Nie, Keyu Yan

{"title":"部分观测的扩展平均场控制问题","authors":"Tianyang Nie, Keyu Yan","doi":"10.1051/cocv/2022010","DOIUrl":null,"url":null,"abstract":"We study an extended mean-field control problem with partial observation, where the dynamic of the state is given by a forward-backward stochastic differential equation of McKean-Vlasov type. The cost functional, the state and the observation all depend on the joint distribution of the state and the control process. Our problem is motivated by the recent popular subject of mean-field games and related control problems of McKean-Vlasov type. We first establish a necessary condition in the form of Pontryagin's maximum principle for optimality. Then a verification theorem is obtained for optimal control under some convex conditions of the Hamiltonian function. The results are also applied to studying linear-quadratic mean-filed control problem in the type of scalar interaction.","PeriodicalId":50500,"journal":{"name":"Esaim-Control Optimisation and Calculus of Variations","volume":null,"pages":null},"PeriodicalIF":1.3000,"publicationDate":"2022-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"Extended mean-field control problem with partial observation\",\"authors\":\"Tianyang Nie, Keyu Yan\",\"doi\":\"10.1051/cocv/2022010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We study an extended mean-field control problem with partial observation, where the dynamic of the state is given by a forward-backward stochastic differential equation of McKean-Vlasov type. The cost functional, the state and the observation all depend on the joint distribution of the state and the control process. Our problem is motivated by the recent popular subject of mean-field games and related control problems of McKean-Vlasov type. We first establish a necessary condition in the form of Pontryagin's maximum principle for optimality. Then a verification theorem is obtained for optimal control under some convex conditions of the Hamiltonian function. The results are also applied to studying linear-quadratic mean-filed control problem in the type of scalar interaction.\",\"PeriodicalId\":50500,\"journal\":{\"name\":\"Esaim-Control Optimisation and Calculus of Variations\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.3000,\"publicationDate\":\"2022-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Esaim-Control Optimisation and Calculus of Variations\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1051/cocv/2022010\",\"RegionNum\":3,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Esaim-Control Optimisation and Calculus of Variations","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1051/cocv/2022010","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}

引用次数: 8

摘要

研究了一类具有部分观测的扩展平均场控制问题，其中状态的动态由McKean-Vlasov型的前向后随机微分方程给出。代价函数、状态和观测值都依赖于状态和控制过程的联合分布。我们的问题是由最近流行的平均场博弈和McKean-Vlasov类型的相关控制问题所激发的。我们首先以庞特里亚金极大原理的形式建立了最优性的必要条件。然后给出了哈密顿函数在某些凸条件下最优控制的验证定理。所得结果也适用于标量相互作用下线性二次平均场控制问题的研究。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Extended mean-field control problem with partial observation

We study an extended mean-field control problem with partial observation, where the dynamic of the state is given by a forward-backward stochastic differential equation of McKean-Vlasov type. The cost functional, the state and the observation all depend on the joint distribution of the state and the control process. Our problem is motivated by the recent popular subject of mean-field games and related control problems of McKean-Vlasov type. We first establish a necessary condition in the form of Pontryagin's maximum principle for optimality. Then a verification theorem is obtained for optimal control under some convex conditions of the Hamiltonian function. The results are also applied to studying linear-quadratic mean-filed control problem in the type of scalar interaction.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Esaim-Control Optimisation and Calculus of Variations Mathematics-Computational Mathematics

自引率

7.10%

发文量

期刊介绍： ESAIM: COCV strives to publish rapidly and efficiently papers and surveys in the areas of Control, Optimisation and Calculus of Variations. Articles may be theoretical, computational, or both, and they will cover contemporary subjects with impact in forefront technology, biosciences, materials science, computer vision, continuum physics, decision sciences and other allied disciplines. Targeted topics include: in control: modeling, controllability, optimal control, stabilization, control design, hybrid control, robustness analysis, numerical and computational methods for control, stochastic or deterministic, continuous or discrete control systems, finite-dimensional or infinite-dimensional control systems, geometric control, quantum control, game theory; in optimisation: mathematical programming, large scale systems, stochastic optimisation, combinatorial optimisation, shape optimisation, convex or nonsmooth optimisation, inverse problems, interior point methods, duality methods, numerical methods, convergence and complexity, global optimisation, optimisation and dynamical systems, optimal transport, machine learning, image or signal analysis; in calculus of variations: variational methods for differential equations and Hamiltonian systems, variational inequalities; semicontinuity and convergence, existence and regularity of minimizers and critical points of functionals, relaxation; geometric problems and the use and development of geometric measure theory tools; problems involving randomness; viscosity solutions; numerical methods; homogenization, multiscale and singular perturbation problems.