Andrea Cosso, Fausto Gozzi, Idris Kharroubi, H. Pham, M. Rosestolato
{"title":"Optimal control of path-dependent McKean–Vlasov SDEs in infinite-dimension","authors":"Andrea Cosso, Fausto Gozzi, Idris Kharroubi, H. Pham, M. Rosestolato","doi":"10.1214/22-aap1880","DOIUrl":null,"url":null,"abstract":"We study the optimal control of path-dependent McKean-Vlasov equations valued in Hilbert spaces motivated by non Markovian mean-field models driven by stochastic PDEs. We first establish the well-posedness of the state equation, and then we prove the dynamic programming principle (DPP) in such a general framework. The crucial law invariance property of the value function V is rigorously obtained, which means that V can be viewed as a function on the Wasserstein space of probability measures on the set of continuous functions valued in Hilbert space. We then define a notion of pathwise measure derivative, which extends the Wasserstein derivative due to Lions [41], and prove a related functional It{\\^o} formula in the spirit of Dupire [24] and Wu and Zhang [51]. The Master Bellman equation is derived from the DPP by means of a suitable notion of viscosity solution. We provide different formulations and simplifications of such a Bellman equation notably in the special case when there is no dependence on the law of the control.","PeriodicalId":50979,"journal":{"name":"Annals of Applied Probability","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2020-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"21","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of Applied Probability","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1214/22-aap1880","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 21
Abstract
We study the optimal control of path-dependent McKean-Vlasov equations valued in Hilbert spaces motivated by non Markovian mean-field models driven by stochastic PDEs. We first establish the well-posedness of the state equation, and then we prove the dynamic programming principle (DPP) in such a general framework. The crucial law invariance property of the value function V is rigorously obtained, which means that V can be viewed as a function on the Wasserstein space of probability measures on the set of continuous functions valued in Hilbert space. We then define a notion of pathwise measure derivative, which extends the Wasserstein derivative due to Lions [41], and prove a related functional It{\^o} formula in the spirit of Dupire [24] and Wu and Zhang [51]. The Master Bellman equation is derived from the DPP by means of a suitable notion of viscosity solution. We provide different formulations and simplifications of such a Bellman equation notably in the special case when there is no dependence on the law of the control.
研究了由随机偏微分方程驱动的非马尔可夫平均场模型驱动的Hilbert空间中路径相关McKean-Vlasov方程的最优控制问题。首先建立了状态方程的适定性,然后在此一般框架下证明了动态规划原理。严格地得到了值函数V的关键律不变性质,这意味着V可以看作是Hilbert空间中连续函数集合上的概率测度的Wasserstein空间上的函数。然后,我们定义了路径测度导数的概念,将Wasserstein导数推广到Lions[41],并在Dupire[24]和Wu and Zhang[51]的精神下证明了一个相关的泛函It{\^o}公式。利用合适的粘度解的概念,从DPP推导出主贝尔曼方程。我们提供了这样一个Bellman方程的不同的公式和简化,特别是在不依赖于控制律的特殊情况下。
期刊介绍:
The Annals of Applied Probability aims to publish research of the highest quality reflecting the varied facets of contemporary Applied Probability. Primary emphasis is placed on importance and originality.