前后向随机微分方程的最优控制:时间不一致和时间一致解

IF 4.6 Q2 MATERIALS SCIENCE, BIOMATERIALS
Hanxiao Wang , Jiongmin Yong , Chao Zhou
{"title":"前后向随机微分方程的最优控制:时间不一致和时间一致解","authors":"Hanxiao Wang ,&nbsp;Jiongmin Yong ,&nbsp;Chao Zhou","doi":"10.1016/j.matpur.2024.103603","DOIUrl":null,"url":null,"abstract":"<div><p>This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). It is found that such an optimal control problem is time-inconsistent in general, even if the cost functional is reduced to a classical Bolza type one as in Peng <span><span>[47]</span></span>, Lim–Zhou <span><span>[38]</span></span>, and Yong <span><span>[72]</span></span>. Therefore, instead of finding a global optimal control (which is time-inconsistent), we will look for a time-consistent and locally optimal equilibrium strategy, which can be constructed via the solution of an associated equilibrium Hamilton–Jacobi–Bellman (HJB, for short) equation. A verification theorem for the local optimality of the equilibrium strategy is proved by means of the generalized Feynman–Kac formula for BSVIEs and some stability estimates of the representation parabolic partial differential equations (PDEs, for short). Under certain conditions, it is proved that the equilibrium HJB equation, which is a nonlocal PDE, admits a unique classical solution. As special cases and applications, the linear-quadratic problems, a mean-variance model, a social planner problem with heterogeneous Epstein–Zin utilities, and a Stackelberg game are briefly investigated. It turns out that our framework can cover not only the optimal control problems for FBSDEs studied in <span><span>[47]</span></span>, <span><span>[38]</span></span>, <span><span>[72]</span></span>, and so on, but also the problems of the general discounting and some nonlinear appearance of conditional expectations for the terminal state, studied in Yong <span><span>[73]</span></span>, <span><span>[75]</span></span> and Björk–Khapko–Murgoci <span><span>[6]</span></span>.</p></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal controls for forward-backward stochastic differential equations: Time-inconsistency and time-consistent solutions\",\"authors\":\"Hanxiao Wang ,&nbsp;Jiongmin Yong ,&nbsp;Chao Zhou\",\"doi\":\"10.1016/j.matpur.2024.103603\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). It is found that such an optimal control problem is time-inconsistent in general, even if the cost functional is reduced to a classical Bolza type one as in Peng <span><span>[47]</span></span>, Lim–Zhou <span><span>[38]</span></span>, and Yong <span><span>[72]</span></span>. Therefore, instead of finding a global optimal control (which is time-inconsistent), we will look for a time-consistent and locally optimal equilibrium strategy, which can be constructed via the solution of an associated equilibrium Hamilton–Jacobi–Bellman (HJB, for short) equation. A verification theorem for the local optimality of the equilibrium strategy is proved by means of the generalized Feynman–Kac formula for BSVIEs and some stability estimates of the representation parabolic partial differential equations (PDEs, for short). Under certain conditions, it is proved that the equilibrium HJB equation, which is a nonlocal PDE, admits a unique classical solution. As special cases and applications, the linear-quadratic problems, a mean-variance model, a social planner problem with heterogeneous Epstein–Zin utilities, and a Stackelberg game are briefly investigated. It turns out that our framework can cover not only the optimal control problems for FBSDEs studied in <span><span>[47]</span></span>, <span><span>[38]</span></span>, <span><span>[72]</span></span>, and so on, but also the problems of the general discounting and some nonlinear appearance of conditional expectations for the terminal state, studied in Yong <span><span>[73]</span></span>, <span><span>[75]</span></span> and Björk–Khapko–Murgoci <span><span>[6]</span></span>.</p></div>\",\"PeriodicalId\":2,\"journal\":{\"name\":\"ACS Applied Bio Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Bio Materials\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0021782424001016\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, BIOMATERIALS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0021782424001016","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0

摘要

本文讨论的是一个随机渐进-逆行微分方程(EDSP-R)的最优控制问题,其递归代价函数由随机逆行伏特拉积分方程(SRVI)决定。研究发现,正如 Peng 、Lim-Zhou 和 Yong 所观察到的那样,即使成本函数被简化为经典的 Bolza 类型形式,这样的最优控制问题通常也是时间不一致的。因此,与其寻找全局最优控制(这是时间不一致的),我们建议寻找局部最优和时间一致的均衡策略,这可以通过求解与均衡相关的汉密尔顿-雅各比-贝尔曼(HJB)方程来构建。通过 EISRV 的广义费曼-卡克公式和抛物线偏微分方程(PDE)的某些表示稳定性估计,证明了均衡策略局部最优性的验证定理。在某些条件下,证明了作为非局部 PDE 的均衡 HJB 方程具有唯一的经典解。作为特例和应用,我们简要地考虑了线性二次问题、均值方差模型、具有异质爱泼斯坦-津效用的社会规划者问题和斯塔克伯格博弈。事实证明,我们的框架不仅可以涵盖以前著作中研究的 EDSP-R 的最优控制问题,如 Peng、Lim-Zhou 和 Yong 等人的著作,还可以涵盖 Yong 和 Björk-Khapko-Murgoci 等人的著作中研究的一般贴现问题和一些终端状态条件期望的非线性显现问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Optimal controls for forward-backward stochastic differential equations: Time-inconsistency and time-consistent solutions

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). It is found that such an optimal control problem is time-inconsistent in general, even if the cost functional is reduced to a classical Bolza type one as in Peng [47], Lim–Zhou [38], and Yong [72]. Therefore, instead of finding a global optimal control (which is time-inconsistent), we will look for a time-consistent and locally optimal equilibrium strategy, which can be constructed via the solution of an associated equilibrium Hamilton–Jacobi–Bellman (HJB, for short) equation. A verification theorem for the local optimality of the equilibrium strategy is proved by means of the generalized Feynman–Kac formula for BSVIEs and some stability estimates of the representation parabolic partial differential equations (PDEs, for short). Under certain conditions, it is proved that the equilibrium HJB equation, which is a nonlocal PDE, admits a unique classical solution. As special cases and applications, the linear-quadratic problems, a mean-variance model, a social planner problem with heterogeneous Epstein–Zin utilities, and a Stackelberg game are briefly investigated. It turns out that our framework can cover not only the optimal control problems for FBSDEs studied in [47], [38], [72], and so on, but also the problems of the general discounting and some nonlinear appearance of conditional expectations for the terminal state, studied in Yong [73], [75] and Björk–Khapko–Murgoci [6].

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACS Applied Bio Materials
ACS Applied Bio Materials Chemistry-Chemistry (all)
CiteScore
9.40
自引率
2.10%
发文量
464
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信