Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee
{"title":"通过随机最大值原理制定的随机控制问题的深层 BSDE 方法的收敛性","authors":"Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee","doi":"10.1016/j.matcom.2024.08.002","DOIUrl":null,"url":null,"abstract":"<div><p>It is well-known that decision-making problems from stochastic control can be formulated by means of a forward–backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. (2022) proposed an efficient deep learning algorithm based on the stochastic maximum principle (SMP). In this paper, we provide a convergence result for this deep SMP-BSDE algorithm and compare its performance with other existing methods. In particular, by adopting a strategy as in Han and Long (2020), we derive <em>a-posteriori estimate</em>, and show that the total approximation error can be bounded by the value of the loss functional and the discretization error. We present numerical examples for high-dimensional stochastic control problems, both in the cases of drift- and diffusion control, which showcase superior performance compared to existing algorithms.</p></div>","PeriodicalId":4,"journal":{"name":"ACS Applied Energy Materials","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle\",\"authors\":\"Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee\",\"doi\":\"10.1016/j.matcom.2024.08.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>It is well-known that decision-making problems from stochastic control can be formulated by means of a forward–backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. (2022) proposed an efficient deep learning algorithm based on the stochastic maximum principle (SMP). In this paper, we provide a convergence result for this deep SMP-BSDE algorithm and compare its performance with other existing methods. In particular, by adopting a strategy as in Han and Long (2020), we derive <em>a-posteriori estimate</em>, and show that the total approximation error can be bounded by the value of the loss functional and the discretization error. We present numerical examples for high-dimensional stochastic control problems, both in the cases of drift- and diffusion control, which showcase superior performance compared to existing algorithms.</p></div>\",\"PeriodicalId\":4,\"journal\":{\"name\":\"ACS Applied Energy Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-08-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Energy Materials\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0378475424003045\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Energy Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378475424003045","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
摘要
众所周知,随机控制的决策问题可以通过前向-后向随机微分方程(FBSDE)来表述。最近,Ji 等人(2022 年)提出了一种基于随机最大原则(SMP)的高效深度学习算法。在本文中,我们提供了这种深度 SMP-BSDE 算法的收敛结果,并将其性能与其他现有方法进行了比较。特别是,通过采用 Han 和 Long (2020) 的策略,我们得出了后验估计值,并证明总近似误差可由损失函数值和离散化误差限定。我们给出了高维随机控制问题的数值示例,包括漂移控制和扩散控制两种情况,与现有算法相比,这些示例展示了优越的性能。
Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle
It is well-known that decision-making problems from stochastic control can be formulated by means of a forward–backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. (2022) proposed an efficient deep learning algorithm based on the stochastic maximum principle (SMP). In this paper, we provide a convergence result for this deep SMP-BSDE algorithm and compare its performance with other existing methods. In particular, by adopting a strategy as in Han and Long (2020), we derive a-posteriori estimate, and show that the total approximation error can be bounded by the value of the loss functional and the discretization error. We present numerical examples for high-dimensional stochastic control problems, both in the cases of drift- and diffusion control, which showcase superior performance compared to existing algorithms.
期刊介绍:
ACS Applied Energy Materials is an interdisciplinary journal publishing original research covering all aspects of materials, engineering, chemistry, physics and biology relevant to energy conversion and storage. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important energy applications.