Lulu Zhang;Huaguang Zhang;Jiayue Sun;Zhongyang Ming
{"title":"Adaptive Critic-Based Optimal Control of Input-Constrained Stochastic Systems via Generalized Fuzzy Hyperbolic Models","authors":"Lulu Zhang;Huaguang Zhang;Jiayue Sun;Zhongyang Ming","doi":"10.1109/TFUZZ.2024.3523898","DOIUrl":null,"url":null,"abstract":"This article investigates adaptive dynamic programming (ADP)-based optimal control issue of nonlinear stochastic systems with asymmetric input constraints. The solution starts with developing generalized fuzzy hyperbolic model (GFHM) in the stochastic system, which aims to approximate unknown nonlinear terms. By establishing a nonquadratic cost function, the constrained <inline-formula><tex-math>$H_{\\infty }$</tex-math></inline-formula> control problem is converted into zero-sum game and Hamilton–Jacobi–Isaacs equation (HJIE) is derived. To solve the HJIE, the ADP algorithm is developed by constructing a single-network adaptive critic framework. Assisted by GFHM, the updating process obviates the necessity for the dynamics of unknown nonlinear terms. Under the designed controller, the stability of the stochastic system is guaranteed by the Lyapunov method. Two illustrative examples validate the presented method.","PeriodicalId":13212,"journal":{"name":"IEEE Transactions on Fuzzy Systems","volume":"33 5","pages":"1627-1638"},"PeriodicalIF":10.7000,"publicationDate":"2025-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Fuzzy Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10842460/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
This article investigates adaptive dynamic programming (ADP)-based optimal control issue of nonlinear stochastic systems with asymmetric input constraints. The solution starts with developing generalized fuzzy hyperbolic model (GFHM) in the stochastic system, which aims to approximate unknown nonlinear terms. By establishing a nonquadratic cost function, the constrained $H_{\infty }$ control problem is converted into zero-sum game and Hamilton–Jacobi–Isaacs equation (HJIE) is derived. To solve the HJIE, the ADP algorithm is developed by constructing a single-network adaptive critic framework. Assisted by GFHM, the updating process obviates the necessity for the dynamics of unknown nonlinear terms. Under the designed controller, the stability of the stochastic system is guaranteed by the Lyapunov method. Two illustrative examples validate the presented method.
期刊介绍:
The IEEE Transactions on Fuzzy Systems is a scholarly journal that focuses on the theory, design, and application of fuzzy systems. It aims to publish high-quality technical papers that contribute significant technical knowledge and exploratory developments in the field of fuzzy systems. The journal particularly emphasizes engineering systems and scientific applications. In addition to research articles, the Transactions also includes a letters section featuring current information, comments, and rebuttals related to published papers.