{"title":"用于混沌控制的kan增强深度强化学习:通过小扰动实现快速稳定","authors":"Tongtao Liu, Yongping Zhang","doi":"10.1016/j.physd.2025.134915","DOIUrl":null,"url":null,"abstract":"<div><div>Based on the fact that chaotic systems own dense periodic orbits, chaos control methods represented by the OGY method successfully achieve stabilization with minor control inputs, offering advantages of low energy consumption and non-invasiveness. However, these methods heavily depend on the time required for trajectories to populate chaotic attractors and require prior knowledge of local dynamic information near the target state. These issues hinder their practical applications. In this paper, Kolmogorov–Arnold Networks (KANs) are demonstrated to exhibit significant potential for chaos control via deep reinforcement learning, which is a neural network architecture proposed recently. A new deep reinforcement learning algorithm called parametrized branching dueling Q-network (P-BDQ) is proposed. Then, a new controller is designed based on KANs and P-BDQ. This controller preserves the advantages of the OGY method while reducing the stabilization time through appropriate perturbations applied at each iteration step. Additionally, the data-driven property of deep reinforcement learning avoids the need for explicit modeling of the local system dynamics near a stable state. Numerical simulations demonstrate that this controller performs effectively across multiple chaotic systems.</div></div>","PeriodicalId":20050,"journal":{"name":"Physica D: Nonlinear Phenomena","volume":"482 ","pages":"Article 134915"},"PeriodicalIF":2.9000,"publicationDate":"2025-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"KAN-enhanced deep reinforcement learning for chaos control: Achieving rapid stabilization via minor perturbations\",\"authors\":\"Tongtao Liu, Yongping Zhang\",\"doi\":\"10.1016/j.physd.2025.134915\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Based on the fact that chaotic systems own dense periodic orbits, chaos control methods represented by the OGY method successfully achieve stabilization with minor control inputs, offering advantages of low energy consumption and non-invasiveness. However, these methods heavily depend on the time required for trajectories to populate chaotic attractors and require prior knowledge of local dynamic information near the target state. These issues hinder their practical applications. In this paper, Kolmogorov–Arnold Networks (KANs) are demonstrated to exhibit significant potential for chaos control via deep reinforcement learning, which is a neural network architecture proposed recently. A new deep reinforcement learning algorithm called parametrized branching dueling Q-network (P-BDQ) is proposed. Then, a new controller is designed based on KANs and P-BDQ. This controller preserves the advantages of the OGY method while reducing the stabilization time through appropriate perturbations applied at each iteration step. Additionally, the data-driven property of deep reinforcement learning avoids the need for explicit modeling of the local system dynamics near a stable state. Numerical simulations demonstrate that this controller performs effectively across multiple chaotic systems.</div></div>\",\"PeriodicalId\":20050,\"journal\":{\"name\":\"Physica D: Nonlinear Phenomena\",\"volume\":\"482 \",\"pages\":\"Article 134915\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physica D: Nonlinear Phenomena\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167278925003926\",\"RegionNum\":3,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica D: Nonlinear Phenomena","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167278925003926","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
KAN-enhanced deep reinforcement learning for chaos control: Achieving rapid stabilization via minor perturbations
Based on the fact that chaotic systems own dense periodic orbits, chaos control methods represented by the OGY method successfully achieve stabilization with minor control inputs, offering advantages of low energy consumption and non-invasiveness. However, these methods heavily depend on the time required for trajectories to populate chaotic attractors and require prior knowledge of local dynamic information near the target state. These issues hinder their practical applications. In this paper, Kolmogorov–Arnold Networks (KANs) are demonstrated to exhibit significant potential for chaos control via deep reinforcement learning, which is a neural network architecture proposed recently. A new deep reinforcement learning algorithm called parametrized branching dueling Q-network (P-BDQ) is proposed. Then, a new controller is designed based on KANs and P-BDQ. This controller preserves the advantages of the OGY method while reducing the stabilization time through appropriate perturbations applied at each iteration step. Additionally, the data-driven property of deep reinforcement learning avoids the need for explicit modeling of the local system dynamics near a stable state. Numerical simulations demonstrate that this controller performs effectively across multiple chaotic systems.
期刊介绍:
Physica D (Nonlinear Phenomena) publishes research and review articles reporting on experimental and theoretical works, techniques and ideas that advance the understanding of nonlinear phenomena. Topics encompass wave motion in physical, chemical and biological systems; physical or biological phenomena governed by nonlinear field equations, including hydrodynamics and turbulence; pattern formation and cooperative phenomena; instability, bifurcations, chaos, and space-time disorder; integrable/Hamiltonian systems; asymptotic analysis and, more generally, mathematical methods for nonlinear systems.