基于多智能体深度强化学习的耦合振荡多路网络中的驯服嵌合体

IF 3.1 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY
Huicong Zhong , Jianpeng Ding , Youming Lei , Michael Small
{"title":"基于多智能体深度强化学习的耦合振荡多路网络中的驯服嵌合体","authors":"Huicong Zhong ,&nbsp;Jianpeng Ding ,&nbsp;Youming Lei ,&nbsp;Michael Small","doi":"10.1016/j.physa.2025.131026","DOIUrl":null,"url":null,"abstract":"<div><div>We propose a method based on the multi-agent soft actor–critic (MASAC) algorithm for taming chimera states in two-layer multiplex networks. In the method, two agents are designed, where one is responsible for observing and controlling the accessible layer and the other dedicated to monitoring the target layer and adaptively adjusting the interlayer coupling strengths accordingly. Through cooperation, the two agents can achieve indirect control of the desired chimera state in the inaccessible target layer, despite being unavailable for direct access. The method employs the centralized training and decentralized execution framework, to overcome the difficulty of implementing control without simultaneous observation of all layers. Furthermore, pinning control is introduced when controlling the accessible layer. In this MASAC-based method combined with pinning control, the control mechanism of chimera states does not arise from synchronization, but relates to cooperation between two designed agents. Therefore, the method works even without the desired chimera state in the accessible layer. Results demonstrate the effectiveness and robustness of the MASAC-based method, both with and without pinning control, across varying system sizes and ratios of controlled nodes. The MASAC-based method combined with pinning control remains effective even when only 10% of the nodes in the accessible layer are actively controlled.</div></div>","PeriodicalId":20152,"journal":{"name":"Physica A: Statistical Mechanics and its Applications","volume":"680 ","pages":"Article 131026"},"PeriodicalIF":3.1000,"publicationDate":"2025-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Taming chimeras in multiplex networks of coupled oscillators based on multi-agent deep reinforcement learning\",\"authors\":\"Huicong Zhong ,&nbsp;Jianpeng Ding ,&nbsp;Youming Lei ,&nbsp;Michael Small\",\"doi\":\"10.1016/j.physa.2025.131026\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>We propose a method based on the multi-agent soft actor–critic (MASAC) algorithm for taming chimera states in two-layer multiplex networks. In the method, two agents are designed, where one is responsible for observing and controlling the accessible layer and the other dedicated to monitoring the target layer and adaptively adjusting the interlayer coupling strengths accordingly. Through cooperation, the two agents can achieve indirect control of the desired chimera state in the inaccessible target layer, despite being unavailable for direct access. The method employs the centralized training and decentralized execution framework, to overcome the difficulty of implementing control without simultaneous observation of all layers. Furthermore, pinning control is introduced when controlling the accessible layer. In this MASAC-based method combined with pinning control, the control mechanism of chimera states does not arise from synchronization, but relates to cooperation between two designed agents. Therefore, the method works even without the desired chimera state in the accessible layer. Results demonstrate the effectiveness and robustness of the MASAC-based method, both with and without pinning control, across varying system sizes and ratios of controlled nodes. The MASAC-based method combined with pinning control remains effective even when only 10% of the nodes in the accessible layer are actively controlled.</div></div>\",\"PeriodicalId\":20152,\"journal\":{\"name\":\"Physica A: Statistical Mechanics and its Applications\",\"volume\":\"680 \",\"pages\":\"Article 131026\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-10-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physica A: Statistical Mechanics and its Applications\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0378437125006788\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PHYSICS, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica A: Statistical Mechanics and its Applications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378437125006788","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

提出了一种基于多智能体软行为者评价(MASAC)算法的二层多路网络嵌合体状态驯服方法。在该方法中,设计了两个agent,其中一个agent负责观察和控制可达层,另一个agent负责监视目标层并相应地自适应调整层间耦合强度。通过合作,两个智能体可以间接控制不可访问的目标层中期望的嵌合体状态,尽管无法直接访问。该方法采用集中训练和分散执行的框架,克服了在不同时观察所有层的情况下实现控制的困难。此外,在控制可访问层时引入了钉住控制。在基于masac与钉住控制相结合的方法中,嵌合体状态的控制机制不是来自于同步,而是涉及到两个被设计agent之间的合作。因此,即使在可访问层中没有期望的嵌合体状态,该方法也可以工作。结果证明了基于masac的方法在不同系统大小和控制节点比例下的有效性和鲁棒性,无论是否有固定控制。即使在可访问层中只有10%的节点被主动控制时,基于masac的方法与固定控制相结合仍然有效。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Taming chimeras in multiplex networks of coupled oscillators based on multi-agent deep reinforcement learning
We propose a method based on the multi-agent soft actor–critic (MASAC) algorithm for taming chimera states in two-layer multiplex networks. In the method, two agents are designed, where one is responsible for observing and controlling the accessible layer and the other dedicated to monitoring the target layer and adaptively adjusting the interlayer coupling strengths accordingly. Through cooperation, the two agents can achieve indirect control of the desired chimera state in the inaccessible target layer, despite being unavailable for direct access. The method employs the centralized training and decentralized execution framework, to overcome the difficulty of implementing control without simultaneous observation of all layers. Furthermore, pinning control is introduced when controlling the accessible layer. In this MASAC-based method combined with pinning control, the control mechanism of chimera states does not arise from synchronization, but relates to cooperation between two designed agents. Therefore, the method works even without the desired chimera state in the accessible layer. Results demonstrate the effectiveness and robustness of the MASAC-based method, both with and without pinning control, across varying system sizes and ratios of controlled nodes. The MASAC-based method combined with pinning control remains effective even when only 10% of the nodes in the accessible layer are actively controlled.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.20
自引率
9.10%
发文量
852
审稿时长
6.6 months
期刊介绍: Physica A: Statistical Mechanics and its Applications Recognized by the European Physical Society Physica A publishes research in the field of statistical mechanics and its applications. Statistical mechanics sets out to explain the behaviour of macroscopic systems by studying the statistical properties of their microscopic constituents. Applications of the techniques of statistical mechanics are widespread, and include: applications to physical systems such as solids, liquids and gases; applications to chemical and biological systems (colloids, interfaces, complex fluids, polymers and biopolymers, cell physics); and other interdisciplinary applications to for instance biological, economical and sociological systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信