Chenyang Bian, Zhipeng Zhang, Leihao Du, Zengqiang Chen
{"title":"Optimal state-flipped control and learning for synchronization of probabilistic Boolean networks.","authors":"Chenyang Bian, Zhipeng Zhang, Leihao Du, Zengqiang Chen","doi":"10.1016/j.isatra.2025.05.041","DOIUrl":null,"url":null,"abstract":"<p><p>This paper studies the synchronization with probability 1 in Probabilistic Boolean Networks (PBNs) by combining optimal state-flipped control and Q-learning. Within the framework of the Semi-Tensor Product (STP), the synchronization problem is transformed into a set stabilization problem, and the verification criteria are proposed to achieve synchronization. To improve computational efficiency, a reachable set criterion based on state-flipping is introduced, leading to the development of an algorithm for identifying optimal flipping sequences. For large-scale PBNs, a two-step Q-learning-based optimization strategy is proposed: the first step generates the Q-table, and the second step enumerates all optimal state-flipping sequences that reach the synchronization set, thus reducing the computational complexity of the synchronization problem for large-scale PBNs. Finally, numerical simulations demonstrate the effectiveness and practicality of the proposed methods.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISA transactions","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.isatra.2025.05.041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This paper studies the synchronization with probability 1 in Probabilistic Boolean Networks (PBNs) by combining optimal state-flipped control and Q-learning. Within the framework of the Semi-Tensor Product (STP), the synchronization problem is transformed into a set stabilization problem, and the verification criteria are proposed to achieve synchronization. To improve computational efficiency, a reachable set criterion based on state-flipping is introduced, leading to the development of an algorithm for identifying optimal flipping sequences. For large-scale PBNs, a two-step Q-learning-based optimization strategy is proposed: the first step generates the Q-table, and the second step enumerates all optimal state-flipping sequences that reach the synchronization set, thus reducing the computational complexity of the synchronization problem for large-scale PBNs. Finally, numerical simulations demonstrate the effectiveness and practicality of the proposed methods.