Chenyang Bian, Zhipeng Zhang, Leihao Du, Zengqiang Chen
{"title":"概率布尔网络同步的最优状态翻转控制与学习。","authors":"Chenyang Bian, Zhipeng Zhang, Leihao Du, Zengqiang Chen","doi":"10.1016/j.isatra.2025.05.041","DOIUrl":null,"url":null,"abstract":"<p><p>This paper studies the synchronization with probability 1 in Probabilistic Boolean Networks (PBNs) by combining optimal state-flipped control and Q-learning. Within the framework of the Semi-Tensor Product (STP), the synchronization problem is transformed into a set stabilization problem, and the verification criteria are proposed to achieve synchronization. To improve computational efficiency, a reachable set criterion based on state-flipping is introduced, leading to the development of an algorithm for identifying optimal flipping sequences. For large-scale PBNs, a two-step Q-learning-based optimization strategy is proposed: the first step generates the Q-table, and the second step enumerates all optimal state-flipping sequences that reach the synchronization set, thus reducing the computational complexity of the synchronization problem for large-scale PBNs. Finally, numerical simulations demonstrate the effectiveness and practicality of the proposed methods.</p>","PeriodicalId":94059,"journal":{"name":"ISA transactions","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal state-flipped control and learning for synchronization of probabilistic Boolean networks.\",\"authors\":\"Chenyang Bian, Zhipeng Zhang, Leihao Du, Zengqiang Chen\",\"doi\":\"10.1016/j.isatra.2025.05.041\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This paper studies the synchronization with probability 1 in Probabilistic Boolean Networks (PBNs) by combining optimal state-flipped control and Q-learning. Within the framework of the Semi-Tensor Product (STP), the synchronization problem is transformed into a set stabilization problem, and the verification criteria are proposed to achieve synchronization. To improve computational efficiency, a reachable set criterion based on state-flipping is introduced, leading to the development of an algorithm for identifying optimal flipping sequences. For large-scale PBNs, a two-step Q-learning-based optimization strategy is proposed: the first step generates the Q-table, and the second step enumerates all optimal state-flipping sequences that reach the synchronization set, thus reducing the computational complexity of the synchronization problem for large-scale PBNs. Finally, numerical simulations demonstrate the effectiveness and practicality of the proposed methods.</p>\",\"PeriodicalId\":94059,\"journal\":{\"name\":\"ISA transactions\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-05-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISA transactions\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1016/j.isatra.2025.05.041\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISA transactions","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.isatra.2025.05.041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Optimal state-flipped control and learning for synchronization of probabilistic Boolean networks.
This paper studies the synchronization with probability 1 in Probabilistic Boolean Networks (PBNs) by combining optimal state-flipped control and Q-learning. Within the framework of the Semi-Tensor Product (STP), the synchronization problem is transformed into a set stabilization problem, and the verification criteria are proposed to achieve synchronization. To improve computational efficiency, a reachable set criterion based on state-flipping is introduced, leading to the development of an algorithm for identifying optimal flipping sequences. For large-scale PBNs, a two-step Q-learning-based optimization strategy is proposed: the first step generates the Q-table, and the second step enumerates all optimal state-flipping sequences that reach the synchronization set, thus reducing the computational complexity of the synchronization problem for large-scale PBNs. Finally, numerical simulations demonstrate the effectiveness and practicality of the proposed methods.