{"title":"A Fully Decentralized Online Actor-Critic Algorithm for Constrained Multiagent Reinforcement Learning Over Directed Graphs.","authors":"Zirui Jiao, Wenwu Yu, He Wang","doi":"10.1109/TCYB.2026.3715812","DOIUrl":"10.1109/TCYB.2026.3715812","url":null,"abstract":"<p><p>This article studies constrained multiagent reinforcement learning (C-MARL) over fixed directed graphs, where agents cooperatively optimize a globally averaged long-term objective while satisfying globally averaged constraints. To address the challenges of decentralized learning with a row-stochastic communication matrix, we propose a fully decentralized online actor-critic (AC) algorithm with Perron-vector normalization. Each agent updates its policy parameters, critic parameters, and local multiplier estimates based on local information received from its in-neighbors. Convergence guarantees are established under linear function approximation for the critic. Numerical simulations demonstrate the effectiveness and robustness of the proposed algorithm.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":11.3,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148677943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fault Decoupling Through State Estimation Using Observer-Based Physics-Informed Neural Network.","authors":"Vijayakumar Muthusamy, Ines Chihi","doi":"10.1109/TCYB.2026.3718151","DOIUrl":"10.1109/TCYB.2026.3718151","url":null,"abstract":"<p><p>In the context of fault diagnosis in smart manufacturing, fault decoupling has become a critical component, enabling systems to distinguish between various sources of anomalies, such as actuator faults, sensor faults, and external disturbances. This article proposes a joint state and fault estimation for linear time-invariant (LTI) systems affected by multiple faults and disturbances. First, the design of dual proportional-integral fading unknown input observers (PIFUIOs) is implemented to estimate the system states and fault signals under a structurally decoupled framework. Necessary and sufficient conditions are derived to guarantee the existence of the observers and to ensure mutual decoupling between faults and disturbances. Next, a physics-informed neural network (PINN) is framed, in which the loss functions are constructed based on the observer design to enhance estimation accuracy and incorporate physical knowledge of the observer into the learning process. In addition, sufficient conditions based on Lyapunov stability theory to ensure asymptotic convergence and attenuation of faults and disturbances are formulated using linear matrix inequalities (LMIs). Finally, the effectiveness of the proposed approach is validated via a DC motor model.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":11.3,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148678252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Prescribed-Time Performance-Based Data-Driven Control of Permanent Magnet Linear Motors: A Resilient Hierarchical Approach.","authors":"Yuan-Xin Li, Wen Tan, Zhongsheng Hou","doi":"10.1109/TCYB.2026.3716721","DOIUrl":"10.1109/TCYB.2026.3716721","url":null,"abstract":"<p><p>This article investigates coordinated velocity tracking control for heterogeneous permanent magnet linear motors (PMLMs) under actuator faults and denial-of-service (DoS) attacks. Parameter heterogeneity, actuator degradation, and communication failures jointly threaten system stability and tracking accuracy. A prescribed-time performance-based hierarchical resilient adaptive data-driven control strategy is proposed to solve the formulated issue. First, a distributed resilient prescribed-time observer is designed to estimate the time-varying virtual reference velocity despite intermittent communication failures caused by DoS attacks. Subsequently, using the dynamic linearization (DL) method, the ideal controller is converted into an equivalent data model that relies solely on input/output (I/O) data, bypassing the need for accurate PMLM models. By introducing a global prescribed-time performance function (PTPF), the constrained velocity tracking errors are transformed into equivalent unconstrained conditions. Based on the estimated reference signal, a decentralized controller-dynamic-linearization (CDL)-based fuzzy adaptive tracking controller is designed, in which the unknown fault-related nonlinear term is approximated using a fuzzy logic system to compensate for actuator fault effects. The prescribed-time stabilization of the observation error and velocity tracking error is validated by Lyapunov stability analysis and contraction mapping techniques. Finally, simulation examples confirm the effectiveness of the proposed scheme.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":11.3,"publicationDate":"2026-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148678318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sliding Mode Control for 2-D FMII Networked System Under Partially Known Fading Channel Information","authors":"Zheng Zhou, Guangchen Zhang, Shuping He, Xudong Zhao, Yuanqing Xia, Fengjuan Zhu","doi":"10.1109/tcyb.2026.3716786","DOIUrl":"https://doi.org/10.1109/tcyb.2026.3716786","url":null,"abstract":"","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"58 1","pages":""},"PeriodicalIF":11.8,"publicationDate":"2026-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148682412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jiang-Tao Chen, Zi-Jia Wang, Wei-Jie Yu, Tian-Fang Zhao, Zhi-Hui Zhan, Sam Kwong, Jun Zhang
{"title":"Diffusion-Based Knowledge Transfer for Multitask Optimization.","authors":"Jiang-Tao Chen, Zi-Jia Wang, Wei-Jie Yu, Tian-Fang Zhao, Zhi-Hui Zhan, Sam Kwong, Jun Zhang","doi":"10.1109/TCYB.2026.3711601","DOIUrl":"10.1109/TCYB.2026.3711601","url":null,"abstract":"<p><p>Evolutionary multitask optimization (EMTO) aims to optimize multiple tasks simultaneously by transferring the related knowledge between tasks. Therefore, knowledge transfer (KT) between different tasks is crucial for facilitating the optimization of tasks. The traditional KT methods in EMTO achieve superficial KT through individual transfers, limiting their ability to transfer high-quality knowledge from other tasks. Therefore, in this article, a diffusion model-based KT (DMKT) method built specifically on cold diffusion (CD) is proposed to deeply mine the mapping relationships between different tasks and obtain transfer models for mapping individuals across tasks. Since CD supports arbitrary degradation operators, the interpolation between fitness-paired source and target task individuals can be defined as a task-oriented gradual degradation process, enabling the corresponding restoration process to learn directed cross-task mappings. In particular, we first construct two cyclic training diffusion models (DMs) for each source-target task pair. Subsequently, the trained DM can be used to generate new promising solutions for achieving efficient KT. The experimental results on the CEC2022 multitask optimization problem (MTOP) benchmark demonstrate that the proposed diffusion-based KT multitask optimization (DKTMTO) algorithm outperforms other state-of-the-art EMTO algorithms. Moreover, DMKT can be integrated into other EMTO algorithms to further improve their performance. Finally, DKTMTO is applied to real-world multitask planar kinematic arm control problems (PKACPs) and the WCCI2020 many-task optimization problem (MaTOP) benchmark, demonstrating its applicability and scalability.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":11.3,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148669282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Stochastic Watermarking Protection Strategy for CPSs Under Linear Stealthy Attacks.","authors":"Pengyu Li, Dan Ye, Fang Wei","doi":"10.1109/TCYB.2026.3716941","DOIUrl":"https://doi.org/10.1109/TCYB.2026.3716941","url":null,"abstract":"<p><p>This article investigates the stochastic watermarking protection strategy for cyber-physical systems (CPSs) in the presence of linear stealthy attacks. Unlike deterministic watermarking, stochastic watermarking strategies are developed to counteract scenarios where watermarking signals are deciphered. More specifically, attackers aim to inject attack signals into the vulnerabilities of stochastic watermarking strategies, while defenders intend to intercept attack signals as much as possible. Using zero-sum game theory, we investigate the interactive decision-making process between both sides, proving that the equilibrium strategy depends on maximum attack/defense probabilities and time-varying watermarking parameters. Furthermore, we also present criteria for selecting watermarking parameters to reduce the attacker's payoff. In particular, if the attack probability is not an unknown variable, the proposed defense strategy remains effective. Finally, the validity of the theoretical results is demonstrated through simulation examples.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":11.3,"publicationDate":"2026-08-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148669267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fixed-Time Fault-Tolerant Control for Wastewater Treatment Processes With Asymmetric State Constraints","authors":"Hong-Gui Han;Han-Qian Hou;Hao-Yuan Sun;Jun-Fei Qiao","doi":"10.1109/TCYB.2026.3683543","DOIUrl":"10.1109/TCYB.2026.3683543","url":null,"abstract":"In wastewater treatment processes (WWTPs), the presence of aeration equipment faults (actuator faults) prevents the desired tracking control effect of the state-constrained dissolved oxygen concentration (DOC). To solve this problem, an adaptive fixed-time fault-tolerant control (AFTFTC) strategy based on the asymmetric integral barrier Lyapunov function (AIBLF) is developed in this article. First, in order to directly consider asymmetric state constraints in the controller design process, an AIBLF is constructed. Second, a fixed-time FTC method is proposed to compensate for the effects of actuator faults on DOC regulation and achieve fast tracking of the DOC setpoint. Specifically, the adaptive compensation term with DOC asymmetric constraint boundaries is used to estimate the unknown boundary of the actuator bias fault (BF). Furthermore, it is proven that the designed controller can ensure the fixed-time stability of the closed-loop system. Finally, the validity of the control strategy is validated on the benchmark simulation model 1 (BSM1).","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"56 8","pages":"4229-4241"},"PeriodicalIF":11.3,"publicationDate":"2026-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147731500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reputation-Aware Distributed Filtering for Nonlinear Bias-Corrupted Systems Over Sensor Networks Under Event-Triggered Mechanism","authors":"Chaoqing Jia, Zidong Wang, Jun Hu, Hongli Dong","doi":"10.1109/tcyb.2026.3709744","DOIUrl":"https://doi.org/10.1109/tcyb.2026.3709744","url":null,"abstract":"","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"13 1","pages":""},"PeriodicalIF":11.8,"publicationDate":"2026-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148633969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}