Wandong Zhang, Yimin Yang, Thangarajah Akilan, Q M Jonathan Wu, Tianlong Liu
{"title":"Fast Transfer Learning Method Using Random Layer Freezing and Feature Refinement Strategy.","authors":"Wandong Zhang, Yimin Yang, Thangarajah Akilan, Q M Jonathan Wu, Tianlong Liu","doi":"10.1109/TCYB.2024.3483068","DOIUrl":"10.1109/TCYB.2024.3483068","url":null,"abstract":"<p><p>Recently, Moore-Penrose inverse (MPI)-based parameter fine-tuning of fully connected (FC) layers in pretrained deep convolutional neural networks (DCNNs) has emerged within the inductive transfer learning (ITL) paradigm. However, this approach has not gained significant traction in practical applications due to its stringent computational requirements. This work addresses this issue through a novel fast retraining strategy that enhances applicability of the MPI-based ITL. Specifically, during each retraining epoch, a random layer freezing protocol is utilized to manage the number of layers undergoing feature refinement. Additionally, this work incorporates an MPI-based approach for refining the trainable parameters of FC layers under batch processing, contributing to expedited convergence. Extensive experiments on several ImageNet pretrained benchmark DCNNs demonstrate that the proposed ITL achieves competitive performance with excellent convergence speed compared to conventional ITL methods. For instance, the proposed strategy converges nearly 1.5 times faster than retraining the ImageNet pretrained ResNet-50 using stochastic gradient descent with momentum (SGDM).</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545173","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haisheng Xia, Ming Pi, Lingjing Jin, Rong Song, Zhijun Li
{"title":"Human Collaborative Control of Lower-Limb Prosthesis Based on Game Theory and Fuzzy Approximation.","authors":"Haisheng Xia, Ming Pi, Lingjing Jin, Rong Song, Zhijun Li","doi":"10.1109/TCYB.2024.3483148","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3483148","url":null,"abstract":"<p><p>For leg prosthesis user, the soft tissue and skin under the stump of are not accustomed to weight bearing, excessive continuous contact pressure can lead to the risk of degenerative tissue ulceration. This article presents a novel human-robot collaborative control scheme that achieves control weight self-adjustment for robotic prostheses to minimize interaction torque. To establish the human-robot interaction relationship, we regard the contact pressure between human residual limb and the prosthetic receiving cavity as the interaction force. We aim at reducing the interaction force under the premise of minimally changing the original motion trajectory of the robotic prosthesis. The control scheme mainly includes trajectory optimization based on a dual-agent game control scheme under a cooperative relationship, and a fuzzy logic system for improving the control accuracy of trajectory tracking of robotic prostheses with unknown dynamic parameters. Experiments were carried out on two amputee participants to verify the proposed human-robot interactive control scheme in a robotic prosthesis. The results show that the interaction torque could be reduced while maintaining minimal trajectory tracking error. The proposed control scheme could potentially facilitate the dexterous manipulation of leg prostheses, thus benefiting amputees.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Patch-Based Method for Underwater Image Enhancement With Denoising Diffusion Models.","authors":"Haisheng Xia, Binglei Bao, Fei Liao, Jintao Chen, Binglu Wang, Zhijun Li","doi":"10.1109/TCYB.2024.3482174","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3482174","url":null,"abstract":"<p><p>The enhancement of underwater images has emerged as a significant technological challenge in advancing marine research and exploration tasks. Due to the scattering of suspended particles and absorption of light in underwater environments, underwater images tend to present blurriness and predominantly color distortion. In this study, we propose a novel approach utilizing denoising diffusion models to improve underwater degraded images. After training the noise estimation network of the denoising diffusion models, we accelerate the deterministic sampling process with denoising diffusion implicit models. We also propose a patch-based method by implementing average sampling between overlapping image patches at each sampling step, enabling the generation of images at arbitrary resolution while preserving their natural appearance and details. Through benchmark experiments, we illustrate that our method outperforms or closely approaches state-of-the-art techniques in terms of effectiveness and performance. We demonstrate that our approach reduces the interference of underwater environments with the semantic information of the images by salient object detection experiments.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jun Cheng, Jiangming Xu, Huaicheng Yan, Zheng-Guang Wu, Wenhai Qi
{"title":"Neural Network-Based Sliding Mode Control for Semi-Markov Jumping Systems With Singular Perturbation.","authors":"Jun Cheng, Jiangming Xu, Huaicheng Yan, Zheng-Guang Wu, Wenhai Qi","doi":"10.1109/TCYB.2024.3481870","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3481870","url":null,"abstract":"<p><p>The primary focus of this article centers around the application of sliding mode control (SMC) to semi-Markov jumping systems, incorporating a dynamic event-triggered protocol (ETP) and singular perturbation. The underlying semi-Markov singularly perturbed systems (SMSPSs) exhibit mode switching behavior governed by a semi-Markov process, wherein the variation of this process is regulated by a deterministic switching signal. To simultaneously reduce the triggering rate and uphold the system performance, a novel parameter-based dynamic ETP is established. This protocol incorporates weight estimation of a radial basis function neural network (RBFNN) and introduces two internal dynamic variables. Following the Lyapunov's theory, sufficient criteria are established for ensuring the mean-square exponential stability of the resulting system. Additionally, an SMC scheme based on the convergence factor is designed to fulfill reachability conditions. Finally, two examples are carried out to validate the solvability and applicability of the attained control methodology.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142545175","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adjustable Jacobi-Fourier Moment for Image Representation.","authors":"Jianwei Yang, Xin Yuan, Xiaoqi Lu, Yuan Yan Tang","doi":"10.1109/TCYB.2024.3482352","DOIUrl":"10.1109/TCYB.2024.3482352","url":null,"abstract":"<p><p>The widely adopted Jacobi-Fourier moment (JFM) is limited by its inability to effectively capture spatial information. Although fractional-order JFM ( FOJFM) introduces spatial information through a fractional-order parameter, the control of spatial information remains inadequate. This limitation stems from the insufficient control over zeros distribution associated with the used moment's radial kernel. To address this issue, we generalize both JFM and FOJFM into a transformed JFM. A transformed function with four parameters is designed, and adjustable JFM (AJFM) is proposed. Two parameters correlate to increasing velocities on the left and right parts of the transformed functions, enabling zeros quantities of radial kernel fall in the left and right parts of the interval. The other two parameters segment the transformed function, adjusting regions where different quantities of zeros fall in. This refined control over the radial kernel's zero distribution enhances the versatility of feature extraction by the AJFM, governed by the introduced parameters. Experimental results demonstrate that AJFM, with properly chosen parameters, can emphasize specific regions within an image more effectively.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142521790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Periodic Event-Triggered Model Predictive Control for Networked Nonlinear Uncertain Systems With Disturbances.","authors":"Jiangtong Wang, Jiankun Sun, Jun Yang, Shihua Li","doi":"10.1109/TCYB.2024.3472284","DOIUrl":"10.1109/TCYB.2024.3472284","url":null,"abstract":"<p><p>This article investigates the event-triggered model predictive control (MPC) problem for a class of networked nonlinear uncertain systems subject to time-varying disturbances. Different from the traditional MPC, the proposed periodic event-triggered MPC (PETMPC) method does not generate new control sequence unless a predesigned periodic event-triggering mechanism (PETM) is violated. First, a generalized proportional-integral observer (GPIO) is developed to estimate the unknown state and disturbance information by using the sampled-data output of controlled system. Then, the disturbance predictions for future finite steps are obtained based on forward Euler method. After that, with the help of prediction model, the optimal control sequence, including the future finite step predicted control inputs, is generated and dexterously exploited during the interevent interval by storing it in a buffer installed between the control sequence generator and actuator, thereby leading to the further reduction of signal transmission number and the frequency of control sequence computations. Through a rigorous stability analysis, it can be proved that the closed-loop hybrid control system is globally bounded stable under the nominal PETMPC law. Finally, numerical simulations are conducted to substantiate the feasibility and superiority of the proposed PETMPC method.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142406370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Semi-Global Stabilization of Discrete-Time Linear Systems Subject to Infinite Distributed Input Delays and Actuator Saturations.","authors":"Yige Guo, Xiang Xu, Lu Liu, Yong Wang, Gang Feng","doi":"10.1109/TCYB.2024.3465437","DOIUrl":"10.1109/TCYB.2024.3465437","url":null,"abstract":"<p><p>The semi-global stabilization problem of discrete-time systems subject to infinite distributed input delays and actuator saturations is investigated in this article. This article develops two low-gain feedback control laws for two types of systems, respectively. It is shown that the resulting system is semi-globally exponentially stabilized. Our results include those existing results on systems subject to only input saturations and systems subject to bounded delays and input saturations as special cases. Compared with existing results on infinite delays and actuator saturations, this article develops a more accurate scaling utilizing a more general framework. Furthermore, a novel converse Lyapunov theorem for discrete-time linear infinite-delayed systems and a novel stability analysis theorem for perturbed discrete-time linear infinite-delayed systems are developed to handle the nonlinearity induced by saturations. Finally, this article provides two numerical examples to illustrate the effectiveness of the developed theorems.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142406371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Digital-Twin Predictive Control of Nonlinear Systems With Time Delays, Unknown Dynamics, and Communication Delays.","authors":"Guo-Ping Liu","doi":"10.1109/TCYB.2024.3471608","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3471608","url":null,"abstract":"<p><p>With the advancement of computing technology and big data technology, digital twins have gradually been applied in various fields, such as manufacturing, energy, and healthcare. This article studies the predictive control of nonlinear dynamic systems using digital twins. Based on a digital-twin control system framework, predictive control is discussed for three different nonlinear systems with time delays: 1) known nonlinear systems; 2) unknown nonlinear systems; and 3) unknown nonlinear cyber-physical systems. Both a digital-twin predictive control strategy and a digital-twin control predictor are proposed to compensate for time delays and communication delays actively. With the strategy and predictor, the digital-twin controller of a time-delay nonlinear system can be designed to achieve the desired performance based on the nonlinear system without time delays, which vastly simplifies the controller design procedure. A digital model is constructed using data to deal with unknown nonlinear dynamics. The three different closed-loop digital-twin predictive control systems are analyzed to derive a unified stability criterion. The simulation results show how the proposed digital-twin predictive control method performs well for nonlinear systems with time delays, unknown dynamics, and/or communication delays.</p>","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"PP ","pages":""},"PeriodicalIF":9.4,"publicationDate":"2024-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142400196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiwang Dong;Zhiyong Chen;Ming Cao;Wei Ren;Huaguang Zhang;Danwei Wang
{"title":"Guest Editorial Special Issue on Robust Cooperative Control for Heterogeneous Nonlinear Multiagent Systems","authors":"Xiwang Dong;Zhiyong Chen;Ming Cao;Wei Ren;Huaguang Zhang;Danwei Wang","doi":"10.1109/TCYB.2024.3465688","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3465688","url":null,"abstract":"","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"54 10","pages":"5595-5597"},"PeriodicalIF":9.4,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10712179","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142397119","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"IEEE Transactions on Cybernetics","authors":"","doi":"10.1109/TCYB.2024.3466673","DOIUrl":"https://doi.org/10.1109/TCYB.2024.3466673","url":null,"abstract":"","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"54 10","pages":"C3-C3"},"PeriodicalIF":9.4,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10712155","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142397123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}