Neural Networks最新文献

{"title":"Real-time fine finger motion decoding for transradial amputees with surface electromyography","authors":"Zihan Weng ,&nbsp;Yang Xiao ,&nbsp;Peiyang Li ,&nbsp;Chanlin Yi ,&nbsp;Pouya Bashivan ,&nbsp;Hailin Ma ,&nbsp;Guang Yao ,&nbsp;Yuan Lin ,&nbsp;Fali Li ,&nbsp;Dezhong Yao ,&nbsp;Jingming Hou ,&nbsp;Yangsong Zhang ,&nbsp;Peng Xu","doi":"10.1016/j.neunet.2025.107605","DOIUrl":"10.1016/j.neunet.2025.107605","url":null,"abstract":"<div><div>Advancements in human-machine interfaces (HMIs) are pivotal for enhancing rehabilitation technologies and improving the quality of life for individuals with limb loss. This paper presents a novel CNN-Transformer model for decoding continuous fine finger motions from surface electromyography (sEMG) signals by integrating the convolutional neural network (CNN) and Transformer architecture, focusing on applications for transradial amputees. This model leverages the strengths of both convolutional and Transformer architectures to effectively capture both local muscle activation patterns and global temporal dependencies within sEMG signals.</div><div>To achieve high-fidelity sEMG acquisition, we designed a flexible and stretchable epidermal array electrode sleeve (EAES) that conforms to the residual limb, ensuring comfortable long-term wear and robust signal capture, critical for amputees. Moreover, we presented a computer vision (CV) based multimodal data acquisition protocol that synchronizes sEMG recordings with video captures of finger movements, enabling the creation of a large, labeled dataset to train and evaluate the proposed model.</div><div>Given the challenges in acquiring reliable labeled data for transradial amputees, we adopted transfer learning and few-shot calibration to achieve fine finger motion decoding by leveraging datasets from non-amputated subjects. Extensive experimental results demonstrate the superior performance of the proposed model in various scenarios, including intra-session, inter-session, and inter-subject evaluations. Importantly, the system also exhibited promising zero-shot and few-shot learning capabilities for amputees, allowing for personalized calibration with minimal training data. The combined approach holds significant potential for advancing real-time, intuitive control of prostheses and other assistive technologies.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"190 ","pages":"Article 107605"},"PeriodicalIF":6.0,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144185014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A novel dynamic prescribed performance fuzzy-neural backstepping control for PMSM under step load","authors":"Xuechun Hu ,&nbsp;Yu Xia ,&nbsp;Zsófia Lendek ,&nbsp;Jinde Cao ,&nbsp;Radu-Emil Precup","doi":"10.1016/j.neunet.2025.107627","DOIUrl":"10.1016/j.neunet.2025.107627","url":null,"abstract":"<div><div>In order to meet the performance requirements of permanent magnet synchronous motor (PMSM) systems with time-varying model parameters and input constraints under step load, this paper proposes a dynamic prescribed performance fuzzy-neural backstepping control approach. Firstly, a novel finite-time asymmetric dynamic prescribed performance function (FADPPF) is proposed to tackle the issues of exceeding predefined error, control singularity, and system instability that arise in the traditional prescribed performance function under load changes. To address model accuracy degradation and control quality deterioration caused by nonlinear time-varying parameters and input constraints in the PMSM system, a backstepping controller is designed by combining the speed function (SF), fuzzy neural network (FNN), and the proposed FADPPF. The FNN approximates nonlinear uncertain functions in the system model; the SF, as an error amplification mechanism, works together with FADPPF to ensure the transient and steady-state performance of the system. The stability of the devised control strategy is proved using Lyapunov analysis. Finally, simulation results demonstrate the dynamic self-adjusting ability and effectiveness of FADPPF under step load. In addition, the feasibility and superiority of the proposed control scheme are validated.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"190 ","pages":"Article 107627"},"PeriodicalIF":6.0,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144169815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Cross-view self-supervised heterogeneous graph representation learning","authors":"Danfeng Zhao,&nbsp;Yanhao Chen,&nbsp;Wei Song,&nbsp;Qi He","doi":"10.1016/j.neunet.2025.107681","DOIUrl":"10.1016/j.neunet.2025.107681","url":null,"abstract":"<div><div>Heterogeneous graph neural networks (HGNNs) often face challenges in efficiently integrating information from multiple views, which hinders their ability to fully leverage complex data structures. To overcome this problem, we present an improved graph-level cross-attention mechanism specifically designed to enhance multi-view integration and improve the model's expressiveness in heterogeneous networks. By incorporating random walks, the Katz index, and Transformers, the model captures higher-order semantic relationships between nodes within the meta-path view. Node context information is extracted by decomposing the network and applying the attention mechanism within the network schema view. The improved graph-level cross-attention in the cross-view context adaptively fuses features from both views. Furthermore, a contrastive loss function is employed to select positive samples based on the local connection strength and global centrality of nodes, enhancing the model's robustness. The suggested self-supervised model performs exceptionally well in node classification and clustering tasks, according to experimental data, demonstrating the effectiveness of our method.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"190 ","pages":"Article 107681"},"PeriodicalIF":6.0,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144185015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A classification method of motor imagery based on brain functional networks by fusing PLV and ECSP","authors":"Chunling Fan,&nbsp;Yuebin Song,&nbsp;Xiaoqian Mao","doi":"10.1016/j.neunet.2025.107684","DOIUrl":"10.1016/j.neunet.2025.107684","url":null,"abstract":"<div><div>In order to enhance the decoding ability of brain states and evaluate the functional connection changes of relevant nodes in brain regions during motor imagery (MI), this paper proposes a brain functional network construction method which fuses edge features and node features. And we use deep learning methods to realize MI classification of left and right hand grasping tasks. Firstly, we use phase locking value (PLV) to extract edge features and input a weighted PLV to enhanced common space pattern (ECSP) to extract node features. Then, we fuse edge features and node features to construct a novel brain functional network. Finally, we construct an attention and multi-scale feature convolutional neural network (AMSF-CNN) to validate our method. The performance indicators of the brain functional network on the SHU_Dataset in the corresponding brain region will increase and be higher than those in the contralateral brain region when imagining one hand grasping. The average accuracy of our method reaches 79.65 %, which has a 25.85 % improvement compared to the accuracy provided by SHU_Dataset. By comparing with other methods on SHU_Dataset and BCI IV 2a Dataset, the average accuracies achieved by our method outperform other references. Therefore, our method provides theoretical support for exploring the working mechanism of the human brain during MI.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"190 ","pages":"Article 107684"},"PeriodicalIF":6.0,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144185016","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"DiverseReID: Towards generalizable person re-identification via Dynamic Style Hallucination and decoupled domain experts","authors":"Jieru Jia,&nbsp;Huidi Xie,&nbsp;Qin Huang,&nbsp;Yantao Song,&nbsp;Peng Wu","doi":"10.1016/j.neunet.2025.107602","DOIUrl":"10.1016/j.neunet.2025.107602","url":null,"abstract":"<div><div>Person re-identification (re-ID) models often fail to generalize well when deployed to other camera networks with domain shift. A classical domain generalization (DG) solution is to enhance the diversity of source data so that a model can learn more domain-invariant, and hence generalizable representations. Existing methods typically mix images from different domains in a mini-batch to generate novel styles, but the mixing coefficient sampled from predefined Beta distribution requires careful manual tuning and may render sub-optimal performance. To this end, we propose a plug-and-play Dynamic Style Hallucination (DSH) module that adaptively adjusts the mixing weights based on the style distribution discrepancy between image pairs, which is dynamically measured with the reciprocal of Wasserstein distances. This approach not only reduces the tedious manual tuning of parameters but also significantly enriches style diversity by expanding the perturbation space to the utmost. In addition, to promote inter-domain diversity, we devise a Domain Experts Decoupling (DED) loss, which constrains features from one domain to go towards the orthogonal direction against features from other domains. The proposed approach, dubbed DiverseReID, is parameter-free and computationally efficient. Without bells and whistles, it outperforms the state-of-the-art on various DG re-ID benchmarks. Experiments verify that style diversity, not just the size of the training data, is crucial for enhancing generalization.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"189 ","pages":"Article 107602"},"PeriodicalIF":6.0,"publicationDate":"2025-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144135130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Overlapping community detection via Layer-Jaccard similarity incorporated nonnegative matrix factorization","authors":"Zhijian Zhuo ,&nbsp;Bilian Chen","doi":"10.1016/j.neunet.2025.107601","DOIUrl":"10.1016/j.neunet.2025.107601","url":null,"abstract":"<div><div>As information modernization progresses, the connections between entities become more elaborate, forming more intricate networks. Consequently, the emphasis on community detection has transitioned from discerning disjoint communities towards the identification of overlapping communities. A variety of algorithms based on the sparse adjacency matrix, which are sensitive to edge connections, are suitable for detecting edge-sparse areas between overlapping communities but lack the ability to detect edge-dense areas within the overlapping communities. Additionally, most algorithms do not take into account multihop information. To mitigate the aforementioned limitations, we propose an innovative approach termed Layer-Jaccard similarity incorporated nonnegative matrix factorization (LJSINMF), which utilizes both the adjacency matrix and the Layer-Jaccard similarity matrix. Our method initially employs a newly proposed Onion-shell method to decompose the network into layers. Subsequently, the layer of each node is used to construct a Layer-Jaccard similarity matrix, which facilitates the identification of edge-dense areas within the overlapping communities and serves as a general approach for enhancing other nonnegative matrix factorization-based algorithms. Ultimately, we integrate the adjacency matrix and the Layer-Jaccard similarity matrix into the nonnegative matrix factorization framework to determine the node-community membership matrix. Moreover, integrating the Layer-Jaccard similarity matrix into other algorithms is a promising approach to enhance their performance. Comprehensive experiments have been conducted on real-world networks and the results substantiate that the LJSINMF algorithm outperforms most state-of-the-art baseline methods in terms of three evaluation metrics.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"189 ","pages":"Article 107601"},"PeriodicalIF":6.0,"publicationDate":"2025-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144170220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Towards better text image machine translation with multimodal codebook and multi-stage training","authors":"Zhibin Lan ,&nbsp;Jiawei Yu ,&nbsp;Shiyu Liu ,&nbsp;Junfeng Yao ,&nbsp;Degen Huang ,&nbsp;Jinsong Su","doi":"10.1016/j.neunet.2025.107599","DOIUrl":"10.1016/j.neunet.2025.107599","url":null,"abstract":"<div><div>As a widely-used machine translation task, text image machine translation (TIMT) aims to translate the source texts embedded in the image to target translations. However, studies in this aspect face two challenges: (1) constructed in a cascaded manner, dominant models suffer from the error propagation of optical character recognition (OCR), and (2) they lack publicly available large-scale datasets. To deal with these issues, we propose a multimodal codebook based TIMT model. In addition to a text encoder, an image encoder, and a text decoder, our model is equipped with a multimodal codebook that effectively associates images with relevant texts, thus providing useful supplementary information for translation. Particularly, we present a multi-stage training framework to fully exploit various datasets to effectively train our model. Concretely, we first conduct preliminary training on the text encoder and decoder using bilingual texts. Subsequently, via an additional code-conditioned mask translation task, we use the bilingual texts to continuously train the text encoder, multimodal codebook, and decoder. Afterwards, by further introducing an image-text alignment task and adversarial training, we train the whole model except for the text decoder on the OCR dataset. Finally, through the above training tasks except for text translation, we adopt a TIMT dataset to fine-tune the whole model. Besides, we manually annotate a Chinese-English TIMT dataset, named OCRMT30K, and extend it to Chinese-German TIMT dataset through an automatic translation tool. To the best of our knowledge, it is the first public manually-annotated TIMT dataset, which facilitates future studies in this task. To investigate the effectiveness of our model, we conduct extensive experiments on Chinese-English and Chinese-German TIMT tasks. Experimental results and in-depth analyses strongly demonstrate the effectiveness of our model. We release our code and dataset on <span><span>https://github.com/DeepLearnXMU/mc_tit</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"189 ","pages":"Article 107599"},"PeriodicalIF":6.0,"publicationDate":"2025-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144139614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"HMgNO: Hybrid multigrid neural operator with low-order numerical solver for partial differential equations","authors":"Yifan Hu ,&nbsp;Weimin Zhang ,&nbsp;Fukang Yin ,&nbsp;Jianping Wu","doi":"10.1016/j.neunet.2025.107649","DOIUrl":"10.1016/j.neunet.2025.107649","url":null,"abstract":"<div><div>Traditional numerical methods face a trade-off between computational cost and accuracy when solving partial differential equations. Low-order solvers are fast but less accurate, while high-order solvers are accurate but much slower. To address this challenge, we propose a novel framework, the hybrid multigrid neural operator (HMgNO). The HMgNO couples a low-order numerical solver with a multigrid neural operator, and the neural operator is used to correct the low-order numerical solutions to obtain high-order accuracy at each fixed time step size. Thus, the HMgNO achieves accurate solutions while ensuring computational efficiency. Moreover, our framework supports multiple types of low-order numerical solvers, such as finite difference and spectral methods. Experiments on the Navier-Stokes, shallow-water, and diffusion-reaction equations demonstrate that the proposed framework achieves the lowest relative error and smallest spectral bias with few model parameters and fast inference speed.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"190 ","pages":"Article 107649"},"PeriodicalIF":6.0,"publicationDate":"2025-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144185013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Enhancing image-based virtual try-on with Multi-Controlled Diffusion Models","authors":"Weihao Luo ,&nbsp;Zezhen Zeng ,&nbsp;Yueqi Zhong","doi":"10.1016/j.neunet.2025.107552","DOIUrl":"10.1016/j.neunet.2025.107552","url":null,"abstract":"<div><div>Image-based virtual try-on technology digitally overlays clothing onto images of individuals, enabling users to preview how garments fit without physical trial, thus enhancing the online shopping experience. While current diffusion-based virtual try-on networks produce high-quality results, they struggle to accurately render garments with textual designs such as logos or prints which are widely prevalent in the real world, often carrying significant brand and cultural identities. To address this challenge, we introduce the Multi-Controlled Diffusion Models for Image-based Virtual Try-On (MCDM-VTON), a novel approach that synergistically incorporates global image features and local textual features extracted from garments to control the generation process. Specifically, we innovatively introduce an Optical Character Recognition (OCR) model to extract the text-style textures from clothing, utilizing the information gathered as text features. These features, in conjunction with the inherent global image features through a multimodal feature fusion module based on cross-attention, jointly control the denoising process of the diffusion models. Moreover, by extracting text information from both the generated virtual try-on results and the original garment images with the OCR model, we have devised a new content-style loss to supervise the training of diffusion models, thereby reinforcing the generation effect of text-style textures. Extensive experiments demonstrate that MCDM-VTON significantly outperforms existing state-of-the-art methods in terms of text preservation and overall visual quality.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"189 ","pages":"Article 107552"},"PeriodicalIF":6.0,"publicationDate":"2025-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144123671","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"VKAD: A novel fault detection and isolation model for uncertainty-aware industrial processes","authors":"Shengbin Zheng,&nbsp;Dechang Pi","doi":"10.1016/j.neunet.2025.107664","DOIUrl":"10.1016/j.neunet.2025.107664","url":null,"abstract":"<div><div>Fault detection and isolation (FDI) are essential for effective monitoring of industrial processes. Modern industrial processes involve dynamic systems characterized by complex, high-dimensional nonlinearities, posing significant challenges for accurate modeling and analysis. Recent studies have employed deep learning methods to capture and model these complexities in dynamic systems. In contrast, Koopman operator theory offers an alternative perspective, as the Koopman operator describes the linear evolution of observables in nonlinear systems within a high-dimensional space. This linearization simplifies complex nonlinear dynamics, making them easier to analyze and interpret in higher-dimensional settings. However, the Koopman operator theory does not inherently incorporate uncertainties in dynamical systems, which can hinder its performance in process monitoring. To tackle this issue, we integrate Koopman operator theory with Variational Autoencoders to propose a novel fault detection and isolation model called the Variational Koopman Anomaly Detector (VKAD). VKAD is capable of inferring the distribution of observables from time series data of dynamical systems. By advancing the distribution through the Koopman operator over time, VKAD can capture the uncertainty in the evolution of dynamic systems. The uncertainty estimates yielded by VKAD are applicable for both fault detection and isolation in industrial processes. The effectiveness of the proposed VKAD were illustrated using the Tennessee Eastman Process (TEP) and a real satellite on-orbit telemetry dataset (SAT). The experimental results demonstrate that the Fault Detection Rate (FDR) of VKAD achieves superior performance on both the TEP and SAT datasets compared to advanced methods, while the Fault Alarm Rate (FAR) is also highly competitive.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"189 ","pages":"Article 107664"},"PeriodicalIF":6.0,"publicationDate":"2025-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144139615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}