Frontiers in Neurorobotics最新文献

筛选
英文 中文
UHGAN: a dual-phase GAN with Hough-transform constraints for accurate farmland road extraction. UHGAN:一种具有hough变换约束的双相GAN,用于农田道路的精确提取。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-10-13 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1691300
Xinliang Wang, Yuan Ma
{"title":"UHGAN: a dual-phase GAN with Hough-transform constraints for accurate farmland road extraction.","authors":"Xinliang Wang, Yuan Ma","doi":"10.3389/fnbot.2025.1691300","DOIUrl":"10.3389/fnbot.2025.1691300","url":null,"abstract":"<p><strong>Introduction: </strong>Traditional methods for farmland road extraction, such as U-Net, often struggle with complex noise and geometric features, leading to discontinuous extraction and insufficient sensitivity. To address these limitations, this study proposes a novel dual-phase generative adversarial network (GAN) named UHGAN, which integrates Hough-transform constraints.</p><p><strong>Methods: </strong>We designed a cascaded U-Net generator within a two-stage GAN framework. The Stage 1 GAN combines a differentiable Hough transform loss with cross-entropy loss to generate initial road masks. Subsequently, the Stage 2 U-Net refines these masks by repairing breakpoints and suppressing isolated noise.</p><p><strong>Results: </strong>When evaluated on the WHU RuR+rural road dataset, the proposed UHGAN method achieved an accuracy of 0.826, a recall of 0.750, and an F1-score of 0.789. This represents a significant improvement over the single-stage U-Net (F1 = 0.756) and ResNet (F1 = 0.762) baselines.</p><p><strong>Discussion: </strong>The results demonstrate that our approach effectively mitigates the issues of discontinuous extraction caused by the complex geometric shapes and partial occlusion characteristic of farmland roads. The integration of Hough-transform loss, an technique that has received limited attention in prior studies, proves to be highly beneficial. This method shows considerable promise for practical applications in rural infrastructure planning and precision agriculture.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1691300"},"PeriodicalIF":2.8,"publicationDate":"2025-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12554662/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145388587","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
UAV-based intelligent traffic surveillance using recurrent neural networks and Swin transformer for dynamic environments. 基于循环神经网络和Swin变压器的动态环境下无人机智能交通监控。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-10-13 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1681341
Mohammed Alshehri, Ting Wu, Nouf Abdullah Almujally, Yahya AlQahtani, Muhammad Hanzla, Ahmad Jalal, Hui Liu
{"title":"UAV-based intelligent traffic surveillance using recurrent neural networks and Swin transformer for dynamic environments.","authors":"Mohammed Alshehri, Ting Wu, Nouf Abdullah Almujally, Yahya AlQahtani, Muhammad Hanzla, Ahmad Jalal, Hui Liu","doi":"10.3389/fnbot.2025.1681341","DOIUrl":"10.3389/fnbot.2025.1681341","url":null,"abstract":"<p><strong>Introduction: </strong>Urban traffic congestion, environmental degradation, and road safety challenges necessitate intelligent aerial robotic systems capable of real-time adaptive decision-making. Unmanned Aerial Vehicles (UAVs), with their flexible deployment and high vantage point, offer a promising solution for large-scale traffic surveillance in complex urban environments. This study introduces a UAV-based neural framework that addresses challenges such as asymmetric vehicle motion, scale variations, and spatial inconsistencies in aerial imagery.</p><p><strong>Methods: </strong>The proposed system integrates a multi-stage pipeline encompassing contrast enhancement and region-based clustering to optimize segmentation while maintaining computational efficiency for resource-constrained UAV platforms. Vehicle detection is carried out using a Recurrent Neural Network (RNN), optimized via a hybrid loss function combining cross-entropy and mean squared error to improve localization and confidence estimation. Upon detection, the system branches into two neural submodules: (i) a classification stream utilizing SURF and BRISK descriptors integrated with a Swin Transformer backbone for precise vehicle categorization, and (ii) a multi-object tracking stream employing DeepSORT, which fuses motion and appearance features within an affinity matrix for robust trajectory association.</p><p><strong>Results: </strong>Comprehensive evaluation on three benchmark UAV datasets-AU-AIR, UAVDT, and VAID shows consistent and high performance. The model achieved detection precisions of 0.913, 0.930, and 0.920; tracking precisions of 0.901, 0.881, and 0.890; and classification accuracies of 92.14, 92.75, and 91.25%, respectively.</p><p><strong>Discussion: </strong>These findings highlight the adaptability, robustness, and real-time viability of the proposed architecture in aerial traffic surveillance applications. By effectively integrating detection, classification, and tracking within a unified neural framework, the system contributes significant advancements to intelligent UAV-based traffic monitoring and supports future developments in smart city mobility and decision-making systems.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1681341"},"PeriodicalIF":2.8,"publicationDate":"2025-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12554656/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145388582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
End-to-end robot intelligent obstacle avoidance method based on deep reinforcement learning with spatiotemporal transformer architecture. 基于深度强化学习的时空变压器结构端到端机器人智能避障方法。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-10-08 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1646336
Yuwen Zhou, Weizhong Zhang
{"title":"End-to-end robot intelligent obstacle avoidance method based on deep reinforcement learning with spatiotemporal transformer architecture.","authors":"Yuwen Zhou, Weizhong Zhang","doi":"10.3389/fnbot.2025.1646336","DOIUrl":"10.3389/fnbot.2025.1646336","url":null,"abstract":"<p><p>To enhance the obstacle avoidance performance and autonomous decision-making capabilities of robots in complex dynamic environments, this paper proposes an end-to-end intelligent obstacle avoidance method that integrates deep reinforcement learning, spatiotemporal attention mechanisms, and a Transformer-based architecture. Current mainstream robot obstacle avoidance methods often rely on system architectures with separated perception and decision-making modules, which suffer from issues such as fragmented feature transmission, insufficient environmental modeling, and weak policy generalization. To address these problems, this paper adopts Deep Q-Network (DQN) as the core of reinforcement learning, guiding the robot to autonomously learn optimal obstacle avoidance strategies through interaction with the environment, effectively handling continuous decision-making problems in dynamic and uncertain scenarios. To overcome the limitations of traditional perception mechanisms in modeling the temporal evolution of obstacles, a spatiotemporal attention mechanism is introduced, jointly modeling spatial positional relationships and historical motion trajectories to enhance the model's perception of critical obstacle areas and potential collision risks. Furthermore, an end-to-end Transformer-based perception-decision architecture is designed, utilizing multi-head self-attention to perform high-dimensional feature modeling on multi-modal input information (such as LiDAR and depth images), and generating action policies through a decoding module. This completely eliminates the need for manual feature engineering and intermediate state modeling, constructing an integrated learning process of perception and decision-making. Experiments conducted in several typical obstacle avoidance simulation environments demonstrate that the proposed method outperforms existing mainstream deep reinforcement learning approaches in terms of obstacle avoidance success rate, path optimization, and policy convergence speed. It exhibits good stability and generalization capabilities, showing broad application prospects for deployment in real-world complex environments.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1646336"},"PeriodicalIF":2.8,"publicationDate":"2025-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12540343/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145354439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DWMamba: a structure-aware adaptive state space network for image quality improvement. DWMamba:用于图像质量改进的结构感知自适应状态空间网络。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-10-02 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1676787
Wenjun Fu, Xiaobin Wang, Chuncai Yang, Liang Zhang, Lin Feng, Zhixiong Huang
{"title":"DWMamba: a structure-aware adaptive state space network for image quality improvement.","authors":"Wenjun Fu, Xiaobin Wang, Chuncai Yang, Liang Zhang, Lin Feng, Zhixiong Huang","doi":"10.3389/fnbot.2025.1676787","DOIUrl":"10.3389/fnbot.2025.1676787","url":null,"abstract":"<p><p>Overcoming visual degradation in challenging imaging scenarios is essential for accurate scene understanding. Although deep learning methods have integrated various perceptual capabilities and achieved remarkable progress, their high computational cost limits practical deployment under resource-constrained conditions. Moreover, when confronted with diverse degradation types, existing methods often fail to effectively model the inconsistent attenuation across color channels and spatial regions. To tackle these challenges, we propose <b>DWMamba</b>, a degradation-aware and weight-efficient Mamba network for image quality enhancement. Specifically, DWMamba introduces an Adaptive State Space Module (ASSM) that employs a dual-stream channel monitoring mechanism and a soft fusion strategy to capture global dependencies. With linear computational complexity, ASSM strengthens the models ability to address non-uniform degradations. In addition, by leveraging explicit edge priors and region partitioning as guidance, we design a Structure-guided Residual Fusion (SGRF) module to selectively fuse shallow and deep features, thereby restoring degraded details and enhancing low-light textures. Extensive experiments demonstrate that the proposed network delivers superior qualitative and quantitative performance, with strong generalization to diverse extreme lighting conditions. The code is available at https://github.com/WindySprint/DWMamba.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1676787"},"PeriodicalIF":2.8,"publicationDate":"2025-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12529553/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145328870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Approaches for retraining sEMG classifiers for upper-limb prostheses. 上肢假体表面肌电信号分类器再训练方法。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-10-01 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1627872
Tom Donnelly, Elena Seminati, Benjamin Metcalfe
{"title":"Approaches for retraining sEMG classifiers for upper-limb prostheses.","authors":"Tom Donnelly, Elena Seminati, Benjamin Metcalfe","doi":"10.3389/fnbot.2025.1627872","DOIUrl":"10.3389/fnbot.2025.1627872","url":null,"abstract":"<p><strong>Introduction: </strong>Abandonment rates for myoelectric upper limb prostheses can reach 44%, negatively affecting quality of life and increasing the risk of injury due to compensatory movements. Traditional myoelectric prostheses rely on conventional signal processing for the detection and classification of movement intentions, whereas machine learning offers more robust and complex control through pattern recognition. However, the non-stationary nature of surface electromyogram signals and their day-to-day variations significantly degrade the classification performance of machine learning algorithms. Although single-session classification accuracies exceeding 99% have been reported for 8-class datasets, multisession accuracies typically decrease by 23% between morning and afternoon sessions. Retraining or adaptation can mitigate this accuracy loss.</p><p><strong>Methods: </strong>This study evaluates three paradigms for retraining a machine learning-based classifier: confidence scores, nearest neighbour window assessment, and a novel signal-to-noise ratio-based approach.</p><p><strong>Results: </strong>The results show that all paradigms improve accuracy against no retraining, with the nearest neighbour and signal-to-noise ratio methods showing an average improvement 5% in accuracy over the confidence-based approach.</p><p><strong>Discussion: </strong>The effectiveness of each paradigm is assessed based on intersession accuracy across 10 sessions recorded over 5 days using the NinaPro 6 dataset.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1627872"},"PeriodicalIF":2.8,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12521216/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145307751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction: Pre-training, personalization, and self-calibration: all a neural network-based myoelectric decoder needs. 校正:预训练,个性化和自校准:所有基于神经网络的肌电解码器需要。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-09-19 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1675642
Chenfei Ma, Xinyu Jiang, Kianoush Nazarpour
{"title":"Correction: Pre-training, personalization, and self-calibration: all a neural network-based myoelectric decoder needs.","authors":"Chenfei Ma, Xinyu Jiang, Kianoush Nazarpour","doi":"10.3389/fnbot.2025.1675642","DOIUrl":"https://doi.org/10.3389/fnbot.2025.1675642","url":null,"abstract":"<p><p>[This corrects the article DOI: 10.3389/fnbot.2025.1604453.].</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1675642"},"PeriodicalIF":2.8,"publicationDate":"2025-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12498340/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145244414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
4D trajectory prediction for inbound flights. 入境航班4D轨迹预测。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-09-17 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1625074
Weizhen Tang, Jie Dai
{"title":"4D trajectory prediction for inbound flights.","authors":"Weizhen Tang, Jie Dai","doi":"10.3389/fnbot.2025.1625074","DOIUrl":"https://doi.org/10.3389/fnbot.2025.1625074","url":null,"abstract":"<p><strong>Introduction: </strong>To address the challenges of cumulative errors, insufficient modeling of complex spatiotemporal features, and limitations in computational efficiency and generalization ability in 4D trajectory prediction, this paper proposes a high-precision, robust prediction method.</p><p><strong>Methods: </strong>A hybrid model SVMD-DBO-RCBAM is constructed, integrating sequential variational modal decomposition (SVMD), the dung beetle optimization algorithm (DBO), and the ResNet-CBAM network. Innovations include frequency-domain feature decoupling, dynamic parameter optimization, and enhanced spatio-temporal feature focusing.</p><p><strong>Results: </strong>Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.</p><p><strong>Discussion: </strong>Experiments show that the model achieves a low longitude MAE of 0.0377 in single-step prediction, a 38.5% reduction compared to the baseline model; in multi-step prediction, the longitude R2 reaches 0.9844, with a 72.9% reduction in cumulative error rate and an IQR of prediction errors less than 10% of traditional models, demonstrating high accuracy and stability.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1625074"},"PeriodicalIF":2.8,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12497917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145244444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
RSA-TransUNet: a robust structure-adaptive TransUNet for enhanced road crack segmentation. RSA-TransUNet:用于增强道路裂缝分割的鲁棒结构自适应TransUNet。
IF 3.5 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-09-16 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1633697
Liling Hou, Fei Yu, Yaowen Hu, Yang Hu, Ruoli Yang
{"title":"RSA-TransUNet: a robust structure-adaptive TransUNet for enhanced road crack segmentation.","authors":"Liling Hou, Fei Yu, Yaowen Hu, Yang Hu, Ruoli Yang","doi":"10.3389/fnbot.2025.1633697","DOIUrl":"10.3389/fnbot.2025.1633697","url":null,"abstract":"<p><p>With the advancement of deep learning, road crack segmentation has become increasingly crucial for intelligent transportation safety. Despite notable progress, existing methods still face challenges in capturing fine-grained textures in small crack regions, handling blurred edges and significant width variations, and performing multi-class segmentation. Moreover, the high computational cost of training such models hinders their practical deployment. To tackle these limitations, we propose RSA-TransUNet, a novel model for road crack segmentation. At its core is the Axial-shift MLP Attention (ASMA) mechanism, which integrates axial perception with sparse contextual modeling. Through multi-path axial perturbations and an attention-guided structure, ASMA effectively captures long-range dependencies within row-column patterns, enabling detailed modeling of multi-scale crack features. To improve the model's adaptability to structural irregularities, we introduce the Adaptive Spline Linear Unit (ASLU), which enhances the model's capacity to represent nonlinear transformations. ASLU improves responsiveness to microstructural variations, morphological distortions, and local discontinuities, thereby boosting robustness across different domains. We further develop a Structure-aware Multi-stage Evolutionary Optimization (SMEO) strategy, which guides the training process through three phases: structural perception exploration, feature stability enhancement, and global perturbation. This strategy combines breadth sampling, convergence compression, and local escape mechanisms to improve convergence speed, global search efficiency, and generalization performance. Extensive evaluations on the Crack500, CFD, and DeepCrack datasets-including ablation studies and comparative experiments-demonstrate that RSA-TransUNet achieves superior segmentation accuracy and robustness in complex road environments, highlighting its potential for real-world applications.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1633697"},"PeriodicalIF":3.5,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12479514/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145206146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward accurate single image sand dust removal by utilizing uncertainty-aware neural network. 利用不确定性感知神经网络实现单幅图像的精确除尘。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-09-10 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1575995
Bingcai Wei, Hui Liu, Chuang Qian, Haoliang Shen, Yibiao Chen, Yixin Wang
{"title":"Toward accurate single image sand dust removal by utilizing uncertainty-aware neural network.","authors":"Bingcai Wei, Hui Liu, Chuang Qian, Haoliang Shen, Yibiao Chen, Yixin Wang","doi":"10.3389/fnbot.2025.1575995","DOIUrl":"10.3389/fnbot.2025.1575995","url":null,"abstract":"<p><p>Although deep learning methods have made significant strides in single image sand dust removal, the heterogeneous uncertainty induced by dusty environments poses a considerable challenge. In response, our research presents a novel framework known as the Hierarchical Interactive Uncertainty-aware Network (HIUNet). HIUNet leverages Bayesian neural networks for the extraction of robust shallow features, bolstered by pre-trained encoders for feature extraction and the agility of lightweight decoders for preliminary image reconstitution. Subsequently, a feature frequency selection mechanism is activated to enhance overall performance by strategically identifying and retaining valuable features while effectively suppressing redundant and irrelevant ones. Following this, a feature enhancement module is applied to the preliminary restoration. This intricate fusion culminates in the production of a restored image of superior quality. Our extensive experiments, using our proposed Sand11K dataset that exhibits various levels of degradation from dust and sand, confirm the effectiveness and soundness of our proposed method. By modeling uncertainty via Bayesian neural networks to extract robust shallow features and selecting valuable features through frequency selection, HIUNet can reconstruct high-quality clean images. For future work, we plan to extend our uncertainty-aware framework to handle extreme sand scenarios.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1575995"},"PeriodicalIF":2.8,"publicationDate":"2025-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12457322/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145148867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamic graph neural networks for UAV-based group activity recognition in structured team sports. 结构化团队运动中基于无人机的群体活动识别的动态图神经网络。
IF 2.8 4区 计算机科学
Frontiers in Neurorobotics Pub Date : 2025-09-08 eCollection Date: 2025-01-01 DOI: 10.3389/fnbot.2025.1631998
Ishrat Zahra, Yanfeng Wu, Haifa F Alhasson, Shuaa S Alharbi, Hanan Aljuaid, Ahmad Jalal, Hui Liu
{"title":"Dynamic graph neural networks for UAV-based group activity recognition in structured team sports.","authors":"Ishrat Zahra, Yanfeng Wu, Haifa F Alhasson, Shuaa S Alharbi, Hanan Aljuaid, Ahmad Jalal, Hui Liu","doi":"10.3389/fnbot.2025.1631998","DOIUrl":"10.3389/fnbot.2025.1631998","url":null,"abstract":"<p><strong>Introduction: </strong>Understanding group actions in real-world settings is essential for the advancement of applications in surveillance, robotics, and autonomous systems. Group activity recognition, particularly in sports scenarios, presents unique challenges due to dynamic interactions, occlusions, and varying viewpoints. To address these challenges, we develop a deep learning system that recognizes multi-person behaviors by integrating appearance-based features (HOG, LBP, SIFT), skeletal data (MediaPipe, MOCON), and motion features. Our approach employs a Dynamic Graph Neural Network (DGNN) and Bi-LSTM architecture, enabling robust recognition of group activities in diverse and dynamic environments. To further validate our framework's adaptability, we include evaluations on Volleyball and SoccerTrack UAV-recorded datasets, which offer unique perspectives and challenges.</p><p><strong>Method: </strong>Our framework integrates YOLOv11 for object detection and SORT for tracking to extract multi-modal features-including HOG, LBP, SIFT, skeletal data (MediaPipe), and motion context (MOCON). These features are optimized using genetic algorithms and fused within a Dynamic Graph Neural Network (DGNN), which models players as nodes in a spatio-temporal graph, effectively capturing both spatial formations and temporal dynamics.</p><p><strong>Results: </strong>We evaluated our framework on three datasets: a volleyball dataset, SoccerTrack UAV-based soccer dataset, and NBA basketball dataset. Our system achieved 94.5% accuracy on the volleyball dataset (mAP: 94.2%, MPCA: 93.8%) with an inference time of 0.18 s per frame. On the SoccerTrack UAV dataset, accuracy was 91.8% (mAP: 91.5%, MPCA: 90.5%) with 0.20 s inference, and on the NBA basketball dataset, it was 91.1% (mAP: 90.8%, MPCA: 89.8%) with the same 0.20 s per frame. These results highlight our framework's high performance and efficient computational efficiency across various sports and perspectives.</p><p><strong>Discussion: </strong>Our approach demonstrates robust performance in recognizing multi-person actions across diverse conditions, highlighting its adaptability to both conventional and UAV-based video sources.</p>","PeriodicalId":12628,"journal":{"name":"Frontiers in Neurorobotics","volume":"19 ","pages":"1631998"},"PeriodicalIF":2.8,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12452097/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145130117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书