Quanyu Long , Dechen Yao , JianWei Yang , Jia Dong , Bin Zhu , YuanTing Dai
{"title":"基于因果显著性增强和mamba的多尺度特征融合编码框架用于铁路紧固件故障诊断","authors":"Quanyu Long , Dechen Yao , JianWei Yang , Jia Dong , Bin Zhu , YuanTing Dai","doi":"10.1016/j.aei.2025.103933","DOIUrl":null,"url":null,"abstract":"<div><div>Fault detection of railway fasteners is vital for ensuring train operation safety within intelligent rail maintenance systems. However, existing Transformer-based detectors often incur high computational overhead and exhibit limited adaptability to multi-scale variations and complex background interference. To address these limitations, we propose SaM-DETR, a novel object detection framework that deeply couples causal saliency enhancement with a Mamba-based Multi-scale State Space Module (MSSM). Specifically, we introduce a differentiable Top-K selection mechanism combined with a causal invariance loss to adaptively learn the optimal foreground–background ratio, effectively suppressing spurious correlations and enhancing salient feature extraction. Furthermore, we replace the vanilla transformer encoder with a linear-complexity Mamba-based MSSM encoder, enabling efficient long-range feature fusion while dramatically reducing giga floating-point operations (GFLOPs). Extensive experiments on two real-world railway fastener datasets with different resolutions demonstrate that SaM-DETR achieves a balanced trade-off among detection accuracy, computational efficiency, and inference speed, outperforming mainstream DEtection TRansformer (DETR)-based models. These results validate the robustness and lightweight advantages of its novel causal-saliency—driven multi-scale design in multi-resolution industrial scenarios.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"69 ","pages":"Article 103933"},"PeriodicalIF":9.9000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A causal saliency enhancement and Mamba-based multi-scale feature fusion encoding framework for railway fastener fault diagnosis\",\"authors\":\"Quanyu Long , Dechen Yao , JianWei Yang , Jia Dong , Bin Zhu , YuanTing Dai\",\"doi\":\"10.1016/j.aei.2025.103933\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Fault detection of railway fasteners is vital for ensuring train operation safety within intelligent rail maintenance systems. However, existing Transformer-based detectors often incur high computational overhead and exhibit limited adaptability to multi-scale variations and complex background interference. To address these limitations, we propose SaM-DETR, a novel object detection framework that deeply couples causal saliency enhancement with a Mamba-based Multi-scale State Space Module (MSSM). Specifically, we introduce a differentiable Top-K selection mechanism combined with a causal invariance loss to adaptively learn the optimal foreground–background ratio, effectively suppressing spurious correlations and enhancing salient feature extraction. Furthermore, we replace the vanilla transformer encoder with a linear-complexity Mamba-based MSSM encoder, enabling efficient long-range feature fusion while dramatically reducing giga floating-point operations (GFLOPs). Extensive experiments on two real-world railway fastener datasets with different resolutions demonstrate that SaM-DETR achieves a balanced trade-off among detection accuracy, computational efficiency, and inference speed, outperforming mainstream DEtection TRansformer (DETR)-based models. These results validate the robustness and lightweight advantages of its novel causal-saliency—driven multi-scale design in multi-resolution industrial scenarios.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"69 \",\"pages\":\"Article 103933\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034625008262\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625008262","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A causal saliency enhancement and Mamba-based multi-scale feature fusion encoding framework for railway fastener fault diagnosis
Fault detection of railway fasteners is vital for ensuring train operation safety within intelligent rail maintenance systems. However, existing Transformer-based detectors often incur high computational overhead and exhibit limited adaptability to multi-scale variations and complex background interference. To address these limitations, we propose SaM-DETR, a novel object detection framework that deeply couples causal saliency enhancement with a Mamba-based Multi-scale State Space Module (MSSM). Specifically, we introduce a differentiable Top-K selection mechanism combined with a causal invariance loss to adaptively learn the optimal foreground–background ratio, effectively suppressing spurious correlations and enhancing salient feature extraction. Furthermore, we replace the vanilla transformer encoder with a linear-complexity Mamba-based MSSM encoder, enabling efficient long-range feature fusion while dramatically reducing giga floating-point operations (GFLOPs). Extensive experiments on two real-world railway fastener datasets with different resolutions demonstrate that SaM-DETR achieves a balanced trade-off among detection accuracy, computational efficiency, and inference speed, outperforming mainstream DEtection TRansformer (DETR)-based models. These results validate the robustness and lightweight advantages of its novel causal-saliency—driven multi-scale design in multi-resolution industrial scenarios.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.