Surface Defect Detector Based on Deformable Convolution and Lightweight Multi-Scale Attention

IF 1.5 4区 计算机科学 Q3 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Zilin Xia, Zedong Huang, Jinan Gu, Wenbo Wang
{"title":"Surface Defect Detector Based on Deformable Convolution and Lightweight Multi-Scale Attention","authors":"Zilin Xia,&nbsp;Zedong Huang,&nbsp;Jinan Gu,&nbsp;Wenbo Wang","doi":"10.1002/cpe.70003","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>The detection of defects on industrial surfaces is essential for guaranteeing the quality and safety of products. Deep learning-based object detection methods have demonstrated impressive efficacy in industrial applications in recent years. However, due to the complex and variable shape of defects, the similarity between defects and background, large intra-class differences, and small inter-class differences lead to low classification accuracy, it is a great challenge to achieve accurate defect detection. To overcome these challenges, this research proposed a novel network specifically designed for defect detection. First, a feature extraction network, ResDCA-Net, is constructed based on deformable convolution and lightweight multi-scale attention, where deformable convolution can adaptively adjust to extract features of defects with complex and variable shapes. Second, the lightweight multi-scale attention module is constructed, which uses multi-branch and cross-space fusion to obtain the complete feature space attention map, thereby improving the defect feature attention and reducing the background feature attention. Third, to enhance the classification and localization accuracy, an attention-based decoupled prediction module is proposed to ensure that the classification and regression branches of the model can focus on their required features. Finally, extensive comparative experiments indicate that the proposed approach performs best, achieving 83.7% and 83.4% mean Average Precision (mAP) on the GC10-DET and NEU-DET datasets, respectively. The effectiveness of the proposed individual modules is further validated in ablation experiments, which demonstrate the excellent performance and potential in defect detection tasks.</p>\n </div>","PeriodicalId":55214,"journal":{"name":"Concurrency and Computation-Practice & Experience","volume":"37 4-5","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2025-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Concurrency and Computation-Practice & Experience","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cpe.70003","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

The detection of defects on industrial surfaces is essential for guaranteeing the quality and safety of products. Deep learning-based object detection methods have demonstrated impressive efficacy in industrial applications in recent years. However, due to the complex and variable shape of defects, the similarity between defects and background, large intra-class differences, and small inter-class differences lead to low classification accuracy, it is a great challenge to achieve accurate defect detection. To overcome these challenges, this research proposed a novel network specifically designed for defect detection. First, a feature extraction network, ResDCA-Net, is constructed based on deformable convolution and lightweight multi-scale attention, where deformable convolution can adaptively adjust to extract features of defects with complex and variable shapes. Second, the lightweight multi-scale attention module is constructed, which uses multi-branch and cross-space fusion to obtain the complete feature space attention map, thereby improving the defect feature attention and reducing the background feature attention. Third, to enhance the classification and localization accuracy, an attention-based decoupled prediction module is proposed to ensure that the classification and regression branches of the model can focus on their required features. Finally, extensive comparative experiments indicate that the proposed approach performs best, achieving 83.7% and 83.4% mean Average Precision (mAP) on the GC10-DET and NEU-DET datasets, respectively. The effectiveness of the proposed individual modules is further validated in ablation experiments, which demonstrate the excellent performance and potential in defect detection tasks.

基于可变形卷积和轻量化多尺度关注的表面缺陷检测
工业表面缺陷的检测对于保证产品的质量和安全至关重要。近年来,基于深度学习的目标检测方法在工业应用中表现出了令人印象深刻的功效。然而,由于缺陷形状复杂多变,缺陷与背景相似,类内差异大,类间差异小,导致分类精度较低,实现准确的缺陷检测是一个很大的挑战。为了克服这些挑战,本研究提出了一种专门用于缺陷检测的新型网络。首先,构建基于可变形卷积和轻量化多尺度关注的特征提取网络ResDCA-Net,其中可变形卷积可自适应调整以提取形状复杂多变的缺陷特征;其次,构建轻量级多尺度关注模块,利用多分支和跨空间融合获得完整的特征空间关注图,从而提高缺陷特征关注度,降低背景特征关注度;第三,为了提高分类和定位精度,提出了基于注意力的解耦预测模块,保证模型的分类分支和回归分支能够集中在各自需要的特征上。最后,大量的对比实验表明,该方法在GC10-DET和nue - det数据集上的平均精度(mAP)分别达到83.7%和83.4%。在烧蚀实验中进一步验证了所提出的单个模块的有效性,证明了其在缺陷检测任务中的优异性能和潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Concurrency and Computation-Practice & Experience
Concurrency and Computation-Practice & Experience 工程技术-计算机:理论方法
CiteScore
5.00
自引率
10.00%
发文量
664
审稿时长
9.6 months
期刊介绍: Concurrency and Computation: Practice and Experience (CCPE) publishes high-quality, original research papers, and authoritative research review papers, in the overlapping fields of: Parallel and distributed computing; High-performance computing; Computational and data science; Artificial intelligence and machine learning; Big data applications, algorithms, and systems; Network science; Ontologies and semantics; Security and privacy; Cloud/edge/fog computing; Green computing; and Quantum computing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信