Real-time inner wall surface defect detection based on multi-morphological feature fusion network

IF 7.5 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Zhenshen Qu , Xinxu Cai , Tianyi Zhang , Jiazheng Xu , Xintong Jiang , Chuan Lin
{"title":"Real-time inner wall surface defect detection based on multi-morphological feature fusion network","authors":"Zhenshen Qu ,&nbsp;Xinxu Cai ,&nbsp;Tianyi Zhang ,&nbsp;Jiazheng Xu ,&nbsp;Xintong Jiang ,&nbsp;Chuan Lin","doi":"10.1016/j.engappai.2025.111331","DOIUrl":null,"url":null,"abstract":"<div><div>In industrial manufacturing, defects on the inner wall surface are crucial for quality and safety assessment. However, existing detection methods are limited by low resolution and glare interference. This study presents a Multi-morphological Feature Fusion Network for Object Detection (MFFN-OD) for 360°detection of inner wall image defects. First, it cleverly integrates panoramic imaging with conventional features through a dual-branch backbone and annular features, ensuring rotation invariance and holistic feature preservation. Second, we develop an Adaptive Multi-morphological Feature Alignment Module (AMFAM) that combats centrally polarized defects by automatically adjusting feature alignment, reducing noise, and increasing accuracy, as well as a feature interaction module with a focus on strengthening multiscale feature fusion. Third, we introduce an Asymptotic Feature Pyramid Network with Auxiliary Features (AFPN-AF) to further refine fusion, close semantic gaps, and improve performance. Experimental results show that MFFN-OD achieves 96.1% mean Average Precision (mAP) and 94.3% Average Precision (AP) for demanding faults with fast detection of 17 milliseconds per frame, meeting industrial requirements for accuracy and real-time performance.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"159 ","pages":"Article 111331"},"PeriodicalIF":7.5000,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625013338","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In industrial manufacturing, defects on the inner wall surface are crucial for quality and safety assessment. However, existing detection methods are limited by low resolution and glare interference. This study presents a Multi-morphological Feature Fusion Network for Object Detection (MFFN-OD) for 360°detection of inner wall image defects. First, it cleverly integrates panoramic imaging with conventional features through a dual-branch backbone and annular features, ensuring rotation invariance and holistic feature preservation. Second, we develop an Adaptive Multi-morphological Feature Alignment Module (AMFAM) that combats centrally polarized defects by automatically adjusting feature alignment, reducing noise, and increasing accuracy, as well as a feature interaction module with a focus on strengthening multiscale feature fusion. Third, we introduce an Asymptotic Feature Pyramid Network with Auxiliary Features (AFPN-AF) to further refine fusion, close semantic gaps, and improve performance. Experimental results show that MFFN-OD achieves 96.1% mean Average Precision (mAP) and 94.3% Average Precision (AP) for demanding faults with fast detection of 17 milliseconds per frame, meeting industrial requirements for accuracy and real-time performance.
基于多形态特征融合网络的内墙表面缺陷实时检测
在工业制造中,内壁表面缺陷是质量和安全评价的关键。然而,现有的检测方法受到低分辨率和眩光干扰的限制。本文提出了一种用于360°检测内壁图像缺陷的多形态特征融合网络(MFFN-OD)。首先,它通过双分支主干和环状特征巧妙地将全景成像与常规特征相结合,保证了旋转不变性和整体特征保持。其次,我们开发了一个自适应多形态特征对齐模块(AMFAM),该模块通过自动调整特征对齐、降低噪声和提高精度来对抗中心极化缺陷,以及一个特征交互模块,重点是加强多尺度特征融合。第三,我们引入了一种带辅助特征的渐近特征金字塔网络(AFPN-AF),以进一步细化融合,缩小语义差距,提高性能。实验结果表明,MFFN-OD对高要求故障的平均检测精度(mAP)为96.1%,平均检测精度(AP)为94.3%,检测速度为17毫秒/帧,满足工业对精度和实时性的要求。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信