Underwater Crack Detection and Segmentation via Transformer-Based Style Transfer With Global–Local Feature Fusion

IF 4.5 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
IEEE Sensors Journal Pub Date : 2026-10-15 Epub Date: 2026-08-26 DOI:10.1109/JSEN.2026.3725742
Tao Liu;Qin Cheng;Lingji Xu;Jianming Miao
{"title":"Underwater Crack Detection and Segmentation via Transformer-Based Style Transfer With Global–Local Feature Fusion","authors":"Tao Liu;Qin Cheng;Lingji Xu;Jianming Miao","doi":"10.1109/JSEN.2026.3725742","DOIUrl":null,"url":null,"abstract":"Deep-learning-enabled autonomous underwater vehicles (AUVs) have shown strong potential for autonomous underwater structural inspection, yet reliable crack detection and segmentation remain constrained by scarce underwater crack data and degraded imaging conditions. This article presents a crack-aware framework that combines structure-preserving style transfer for underwater crack image synthesis with DBE-YOLO for underwater crack detection and segmentation. In the style transfer stage, terrestrial crack images are translated into underwater-style samples using a Transformer-based model, where a quality-aware consistency loss is designed to suppress patchwise style artifacts and color distortion while preserving crack structures. In the perception stage, we propose DBE-YOLO, a YOLOv7-based detector-segmenter tailored to underwater crack geometry. DBE-YOLO incorporates deformable convolution v2 (DCNv2), bilevel routing attention (BRA), and Explicit Visual Center (EVC) to align adaptive sampling, contextual reasoning, and global–local feature fusion with the elongated morphology, weak visual contrast, and background interference of underwater cracks. Focal-EIoU and binary cross-entropy (BCE)-Dice losses are further adopted to improve bounding-box localization and mask delineation, respectively. A dedicated underwater crack dataset containing both synthesized and real underwater crack images is constructed for training and evaluation. Experiments on unseen real underwater crack images show that DBE-YOLO improves detection mean average precision (mAP) from 82.0% to 87.1% over the YOLOv7 baseline, while the BCE-Dice loss improves average precision (AP)-mask from 86.8% to 88.1% for segmentation. These results demonstrate the effectiveness of the proposed framework for underwater crack detection and segmentation under challenging underwater conditions.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"26 20","pages":"30362-30375"},"PeriodicalIF":4.5000,"publicationDate":"2026-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/11667810/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/26 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Deep-learning-enabled autonomous underwater vehicles (AUVs) have shown strong potential for autonomous underwater structural inspection, yet reliable crack detection and segmentation remain constrained by scarce underwater crack data and degraded imaging conditions. This article presents a crack-aware framework that combines structure-preserving style transfer for underwater crack image synthesis with DBE-YOLO for underwater crack detection and segmentation. In the style transfer stage, terrestrial crack images are translated into underwater-style samples using a Transformer-based model, where a quality-aware consistency loss is designed to suppress patchwise style artifacts and color distortion while preserving crack structures. In the perception stage, we propose DBE-YOLO, a YOLOv7-based detector-segmenter tailored to underwater crack geometry. DBE-YOLO incorporates deformable convolution v2 (DCNv2), bilevel routing attention (BRA), and Explicit Visual Center (EVC) to align adaptive sampling, contextual reasoning, and global–local feature fusion with the elongated morphology, weak visual contrast, and background interference of underwater cracks. Focal-EIoU and binary cross-entropy (BCE)-Dice losses are further adopted to improve bounding-box localization and mask delineation, respectively. A dedicated underwater crack dataset containing both synthesized and real underwater crack images is constructed for training and evaluation. Experiments on unseen real underwater crack images show that DBE-YOLO improves detection mean average precision (mAP) from 82.0% to 87.1% over the YOLOv7 baseline, while the BCE-Dice loss improves average precision (AP)-mask from 86.8% to 88.1% for segmentation. These results demonstrate the effectiveness of the proposed framework for underwater crack detection and segmentation under challenging underwater conditions.
基于全局-局部特征融合的变压器风格转换水下裂纹检测与分割
基于深度学习的自主水下航行器(auv)已经显示出自主水下结构检测的巨大潜力,但可靠的裂缝检测和分割仍然受到水下裂缝数据稀缺和成像条件下降的限制。本文提出了一种裂缝感知框架,该框架将水下裂缝图像合成的保结构风格转移与水下裂缝检测和分割的DBE-YOLO相结合。在样式转换阶段,使用基于transformer的模型将陆地裂纹图像转换为水下样式样本,其中设计了具有质量意识的一致性损失,以抑制斑块样式伪像和颜色失真,同时保留裂纹结构。在感知阶段,我们提出了DBE-YOLO,这是一种基于yolov7的针对水下裂纹几何形状定制的检测器-分段器。DBE-YOLO结合了可变形卷积v2 (DCNv2)、双层路由注意(BRA)和显式视觉中心(EVC),将自适应采样、上下文推理和全局-局部特征融合与水下裂缝的细长形态、弱视觉对比度和背景干扰相结合。进一步采用focus - eiou和二进制交叉熵(BCE)-Dice损失分别改进了边界盒定位和掩模圈定。构建了包含合成和真实水下裂缝图像的专用水下裂缝数据集,用于训练和评估。在未见过的真实水下裂缝图像上的实验表明,DBE-YOLO将YOLOv7基线的检测平均精度(mAP)从82.0%提高到87.1%,而BCE-Dice loss将AP -mask的分割平均精度(AP)从86.8%提高到88.1%。这些结果证明了该框架在具有挑战性的水下条件下水下裂纹检测和分割的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书