Rapid acquisition and surface defects recognition based on panoramic image of small-section hydraulic tunnel

IF 8.2 1区 工程技术 Q1 ENGINEERING, CIVIL
Haoyu Wang , Jichen Xie , Jinyang Fu , Cong Zhang , Dingping Chen , Zhiheng Zhu , Xuesen Zhang
{"title":"Rapid acquisition and surface defects recognition based on panoramic image of small-section hydraulic tunnel","authors":"Haoyu Wang ,&nbsp;Jichen Xie ,&nbsp;Jinyang Fu ,&nbsp;Cong Zhang ,&nbsp;Dingping Chen ,&nbsp;Zhiheng Zhu ,&nbsp;Xuesen Zhang","doi":"10.1016/j.undsp.2024.08.007","DOIUrl":null,"url":null,"abstract":"<div><div>Small-section hydraulic tunnels are characterized by small spaces and various section forms, under complex environments, which makes it difficult to carry out an inspection by the mobile acquisition equipment. To resolve these problems, an arbitrarily adjustable camera module deployment method and the corresponding automatic image acquisition equipment with multi-area array cameras are proposed and developed. Such method enables the acquisition of full-length surface images of the hydraulic tunnels with different cross-section forms and diameters by a one-way travel, and the overlap rate and accuracy of the acquired image sets meet the requirements of three-dimensional reconstruction and panoramic image generation. In addition, to improve the speed and accuracy of traditional algorithms for tunnel surface defects detection, this paper proposes an improved YOLOv5s-DECA model. The algorithm introduces DenseNet to optimize the backbone feature extraction network and incorporates an efficient channel attention ECA module to make a better extraction of features of defects. The experimental results show that mAP, and F1-score of YOLOv5-DECA are 73.4% and 74.6%, respectively, which are better than the common model in terms of accuracy and robustness. The proposed YOLOv5-DECA has great detection performance for targets with variable shapes and can solve the problem of classification imbalance in surface defects. Then, by combining YOLOv5-DECA with the direction search algorithm, a “point-ring-section” method is established to allow rapid identification of common surface defects by detecting them layer by layer with the bottom image of the stitched panorama as the seed. The presented method in this paper effectively solves the problem that a single image fails to show the overall distribution of the defects and their accurate positioning in a whole large tunnel section and the effective features of defects in an excessively large panoramic image size are difficult to be captured by the neural network. Field applications demonstrated that the presented method is adequate for high-precision and intelligent surface defect detection and positioning for different small-section hydraulic tunnels such as circular, arch-wall, and box-shaped hydraulic tunnels.</div></div>","PeriodicalId":48505,"journal":{"name":"Underground Space","volume":"21 ","pages":"Pages 270-290"},"PeriodicalIF":8.2000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Underground Space","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2467967424001260","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0

Abstract

Small-section hydraulic tunnels are characterized by small spaces and various section forms, under complex environments, which makes it difficult to carry out an inspection by the mobile acquisition equipment. To resolve these problems, an arbitrarily adjustable camera module deployment method and the corresponding automatic image acquisition equipment with multi-area array cameras are proposed and developed. Such method enables the acquisition of full-length surface images of the hydraulic tunnels with different cross-section forms and diameters by a one-way travel, and the overlap rate and accuracy of the acquired image sets meet the requirements of three-dimensional reconstruction and panoramic image generation. In addition, to improve the speed and accuracy of traditional algorithms for tunnel surface defects detection, this paper proposes an improved YOLOv5s-DECA model. The algorithm introduces DenseNet to optimize the backbone feature extraction network and incorporates an efficient channel attention ECA module to make a better extraction of features of defects. The experimental results show that mAP, and F1-score of YOLOv5-DECA are 73.4% and 74.6%, respectively, which are better than the common model in terms of accuracy and robustness. The proposed YOLOv5-DECA has great detection performance for targets with variable shapes and can solve the problem of classification imbalance in surface defects. Then, by combining YOLOv5-DECA with the direction search algorithm, a “point-ring-section” method is established to allow rapid identification of common surface defects by detecting them layer by layer with the bottom image of the stitched panorama as the seed. The presented method in this paper effectively solves the problem that a single image fails to show the overall distribution of the defects and their accurate positioning in a whole large tunnel section and the effective features of defects in an excessively large panoramic image size are difficult to be captured by the neural network. Field applications demonstrated that the presented method is adequate for high-precision and intelligent surface defect detection and positioning for different small-section hydraulic tunnels such as circular, arch-wall, and box-shaped hydraulic tunnels.
基于小断面水工隧道全景图像的快速采集与表面缺陷识别
小断面水工隧洞具有空间小、断面形式多样、环境复杂等特点,给移动采集设备进行检测带来了困难。针对这些问题,提出并研制了一种任意可调的相机模组部署方法及相应的多区域阵列相机自动图像采集设备。该方法可以通过单向行程获取不同断面形式和直径的水工隧洞全长表面图像,获取的图像集重叠率和精度满足三维重建和全景图像生成的要求。此外,为了提高传统隧道表面缺陷检测算法的速度和精度,本文提出了一种改进的YOLOv5s-DECA模型。该算法引入DenseNet对主干特征提取网络进行优化,并结合高效通道关注ECA模块,更好地提取缺陷特征。实验结果表明,YOLOv5-DECA的mAP和f1得分分别为73.4%和74.6%,在准确率和鲁棒性方面都优于普通模型。所提出的YOLOv5-DECA对变形状目标具有良好的检测性能,能够解决表面缺陷分类不平衡的问题。然后,将YOLOv5-DECA与方向搜索算法相结合,建立“点环切片”方法,以拼接全景图底部图像为种子,逐层检测常见表面缺陷,实现对常见表面缺陷的快速识别。本文提出的方法有效地解决了单幅图像无法显示缺陷在整个大断面内的整体分布和准确定位,以及超大全景图像难以捕捉缺陷有效特征的问题。现场应用表明,该方法可满足圆形、拱墙、箱形等不同小断面水工隧道的高精度、智能化表面缺陷检测与定位。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Underground Space
Underground Space ENGINEERING, CIVIL-
CiteScore
10.20
自引率
14.10%
发文量
71
审稿时长
63 days
期刊介绍: Underground Space is an open access international journal without article processing charges (APC) committed to serving as a scientific forum for researchers and practitioners in the field of underground engineering. The journal welcomes manuscripts that deal with original theories, methods, technologies, and important applications throughout the life-cycle of underground projects, including planning, design, operation and maintenance, disaster prevention, and demolition. The journal is particularly interested in manuscripts related to the latest development of smart underground engineering from the perspectives of resilience, resources saving, environmental friendliness, humanity, and artificial intelligence. The manuscripts are expected to have significant innovation and potential impact in the field of underground engineering, and should have clear association with or application in underground projects.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信