Intelligent segmentation and quantification of tunnel lining cracks via computer vision

Yong Feng, Xiao-Lei Zhang, Shi-Jin Feng, Wei Zhang, Kan Hu, Yue-Wu Da
{"title":"Intelligent segmentation and quantification of tunnel lining cracks via computer vision","authors":"Yong Feng, Xiao-Lei Zhang, Shi-Jin Feng, Wei Zhang, Kan Hu, Yue-Wu Da","doi":"10.1177/14759217241254748","DOIUrl":null,"url":null,"abstract":"Aiming to automatically, precisely, and rapidly detect tunnel lining cracks from images and extract geometric information for structural condition assessment, this study proposes a novel tunnel lining crack segmentation network (TCSegNet) and establishes a framework for calculating key geometric parameters of cracks. A tunnel lining crack segmentation dataset is first built by conducting on-site inspections of metro tunnels and collecting open-sourced tunnel images. Afterward, the TCSegNet, conforming to the encoder–decoder architectural paradigm, is designed to separate cracks from lining images pixel-to-pixel. An improved ConvNeXt and developed efficient atrous spatial pyramid pooling module constitute the encoder. The skip connections, upsampling modules, and tailored segmentation head form the decoder. Upon the segmentation results of TCSegNet, a computing framework integrating multiple digital image processing techniques is proposed to obtain the length, average width, and maximum width of cracks. The experimental results show that the TCSegNet achieves leading results among several dominant models, with 70.78% mean intersection over union (mIoU) and 57.43% F1 score. Furthermore, the TCSegNet has 32.01 million parameters, requires 55.13 billion floating point operations, and gets 107.28 frames per second, proving that it has low time and space complexities and implements real-time segmentation. Also, the rationality and effectiveness of TCSegNet in alleviating the crack disjoint problem and preserving crack edge details are verified through comparative experiments. In addition, the TCSegNet achieves 71.99%, 70.45%, and 70.23% mIoU in high-resolution image segmentation, robustness, and generalization tests, respectively, demonstrating that it is competent for detecting high-resolution lining images, has a solid resistance to illumination variations, and can be well generalized to other tunnel lining image datasets. Finally, the applicability of the crack quantification framework is validated by practical application examples. The developed approaches in this study provide pixel-level segmentation results and detailed measurements of concrete lining cracks to assess tunnel structural safety status.","PeriodicalId":515545,"journal":{"name":"Structural Health Monitoring","volume":"74 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Structural Health Monitoring","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/14759217241254748","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Aiming to automatically, precisely, and rapidly detect tunnel lining cracks from images and extract geometric information for structural condition assessment, this study proposes a novel tunnel lining crack segmentation network (TCSegNet) and establishes a framework for calculating key geometric parameters of cracks. A tunnel lining crack segmentation dataset is first built by conducting on-site inspections of metro tunnels and collecting open-sourced tunnel images. Afterward, the TCSegNet, conforming to the encoder–decoder architectural paradigm, is designed to separate cracks from lining images pixel-to-pixel. An improved ConvNeXt and developed efficient atrous spatial pyramid pooling module constitute the encoder. The skip connections, upsampling modules, and tailored segmentation head form the decoder. Upon the segmentation results of TCSegNet, a computing framework integrating multiple digital image processing techniques is proposed to obtain the length, average width, and maximum width of cracks. The experimental results show that the TCSegNet achieves leading results among several dominant models, with 70.78% mean intersection over union (mIoU) and 57.43% F1 score. Furthermore, the TCSegNet has 32.01 million parameters, requires 55.13 billion floating point operations, and gets 107.28 frames per second, proving that it has low time and space complexities and implements real-time segmentation. Also, the rationality and effectiveness of TCSegNet in alleviating the crack disjoint problem and preserving crack edge details are verified through comparative experiments. In addition, the TCSegNet achieves 71.99%, 70.45%, and 70.23% mIoU in high-resolution image segmentation, robustness, and generalization tests, respectively, demonstrating that it is competent for detecting high-resolution lining images, has a solid resistance to illumination variations, and can be well generalized to other tunnel lining image datasets. Finally, the applicability of the crack quantification framework is validated by practical application examples. The developed approaches in this study provide pixel-level segmentation results and detailed measurements of concrete lining cracks to assess tunnel structural safety status.
通过计算机视觉对隧道衬砌裂缝进行智能分割和量化
为了从图像中自动、精确、快速地检测隧道衬砌裂缝,并提取几何信息用于结构状况评估,本研究提出了一种新型隧道衬砌裂缝分割网络(TCSegNet),并建立了计算裂缝关键几何参数的框架。首先,通过对地铁隧道进行现场检测和收集开源隧道图像,建立了隧道衬砌裂缝分割数据集。随后,按照编码器-解码器架构范例设计了 TCSegNet,用于从衬砌图像中逐个像素地分离裂缝。编码器由改进的 ConvNeXt 和开发的高效 Atrous 空间金字塔池化模块组成。跳转连接、上采样模块和定制的分割头构成解码器。根据 TCSegNet 的分割结果,提出了一个集成多种数字图像处理技术的计算框架,以获得裂缝的长度、平均宽度和最大宽度。实验结果表明,TCSegNet 在几个主流模型中取得了领先的结果,平均交集大于联合(mIoU)为 70.78%,F1 分数为 57.43%。此外,TCSegNet 有 3201 万个参数,需要 551.3 亿次浮点运算,每秒获得 107.28 帧,证明其时间和空间复杂度较低,可以实现实时分割。同时,通过对比实验,验证了 TCSegNet 在缓解裂缝脱节问题和保留裂缝边缘细节方面的合理性和有效性。此外,在高分辨率图像分割、鲁棒性和泛化测试中,TCSegNet 的 mIoU 分别达到了 71.99%、70.45% 和 70.23%,表明它能胜任高分辨率衬砌图像的检测,对光照变化有很强的抵抗能力,并能很好地泛化到其他隧道衬砌图像数据集。最后,实际应用实例验证了裂缝量化框架的适用性。本研究中开发的方法提供了像素级分割结果和混凝土衬砌裂缝的详细测量结果,可用于评估隧道结构安全状况。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信