Hybrid- segmentor:民用基础设施中自动细粒度裂缝分割的混合方法

IF 9.6 1区 工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY
June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto
{"title":"Hybrid- segmentor:民用基础设施中自动细粒度裂缝分割的混合方法","authors":"June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto","doi":"10.1016/j.autcon.2024.105960","DOIUrl":null,"url":null,"abstract":"It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"75 1","pages":""},"PeriodicalIF":9.6000,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hybrid-Segmentor: Hybrid approach for automated fine-grained crack segmentation in civil infrastructure\",\"authors\":\"June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto\",\"doi\":\"10.1016/j.autcon.2024.105960\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).\",\"PeriodicalId\":8660,\"journal\":{\"name\":\"Automation in Construction\",\"volume\":\"75 1\",\"pages\":\"\"},\"PeriodicalIF\":9.6000,\"publicationDate\":\"2025-01-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automation in Construction\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1016/j.autcon.2024.105960\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.autcon.2024.105960","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

检测和分割各种基础设施(如道路和建筑物)的裂缝至关重要,以确保安全、使用寿命和具有成本效益的维护。尽管深度学习取得了进步,但在不同条件下进行精确的裂纹检测仍然具有挑战性。本文介绍了Hybrid-Segmentor,这是一种深度学习模型,结合了基于卷积神经网络和基于transformer的架构,可以提取细粒度的局部特征和全局裂缝模式,大大增强了裂缝检测,从而改善了基础设施的维护。Hybrid-Segmentor在合并多个开源数据集创建的大型自定义数据集上进行训练,可以准确检测不同类型表面、裂缝形状和大小的裂缝。该模型通过准确检测不连续、模糊裂纹、裂纹区域内的非裂纹区域、模糊图像和复杂裂纹轮廓,证明了鲁棒性和通用性。此外,当与其他最近的裂缝分割模型相比,所提出的模型达到了最先进的性能,在五个关键指标上显著优于它们:准确性(0.971),精度(0.807),召回率(0.756),f1分数(0.774)和IoU(0.631)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Hybrid-Segmentor: Hybrid approach for automated fine-grained crack segmentation in civil infrastructure
It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Automation in Construction
Automation in Construction 工程技术-工程:土木
CiteScore
19.20
自引率
16.50%
发文量
563
审稿时长
8.5 months
期刊介绍: Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities. The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信