Self-training method for structural crack detection using image blending-based domain mixing and mutual learning

IF 9.6 1区 工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY
Quang Du Nguyen, Huu-Tai Thai, Son Dong Nguyen
{"title":"Self-training method for structural crack detection using image blending-based domain mixing and mutual learning","authors":"Quang Du Nguyen, Huu-Tai Thai, Son Dong Nguyen","doi":"10.1016/j.autcon.2024.105892","DOIUrl":null,"url":null,"abstract":"Deep learning-based structural crack detection utilizing fully supervised methods requires laborious labeling of training data. Moreover, models trained on one dataset often experience significant performance drops when applied to others due to domain shifts prompted by diverse structures, materials, and environmental conditions. This paper addresses the issues by introducing a robust self-training domain adaptive segmentation (STDASeg) pipeline. STDASeg incorporates an image blending-based domain mixing module to minimize domain discrepancies. Additionally, STDASeg involves a two-stage self-training framework characterized by the mutual learning scheme between Convolutional Neural Networks and Transformers, effectively learning domain invariant features from the two domains. Comprehensive evaluations across three challenging cross-dataset crack detection scenarios highlight the superiority of STDASeg over traditional supervised training approaches and current state-of-the-art methods. These results confirm the stability of STDASeg, thus supporting more efficient infrastructure assessments.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"34 1","pages":""},"PeriodicalIF":9.6000,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.autcon.2024.105892","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Deep learning-based structural crack detection utilizing fully supervised methods requires laborious labeling of training data. Moreover, models trained on one dataset often experience significant performance drops when applied to others due to domain shifts prompted by diverse structures, materials, and environmental conditions. This paper addresses the issues by introducing a robust self-training domain adaptive segmentation (STDASeg) pipeline. STDASeg incorporates an image blending-based domain mixing module to minimize domain discrepancies. Additionally, STDASeg involves a two-stage self-training framework characterized by the mutual learning scheme between Convolutional Neural Networks and Transformers, effectively learning domain invariant features from the two domains. Comprehensive evaluations across three challenging cross-dataset crack detection scenarios highlight the superiority of STDASeg over traditional supervised training approaches and current state-of-the-art methods. These results confirm the stability of STDASeg, thus supporting more efficient infrastructure assessments.
基于图像混合的区域混合和相互学习的结构裂纹检测自训练方法
利用完全监督方法的基于深度学习的结构裂纹检测需要对训练数据进行费力的标记。此外,由于不同的结构、材料和环境条件引起的领域转移,在一个数据集上训练的模型在应用于其他数据集时往往会出现显著的性能下降。本文通过引入鲁棒自训练域自适应分割(STDASeg)管道来解决这些问题。STDASeg结合了一个基于图像混合的域混合模块,以最大限度地减少域差异。此外,STDASeg涉及一个两阶段的自训练框架,该框架以卷积神经网络和变压器之间的相互学习方案为特征,有效地从两个域中学习域不变特征。对三个具有挑战性的跨数据集裂缝检测场景的综合评估突出了STDASeg优于传统的监督训练方法和当前最先进的方法。这些结果证实了STDASeg的稳定性,从而支持更有效的基础设施评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Automation in Construction
Automation in Construction 工程技术-工程:土木
CiteScore
19.20
自引率
16.50%
发文量
563
审稿时长
8.5 months
期刊介绍: Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities. The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信