June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto
{"title":"Hybrid- segmentor:民用基础设施中自动细粒度裂缝分割的混合方法","authors":"June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto","doi":"10.1016/j.autcon.2024.105960","DOIUrl":null,"url":null,"abstract":"It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"75 1","pages":""},"PeriodicalIF":9.6000,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hybrid-Segmentor: Hybrid approach for automated fine-grained crack segmentation in civil infrastructure\",\"authors\":\"June Moh Goo, Xenios Milidonis, Alessandro Artusi, Jan Boehm, Carlo Ciliberto\",\"doi\":\"10.1016/j.autcon.2024.105960\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).\",\"PeriodicalId\":8660,\"journal\":{\"name\":\"Automation in Construction\",\"volume\":\"75 1\",\"pages\":\"\"},\"PeriodicalIF\":9.6000,\"publicationDate\":\"2025-01-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automation in Construction\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1016/j.autcon.2024.105960\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.autcon.2024.105960","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Hybrid-Segmentor: Hybrid approach for automated fine-grained crack segmentation in civil infrastructure
It is essential to detect and segment cracks in various infrastructures, such as roads and buildings, to ensure safety, longevity, and cost-effective maintenance. Despite deep learning advancements, precise crack detection across diverse conditions remains challenging. This paper introduces Hybrid-Segmentor, a deep learning model combining Convolutional Neural Networks-based and Transformer-based architectures to extract both fine-grained local features and global crack patterns, significantly enhancing crack detection for improved infrastructure maintenance. Hybrid-Segmentor, trained on a large custom dataset created by merging multiple open-source datasets, can accurately detect cracks on different types of surfaces, crack shapes, and sizes. The model demonstrates robustness and versatility by accurately detecting discontinuities, vague cracks, non-crack regions within crack areas, blurred images, and complex crack contours. Furthermore, when compared against other recent models for crack segmentation, the proposed model achieves state-of-the-art performance, significantly outperforming them across five key metrics: accuracy (0.971), precision (0.807), recall (0.756), F1-score (0.774), and IoU (0.631).
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.