Wei Ding , Jiangpeng Shu , Carl James Debono , Vijay Prakash , Dylan Seychell , Ruben Paul Borg
{"title":"利用主动学习集成变压器和无人机器人平台对混凝土结构裂缝进行定量评估","authors":"Wei Ding , Jiangpeng Shu , Carl James Debono , Vijay Prakash , Dylan Seychell , Ruben Paul Borg","doi":"10.1016/j.autcon.2024.105829","DOIUrl":null,"url":null,"abstract":"<div><div>Quantitative assessment of cracks in concrete bridges is crucial for structural health monitoring and digital twin. However, the training of crack segmentation models relies heavily on annotation resources, and their segmentation capabilities are often unsatisfactory in terms of the accuracy of boundary location of thin cracks encountered in practice. In this paper, an active-learning-integrated crack segmentation transformer (ACS-Former) framework is proposed to maximize segmentation performance with limited annotation resources. The two-branch ACS-Former includes (1) a feature pyramid transformer (FPT) for multi-scale crack segmentation and (2) boundary difficulty-aware active learning (BDAL) to select informative images for labeling and incorporation into FPT training. Additionally, an adhesive climbing robot is proposed for image collection of hard-to-access components of large bridges. The on-site operational feasibility and practicability of the proposed ACS-Former and climbing robot are demonstrated by field experiments performed on in-service bridges, including the quantification of cracks narrower than 0.2 mm, as required by engineering codes.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":null,"pages":null},"PeriodicalIF":9.6000,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quantitative assessment of cracks in concrete structures using active-learning-integrated transformer and unmanned robotic platform\",\"authors\":\"Wei Ding , Jiangpeng Shu , Carl James Debono , Vijay Prakash , Dylan Seychell , Ruben Paul Borg\",\"doi\":\"10.1016/j.autcon.2024.105829\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Quantitative assessment of cracks in concrete bridges is crucial for structural health monitoring and digital twin. However, the training of crack segmentation models relies heavily on annotation resources, and their segmentation capabilities are often unsatisfactory in terms of the accuracy of boundary location of thin cracks encountered in practice. In this paper, an active-learning-integrated crack segmentation transformer (ACS-Former) framework is proposed to maximize segmentation performance with limited annotation resources. The two-branch ACS-Former includes (1) a feature pyramid transformer (FPT) for multi-scale crack segmentation and (2) boundary difficulty-aware active learning (BDAL) to select informative images for labeling and incorporation into FPT training. Additionally, an adhesive climbing robot is proposed for image collection of hard-to-access components of large bridges. The on-site operational feasibility and practicability of the proposed ACS-Former and climbing robot are demonstrated by field experiments performed on in-service bridges, including the quantification of cracks narrower than 0.2 mm, as required by engineering codes.</div></div>\",\"PeriodicalId\":8660,\"journal\":{\"name\":\"Automation in Construction\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":9.6000,\"publicationDate\":\"2024-10-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automation in Construction\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S092658052400565X\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092658052400565X","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Quantitative assessment of cracks in concrete structures using active-learning-integrated transformer and unmanned robotic platform
Quantitative assessment of cracks in concrete bridges is crucial for structural health monitoring and digital twin. However, the training of crack segmentation models relies heavily on annotation resources, and their segmentation capabilities are often unsatisfactory in terms of the accuracy of boundary location of thin cracks encountered in practice. In this paper, an active-learning-integrated crack segmentation transformer (ACS-Former) framework is proposed to maximize segmentation performance with limited annotation resources. The two-branch ACS-Former includes (1) a feature pyramid transformer (FPT) for multi-scale crack segmentation and (2) boundary difficulty-aware active learning (BDAL) to select informative images for labeling and incorporation into FPT training. Additionally, an adhesive climbing robot is proposed for image collection of hard-to-access components of large bridges. The on-site operational feasibility and practicability of the proposed ACS-Former and climbing robot are demonstrated by field experiments performed on in-service bridges, including the quantification of cracks narrower than 0.2 mm, as required by engineering codes.
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.