{"title":"Plug-and-play method for segmenting concrete bridge cracks using the segment anything model with a fractal dimension matrix prompt","authors":"Shuai Teng, Airong Liu, Zuxiang Situ, Bingcong Chen, Zhihua Wu, Yixiao Zhang, Jialin Wang","doi":"10.1016/j.autcon.2024.105906","DOIUrl":null,"url":null,"abstract":"This paper addresses the diverse scenarios of bridge crack segmentation, proposing a method for detecting cracks on land and underwater using the Segment Anything Model (SAM) prompted by a fractal dimension matrix. The proposed method does not require additional training and obtains fractal feature information of cracks through fractal dimension matrix calculation. These feature information serve as prompt information for SAM to establish a plug-and-play crack segmentation method. The method achieves high detection performance, with a mean accuracy, IoU, and F1-Score of 99.6 %, 0.89, and 0.95 for land cracks, and 97.6 %, 0.89, and 0.95 for underwater cracks, respectively. This represents a significant improvement over methods that do not use the fractal dimension matrix for SAM prompts. Additionally, the method requires no additional training, showcasing excellent generalizability and practical potential for real-world applications in diverse environments.","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"38 1","pages":""},"PeriodicalIF":9.6000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1016/j.autcon.2024.105906","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
This paper addresses the diverse scenarios of bridge crack segmentation, proposing a method for detecting cracks on land and underwater using the Segment Anything Model (SAM) prompted by a fractal dimension matrix. The proposed method does not require additional training and obtains fractal feature information of cracks through fractal dimension matrix calculation. These feature information serve as prompt information for SAM to establish a plug-and-play crack segmentation method. The method achieves high detection performance, with a mean accuracy, IoU, and F1-Score of 99.6 %, 0.89, and 0.95 for land cracks, and 97.6 %, 0.89, and 0.95 for underwater cracks, respectively. This represents a significant improvement over methods that do not use the fractal dimension matrix for SAM prompts. Additionally, the method requires no additional training, showcasing excellent generalizability and practical potential for real-world applications in diverse environments.
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.