Vision‐based robust missing and loosened bolt detection for splice plate joints

Zhidong Yao, Zhihua Chen, Hongbo Liu, Jiaqi Lu
{"title":"Vision‐based robust missing and loosened bolt detection for splice plate joints","authors":"Zhidong Yao, Zhihua Chen, Hongbo Liu, Jiaqi Lu","doi":"10.1002/tal.2099","DOIUrl":null,"url":null,"abstract":"SummaryVision‐based bolt defect detection methods based on feature changes have been reported. However, the robustness of key feature extraction and bolt detection requires improvement. This paper proposes a robust missing and loose bolt defect detection approach. The key features—reference points for perspective correction and the straight lines of the bolt edges—are extracted from the masks obtained by semantic segmentation models. The true and false bolt discrimination approach based on the mask shape can help improve bolt object detection accuracy. Overlapping between the bolt bounding boxes in the reference and detection images indicates missing bolts. The rotation angles reveal loosened bolts. The proposed approach was tested on fabricated bolted joint specimens and a steel railway bridge. The results suggest that these improvements ensure defect detection accuracy, with a miss rate of only 1% for missing bolt detection. Moreover, a loosened bolt with only 3° rotation is successfully detected. This approach has promising potential applicability in automatically detecting bolt defects in large steel structures.","PeriodicalId":501238,"journal":{"name":"The Structural Design of Tall and Special Buildings","volume":"21 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Structural Design of Tall and Special Buildings","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/tal.2099","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

SummaryVision‐based bolt defect detection methods based on feature changes have been reported. However, the robustness of key feature extraction and bolt detection requires improvement. This paper proposes a robust missing and loose bolt defect detection approach. The key features—reference points for perspective correction and the straight lines of the bolt edges—are extracted from the masks obtained by semantic segmentation models. The true and false bolt discrimination approach based on the mask shape can help improve bolt object detection accuracy. Overlapping between the bolt bounding boxes in the reference and detection images indicates missing bolts. The rotation angles reveal loosened bolts. The proposed approach was tested on fabricated bolted joint specimens and a steel railway bridge. The results suggest that these improvements ensure defect detection accuracy, with a miss rate of only 1% for missing bolt detection. Moreover, a loosened bolt with only 3° rotation is successfully detected. This approach has promising potential applicability in automatically detecting bolt defects in large steel structures.
基于视觉的拼接板接头螺栓缺失和松动鲁棒检测
摘要 基于特征变化的视觉螺栓缺陷检测方法已有报道。然而,关键特征提取和螺栓检测的鲁棒性有待提高。本文提出了一种稳健的缺失和松动螺栓缺陷检测方法。关键特征--用于透视校正的参考点和螺栓边缘的直线--是从语义分割模型获得的掩模中提取的。基于掩模形状的真假螺栓判别方法有助于提高螺栓对象检测的准确性。参考图像和检测图像中的螺栓边界框重叠表示螺栓缺失。旋转角度显示螺栓松动。我们在制造的螺栓连接试样和钢结构铁路桥梁上对所提出的方法进行了测试。结果表明,这些改进确保了缺陷检测的准确性,螺栓缺失检测的漏检率仅为 1%。此外,仅旋转 3° 的松动螺栓也能成功检测出来。这种方法在自动检测大型钢结构中的螺栓缺陷方面具有广阔的应用前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信