Tianyong Jiang, Lingyun Li, Bijan Samali, Yang Yu, Ke Huang, Wanli Yan, Lei Wang
{"title":"Lightweight object detection network for multi-damage recognition of concrete bridges in complex environments","authors":"Tianyong Jiang, Lingyun Li, Bijan Samali, Yang Yu, Ke Huang, Wanli Yan, Lei Wang","doi":"10.1111/mice.13219","DOIUrl":null,"url":null,"abstract":"To solve the challenges of low recognition accuracy, slow speed, and weak generalization ability inherent in traditional methods for multi-damage recognition of concrete bridges, this paper proposed an efficient lightweight damage recognition model, constructed by improving the you only look once v4 (YOLOv4) with MobileNetv3 and fused inverted residual blocks, named YOLOMF. First, a novel lightweight network named MobileNetv3 with fused inverted residual (MobileNetv3-FusedIR) is constructed as the backbone network for YOLOMF. This is achieved by integrating the fused mobile inverted bottleneck convolution (Fused-MBConv) into the shallow layers of MobileNetv3. Second, the standard convolution in YOLOv4 is replaced with the depthwise separable convolution, resulting in a reduction in the number of parameters and complexity of the model. Third, the effects of different activation functions on the damage recognition performance of YOLOMF are thoroughly investigated. Finally, to verify the effectiveness of the proposed method in complex environments, a data enhancement library named Imgaug is used to simulate concrete bridge damage images under challenging conditions such as motion blur, fog, rain, snow, noise, and color variations. The results indicate that the YOLOMF shows excellent multi-damage recognition proficiency for concrete bridges across varying field-of-view sizes as well as complex environmental conditions. The detection speed of YOLOMF reaches 85f/s, facilitating effective real-time multi-damage detection for concrete bridges under complex environments.","PeriodicalId":156,"journal":{"name":"Computer-Aided Civil and Infrastructure Engineering","volume":null,"pages":null},"PeriodicalIF":8.5000,"publicationDate":"2024-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer-Aided Civil and Infrastructure Engineering","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1111/mice.13219","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
To solve the challenges of low recognition accuracy, slow speed, and weak generalization ability inherent in traditional methods for multi-damage recognition of concrete bridges, this paper proposed an efficient lightweight damage recognition model, constructed by improving the you only look once v4 (YOLOv4) with MobileNetv3 and fused inverted residual blocks, named YOLOMF. First, a novel lightweight network named MobileNetv3 with fused inverted residual (MobileNetv3-FusedIR) is constructed as the backbone network for YOLOMF. This is achieved by integrating the fused mobile inverted bottleneck convolution (Fused-MBConv) into the shallow layers of MobileNetv3. Second, the standard convolution in YOLOv4 is replaced with the depthwise separable convolution, resulting in a reduction in the number of parameters and complexity of the model. Third, the effects of different activation functions on the damage recognition performance of YOLOMF are thoroughly investigated. Finally, to verify the effectiveness of the proposed method in complex environments, a data enhancement library named Imgaug is used to simulate concrete bridge damage images under challenging conditions such as motion blur, fog, rain, snow, noise, and color variations. The results indicate that the YOLOMF shows excellent multi-damage recognition proficiency for concrete bridges across varying field-of-view sizes as well as complex environmental conditions. The detection speed of YOLOMF reaches 85f/s, facilitating effective real-time multi-damage detection for concrete bridges under complex environments.
期刊介绍:
Computer-Aided Civil and Infrastructure Engineering stands as a scholarly, peer-reviewed archival journal, serving as a vital link between advancements in computer technology and civil and infrastructure engineering. The journal serves as a distinctive platform for the publication of original articles, spotlighting novel computational techniques and inventive applications of computers. Specifically, it concentrates on recent progress in computer and information technologies, fostering the development and application of emerging computing paradigms.
Encompassing a broad scope, the journal addresses bridge, construction, environmental, highway, geotechnical, structural, transportation, and water resources engineering. It extends its reach to the management of infrastructure systems, covering domains such as highways, bridges, pavements, airports, and utilities. The journal delves into areas like artificial intelligence, cognitive modeling, concurrent engineering, database management, distributed computing, evolutionary computing, fuzzy logic, genetic algorithms, geometric modeling, internet-based technologies, knowledge discovery and engineering, machine learning, mobile computing, multimedia technologies, networking, neural network computing, optimization and search, parallel processing, robotics, smart structures, software engineering, virtual reality, and visualization techniques.