Ronghua Fu , Yufeng Zhang , Kai Zhu , Alfred Strauss , Maosen Cao
{"title":"通过增强型 \"只看一次 \"网络实时检测混凝土裂缝:算法和软件","authors":"Ronghua Fu , Yufeng Zhang , Kai Zhu , Alfred Strauss , Maosen Cao","doi":"10.1016/j.advengsoft.2024.103691","DOIUrl":null,"url":null,"abstract":"<div><p>Deep learning algorithms have been employed for real-time concrete crack detection. However, many algorithms are not specifically tailored for this purpose. Moreover, their lightweight iterations are generally optimized at the macro-model level, leaving room for further lightweight enhancements at the block level. Therefore, this study developed an enhanced YOLOv3 (You Only Look Once Network v3) model, named YOLO-Crack. The structural optimization of the model takes into consideration the shapes of concrete cracks in the dataset. Meanwhile, two multiple branch-shaped blocks based on dilated convolutions, convolutions and pooling operations were proposed. The two blocks, incorporating depthwise separable convolutions and attention mechanisms, were used to rebuild the model at the block level. These enhancements significantly reduce the size and improve the detection performance of YOLO-Crack. Furthermore, YOLO-Crack was softwareized for real-time detection of concrete cracks. The software was designed to support parallel computing, allowing for real-time detection of concrete cracks even on laptops with limited computing power. It was utilized to detect cracks on concrete roads at a university in Nanjing, China, enabling real-time detection at a frame rate of 30 frames per second with satisfactory accuracy.</p></div>","PeriodicalId":50866,"journal":{"name":"Advances in Engineering Software","volume":"195 ","pages":"Article 103691"},"PeriodicalIF":4.0000,"publicationDate":"2024-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Real-time detection of concrete cracks via enhanced You Only Look Once Network: Algorithm and software\",\"authors\":\"Ronghua Fu , Yufeng Zhang , Kai Zhu , Alfred Strauss , Maosen Cao\",\"doi\":\"10.1016/j.advengsoft.2024.103691\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Deep learning algorithms have been employed for real-time concrete crack detection. However, many algorithms are not specifically tailored for this purpose. Moreover, their lightweight iterations are generally optimized at the macro-model level, leaving room for further lightweight enhancements at the block level. Therefore, this study developed an enhanced YOLOv3 (You Only Look Once Network v3) model, named YOLO-Crack. The structural optimization of the model takes into consideration the shapes of concrete cracks in the dataset. Meanwhile, two multiple branch-shaped blocks based on dilated convolutions, convolutions and pooling operations were proposed. The two blocks, incorporating depthwise separable convolutions and attention mechanisms, were used to rebuild the model at the block level. These enhancements significantly reduce the size and improve the detection performance of YOLO-Crack. Furthermore, YOLO-Crack was softwareized for real-time detection of concrete cracks. The software was designed to support parallel computing, allowing for real-time detection of concrete cracks even on laptops with limited computing power. It was utilized to detect cracks on concrete roads at a university in Nanjing, China, enabling real-time detection at a frame rate of 30 frames per second with satisfactory accuracy.</p></div>\",\"PeriodicalId\":50866,\"journal\":{\"name\":\"Advances in Engineering Software\",\"volume\":\"195 \",\"pages\":\"Article 103691\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2024-06-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advances in Engineering Software\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S096599782400098X\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Engineering Software","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S096599782400098X","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
摘要
深度学习算法已被用于实时混凝土裂缝检测。然而,许多算法并不是专门为此目的定制的。此外,这些算法的轻量级迭代一般都是在宏观模型层面上进行优化的,这就为在区块层面上进行进一步的轻量级增强留下了空间。因此,本研究开发了一个增强型 YOLOv3(You Only Look Once Network v3)模型,命名为 YOLO-Crack。该模型的结构优化考虑了数据集中混凝土裂缝的形状。同时,提出了两个基于扩张卷积、卷积和池化操作的多分支形状块。这两个块结合了深度可分离卷积和关注机制,用于在块级重建模型。这些改进大大缩小了 YOLO-Crack 的体积,提高了其检测性能。此外,YOLO-Crack 还被软件化,用于实时检测混凝土裂缝。该软件的设计支持并行计算,即使在计算能力有限的笔记本电脑上也能实时检测混凝土裂缝。该软件被用于检测中国南京某大学混凝土道路上的裂缝,以每秒 30 帧的帧速率进行实时检测,检测精度令人满意。
Real-time detection of concrete cracks via enhanced You Only Look Once Network: Algorithm and software
Deep learning algorithms have been employed for real-time concrete crack detection. However, many algorithms are not specifically tailored for this purpose. Moreover, their lightweight iterations are generally optimized at the macro-model level, leaving room for further lightweight enhancements at the block level. Therefore, this study developed an enhanced YOLOv3 (You Only Look Once Network v3) model, named YOLO-Crack. The structural optimization of the model takes into consideration the shapes of concrete cracks in the dataset. Meanwhile, two multiple branch-shaped blocks based on dilated convolutions, convolutions and pooling operations were proposed. The two blocks, incorporating depthwise separable convolutions and attention mechanisms, were used to rebuild the model at the block level. These enhancements significantly reduce the size and improve the detection performance of YOLO-Crack. Furthermore, YOLO-Crack was softwareized for real-time detection of concrete cracks. The software was designed to support parallel computing, allowing for real-time detection of concrete cracks even on laptops with limited computing power. It was utilized to detect cracks on concrete roads at a university in Nanjing, China, enabling real-time detection at a frame rate of 30 frames per second with satisfactory accuracy.
期刊介绍:
The objective of this journal is to communicate recent and projected advances in computer-based engineering techniques. The fields covered include mechanical, aerospace, civil and environmental engineering, with an emphasis on research and development leading to practical problem-solving.
The scope of the journal includes:
• Innovative computational strategies and numerical algorithms for large-scale engineering problems
• Analysis and simulation techniques and systems
• Model and mesh generation
• Control of the accuracy, stability and efficiency of computational process
• Exploitation of new computing environments (eg distributed hetergeneous and collaborative computing)
• Advanced visualization techniques, virtual environments and prototyping
• Applications of AI, knowledge-based systems, computational intelligence, including fuzzy logic, neural networks and evolutionary computations
• Application of object-oriented technology to engineering problems
• Intelligent human computer interfaces
• Design automation, multidisciplinary design and optimization
• CAD, CAE and integrated process and product development systems
• Quality and reliability.