利用深度学习方法识别和分类高强度螺栓的微观疲劳断裂图像

Shujia Zhang , Liang Zhang , Guoqing Wang , Zichun Zhou , Honggang Lei
{"title":"利用深度学习方法识别和分类高强度螺栓的微观疲劳断裂图像","authors":"Shujia Zhang ,&nbsp;Liang Zhang ,&nbsp;Guoqing Wang ,&nbsp;Zichun Zhou ,&nbsp;Honggang Lei","doi":"10.1016/j.iintel.2024.100097","DOIUrl":null,"url":null,"abstract":"<div><p>The fracture surface of high-strength bolt after fatigue fracture contains a lot of information, such as the location of stress concentration and the distribution of fatigue cracks. In this study, a large number of scanning electron microscope (SEM) images of fatigue fracture surface of broken high-strength bolt were identified and classified using the method of deep learning. At the beginning, a data set of SEM images containing 1556 fatigue fractures of high-strength bolts was prepared. Then, three convolutional neural networks, VGG16, ResNets50 and MobileNets, were used to recognize and classify the images in the dataset. In this process, part of the convolution layer of ResNets50 was extracted for visualization. At the same time, the Loss-Epoch curves, accuracy, recall and confusion matrices of the three networks were derived to evaluate the nets. Finally, the network with the highest accuracy was selected to adjust the parameters to further improve the accuracy of the classification. It was found that the three nets can complete the classification of these images. MobileNets had the best performance for this classification task, and the accuracy rate after adjusting the parameters has reached 86.76%. For some images with obvious features, the recall rate of classification had reached 100%. However, images from the same fatigue area were prone to a small amount of confusion. Finally, the feature map of the network would become more abstract with the deepening of the network, and the features of the image concerned by each convolution layer were also different.</p></div>","PeriodicalId":100791,"journal":{"name":"Journal of Infrastructure Intelligence and Resilience","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772991524000161/pdfft?md5=cd441d727cd921753848e40590210bf2&pid=1-s2.0-S2772991524000161-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Recognition and classification of microscopic fatigue fracture images of high-strength bolt using deep learning methods\",\"authors\":\"Shujia Zhang ,&nbsp;Liang Zhang ,&nbsp;Guoqing Wang ,&nbsp;Zichun Zhou ,&nbsp;Honggang Lei\",\"doi\":\"10.1016/j.iintel.2024.100097\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The fracture surface of high-strength bolt after fatigue fracture contains a lot of information, such as the location of stress concentration and the distribution of fatigue cracks. In this study, a large number of scanning electron microscope (SEM) images of fatigue fracture surface of broken high-strength bolt were identified and classified using the method of deep learning. At the beginning, a data set of SEM images containing 1556 fatigue fractures of high-strength bolts was prepared. Then, three convolutional neural networks, VGG16, ResNets50 and MobileNets, were used to recognize and classify the images in the dataset. In this process, part of the convolution layer of ResNets50 was extracted for visualization. At the same time, the Loss-Epoch curves, accuracy, recall and confusion matrices of the three networks were derived to evaluate the nets. Finally, the network with the highest accuracy was selected to adjust the parameters to further improve the accuracy of the classification. It was found that the three nets can complete the classification of these images. MobileNets had the best performance for this classification task, and the accuracy rate after adjusting the parameters has reached 86.76%. For some images with obvious features, the recall rate of classification had reached 100%. However, images from the same fatigue area were prone to a small amount of confusion. Finally, the feature map of the network would become more abstract with the deepening of the network, and the features of the image concerned by each convolution layer were also different.</p></div>\",\"PeriodicalId\":100791,\"journal\":{\"name\":\"Journal of Infrastructure Intelligence and Resilience\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2772991524000161/pdfft?md5=cd441d727cd921753848e40590210bf2&pid=1-s2.0-S2772991524000161-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Infrastructure Intelligence and Resilience\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2772991524000161\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Infrastructure Intelligence and Resilience","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772991524000161","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

高强度螺栓疲劳断裂后的断裂面包含大量信息,如应力集中的位置和疲劳裂纹的分布。本研究利用深度学习方法对大量高强度螺栓疲劳断裂表面的扫描电子显微镜(SEM)图像进行了识别和分类。首先,编制了包含 1556 个高强度螺栓疲劳断裂的 SEM 图像数据集。然后,使用 VGG16、ResNets50 和 MobileNets 这三种卷积神经网络对数据集中的图像进行识别和分类。在此过程中,提取了 ResNets50 的部分卷积层用于可视化。同时,还得出了三个网络的损失-时间曲线、准确率、召回率和混淆矩阵,以对网络进行评估。最后,选择准确率最高的网络调整参数,进一步提高分类的准确率。结果发现,三个网络都能完成这些图像的分类。移动网络在这项分类任务中表现最好,调整参数后的准确率达到了 86.76%。对于一些特征明显的图像,分类的召回率达到了 100%。不过,来自同一疲劳区的图像容易出现少量混淆。最后,网络的特征图会随着网络的加深而变得更加抽象,每个卷积层所关注的图像特征也不尽相同。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Recognition and classification of microscopic fatigue fracture images of high-strength bolt using deep learning methods

The fracture surface of high-strength bolt after fatigue fracture contains a lot of information, such as the location of stress concentration and the distribution of fatigue cracks. In this study, a large number of scanning electron microscope (SEM) images of fatigue fracture surface of broken high-strength bolt were identified and classified using the method of deep learning. At the beginning, a data set of SEM images containing 1556 fatigue fractures of high-strength bolts was prepared. Then, three convolutional neural networks, VGG16, ResNets50 and MobileNets, were used to recognize and classify the images in the dataset. In this process, part of the convolution layer of ResNets50 was extracted for visualization. At the same time, the Loss-Epoch curves, accuracy, recall and confusion matrices of the three networks were derived to evaluate the nets. Finally, the network with the highest accuracy was selected to adjust the parameters to further improve the accuracy of the classification. It was found that the three nets can complete the classification of these images. MobileNets had the best performance for this classification task, and the accuracy rate after adjusting the parameters has reached 86.76%. For some images with obvious features, the recall rate of classification had reached 100%. However, images from the same fatigue area were prone to a small amount of confusion. Finally, the feature map of the network would become more abstract with the deepening of the network, and the features of the image concerned by each convolution layer were also different.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
2.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信