A data-driven time-sequence feature-based composite network of time-distributed CNN-LSTM for detecting pore defects in laser penetration welding

IF 5.9 2区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Shenghong Yan, Bo Chen, Caiwang Tan, Xiaoguo Song, Guodong Wang
{"title":"A data-driven time-sequence feature-based composite network of time-distributed CNN-LSTM for detecting pore defects in laser penetration welding","authors":"Shenghong Yan, Bo Chen, Caiwang Tan, Xiaoguo Song, Guodong Wang","doi":"10.1007/s10845-024-02391-6","DOIUrl":null,"url":null,"abstract":"<p>The pore in laser penetration welding significantly deteriorates the mechanical property, and is an important criterion for evaluating the product quality. The intelligent diagnosis of welding can guide the optimization of process parameters to inhibit the pore formation. Considering that the signals in laser welding have time-sequence features and abundant implicitness information may cause high computational effort and information misidentify, an intelligent pore defect diagnosis method based on time–frequency feature extraction and a combined neural network of Convolutional Neural Networks (CNN) and Long short-term memory (LSTM) was proposed. Firstly, the visual signal results of vapor plume demonstrated that the pore formation was accompanied by irregular and continuous variation in vapor plume morphology during the subsequent period. Secondly, this denoising, decomposition, and restructuring of signals were performed by wavelet packet transform, and it was found that the sustaining fluctuation of frequency could localize the pore formation in the corresponding position of weld metal. Therefore, the signal was finely segmented to construct a cube time–frequency spectrogram data with the time-sequence characteristics. Finally, a combined classification model of CNN and LSTM was constructed for recognizing the temporal-spatial information of cube spectrogram data, realizing the online monitoring of pore defect. The results indicated that the proposed method was a promising solution for monitoring pore defect in laser penetration welding and improving product quality.</p>","PeriodicalId":16193,"journal":{"name":"Journal of Intelligent Manufacturing","volume":"48 1","pages":""},"PeriodicalIF":5.9000,"publicationDate":"2024-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s10845-024-02391-6","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The pore in laser penetration welding significantly deteriorates the mechanical property, and is an important criterion for evaluating the product quality. The intelligent diagnosis of welding can guide the optimization of process parameters to inhibit the pore formation. Considering that the signals in laser welding have time-sequence features and abundant implicitness information may cause high computational effort and information misidentify, an intelligent pore defect diagnosis method based on time–frequency feature extraction and a combined neural network of Convolutional Neural Networks (CNN) and Long short-term memory (LSTM) was proposed. Firstly, the visual signal results of vapor plume demonstrated that the pore formation was accompanied by irregular and continuous variation in vapor plume morphology during the subsequent period. Secondly, this denoising, decomposition, and restructuring of signals were performed by wavelet packet transform, and it was found that the sustaining fluctuation of frequency could localize the pore formation in the corresponding position of weld metal. Therefore, the signal was finely segmented to construct a cube time–frequency spectrogram data with the time-sequence characteristics. Finally, a combined classification model of CNN and LSTM was constructed for recognizing the temporal-spatial information of cube spectrogram data, realizing the online monitoring of pore defect. The results indicated that the proposed method was a promising solution for monitoring pore defect in laser penetration welding and improving product quality.

Abstract Image

基于数据驱动的时间序列特征的时间分布 CNN-LSTM 复合网络,用于检测激光熔透焊接中的孔隙缺陷
激光熔透焊接中的气孔会严重恶化机械性能,是评价产品质量的重要标准。焊接智能诊断可以指导工艺参数的优化,从而抑制气孔的形成。考虑到激光焊接信号具有时序特征,丰富的隐含信息可能导致计算量大和信息误判,提出了一种基于时频特征提取和卷积神经网络(CNN)与长短期记忆(LSTM)相结合的孔隙缺陷智能诊断方法。首先,蒸汽羽流的视觉信号结果表明,孔隙的形成伴随着随后一段时间蒸汽羽流形态的不规则连续变化。其次,通过小波包变换对信号进行去噪、分解和重组,发现频率的持续波动可以将孔隙的形成定位在焊缝金属的相应位置。因此,对信号进行精细分割,构建出具有时序特征的立方体时频谱图数据。最后,构建了 CNN 和 LSTM 的组合分类模型,用于识别立方体频谱数据的时空信息,实现了孔隙缺陷的在线监测。结果表明,所提出的方法在激光熔透焊接的孔隙缺陷监测和提高产品质量方面是一种很有前途的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Intelligent Manufacturing
Journal of Intelligent Manufacturing 工程技术-工程:制造
CiteScore
19.30
自引率
9.60%
发文量
171
审稿时长
5.2 months
期刊介绍: The Journal of Nonlinear Engineering aims to be a platform for sharing original research results in theoretical, experimental, practical, and applied nonlinear phenomena within engineering. It serves as a forum to exchange ideas and applications of nonlinear problems across various engineering disciplines. Articles are considered for publication if they explore nonlinearities in engineering systems, offering realistic mathematical modeling, utilizing nonlinearity for new designs, stabilizing systems, understanding system behavior through nonlinearity, optimizing systems based on nonlinear interactions, and developing algorithms to harness and leverage nonlinear elements.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信