Hybrid CNN-LSTM model driven image segmentation and roughness prediction for tool condition assessment with heterogeneous data

IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Xu Zhu , Guilin Chen , Chao Ni , Xubin Lu , Jiang Guo
{"title":"Hybrid CNN-LSTM model driven image segmentation and roughness prediction for tool condition assessment with heterogeneous data","authors":"Xu Zhu ,&nbsp;Guilin Chen ,&nbsp;Chao Ni ,&nbsp;Xubin Lu ,&nbsp;Jiang Guo","doi":"10.1016/j.rcim.2024.102796","DOIUrl":null,"url":null,"abstract":"<div><p>Worn tools might lead to substantial detrimental implications on the surface integrity of workpieces for precision/ultra-precision machining. Most previous research has heavily relied on singular information, which might not be appropriate enough to ascertain tool conditions and guarantee the accuracy of workpieces. This paper proposes a CNN-LSTM hybrid model directly utilizing tool images to predict surface roughness on machined parts for tool condition assessment. This work first performs pruning based on UNet3+ architecture to eliminate redundant structures while integrating attention mechanisms to enhance the model's focus on the target region. On this basis, tool wear region information is intensely mined and heterogeneous data is optimized using Spearman correlation analysis. Subsequently, we innovatively proposed a hybrid model that integrates CNN and RNN, endowing the model with the ability to process spatial and sequential information. The effectiveness of the proposed methodology is validated using the practical data obtained from cutting experiments. The results indicate that the proposed tool condition assessment methodology significantly improves the segmentation accuracy of the tool wear region to 94.52 % (Dice coefficient) and predicts the surface roughness of machined parts with an accuracy exceeding 93.1 % (R<sup>2</sup>). It can be observed that the developed methodology may provide an effective solution for accurate tool condition assessment and the implementation of tool health management.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":null,"pages":null},"PeriodicalIF":9.1000,"publicationDate":"2024-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584524000838","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Worn tools might lead to substantial detrimental implications on the surface integrity of workpieces for precision/ultra-precision machining. Most previous research has heavily relied on singular information, which might not be appropriate enough to ascertain tool conditions and guarantee the accuracy of workpieces. This paper proposes a CNN-LSTM hybrid model directly utilizing tool images to predict surface roughness on machined parts for tool condition assessment. This work first performs pruning based on UNet3+ architecture to eliminate redundant structures while integrating attention mechanisms to enhance the model's focus on the target region. On this basis, tool wear region information is intensely mined and heterogeneous data is optimized using Spearman correlation analysis. Subsequently, we innovatively proposed a hybrid model that integrates CNN and RNN, endowing the model with the ability to process spatial and sequential information. The effectiveness of the proposed methodology is validated using the practical data obtained from cutting experiments. The results indicate that the proposed tool condition assessment methodology significantly improves the segmentation accuracy of the tool wear region to 94.52 % (Dice coefficient) and predicts the surface roughness of machined parts with an accuracy exceeding 93.1 % (R2). It can be observed that the developed methodology may provide an effective solution for accurate tool condition assessment and the implementation of tool health management.

混合 CNN-LSTM 模型驱动的图像分割和粗糙度预测,用于使用异构数据进行工具状况评估
磨损的刀具可能会对精密/超精密加工工件的表面完整性产生重大不利影响。以往的研究大多严重依赖单一信息,这可能不足以确定刀具状况并保证工件的精度。本文提出了一种 CNN-LSTM 混合模型,直接利用刀具图像来预测加工零件的表面粗糙度,以评估刀具状况。这项工作首先基于 UNet3+ 架构进行剪枝,以消除冗余结构,同时整合注意力机制,以提高模型对目标区域的关注度。在此基础上,对刀具磨损区域信息进行了深入挖掘,并利用斯皮尔曼相关性分析对异构数据进行了优化。随后,我们创新性地提出了一种融合 CNN 和 RNN 的混合模型,赋予该模型处理空间和序列信息的能力。通过切削实验获得的实际数据验证了所提方法的有效性。结果表明,所提出的刀具状态评估方法显著提高了刀具磨损区域的分割精度,达到 94.52 %(骰子系数),并能预测加工零件的表面粗糙度,精度超过 93.1 %(R2)。由此可见,所开发的方法可为精确评估刀具状况和实施刀具健康管理提供有效的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Robotics and Computer-integrated Manufacturing
Robotics and Computer-integrated Manufacturing 工程技术-工程:制造
CiteScore
24.10
自引率
13.50%
发文量
160
审稿时长
50 days
期刊介绍: The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信