Zhaoju Zhu, Wenrong Zhu, Jianwei Huang, Bingwei He
{"title":"An intelligent monitoring system for robotic milling process based on transfer learning and digital twin","authors":"Zhaoju Zhu, Wenrong Zhu, Jianwei Huang, Bingwei He","doi":"10.1016/j.jmsy.2024.12.009","DOIUrl":null,"url":null,"abstract":"<div><div>Robotic milling is becoming widely used in aerospace and auto manufacturing due to its high flexibility and strong adaptability. However, the practical challenges including complex and time-consuming robot trajectory planning, insufficient monitoring, and lacking three-dimensional visualization limits its further application. To address these challenges, an intelligent monitoring system for robotic milling process based on transfer learning and digital twin was proposed and developed in this paper. Firstly, the fundamental framework of this system was conducted based on a five-dimensional digital twin model for motion simulation, visualization, and tool wear prediction during the robotic milling process. Secondly, the parsing algorithm converting NC code to robot’s machining trajectory and material removal algorithm based on bounding box and mesh deformation were proposed for robotic dynamic milling simulation. Thirdly, a novel transfer learning algorithm named CNN-LSTM-TrAdaBoost.R2 was developed by integrating CNN-LSTM with TrAdaBoost.R2 for automated feature extraction and real-time prediction of tool wear. Finally, the effective and accuracy of tool wear prediction algorithm is verified by ablation experiment and the robotic milling simulation is validated by real milling experiment, as well. The results indicate that the proposed monitoring system for robotic milling process demonstrates great virtual-real mapping. It can offer new insights and technical support for constructing sophisticated digital twin frameworks and enhancing operational monitoring in manufacturing systems.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"78 ","pages":"Pages 433-443"},"PeriodicalIF":12.2000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612524003194","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0
Abstract
Robotic milling is becoming widely used in aerospace and auto manufacturing due to its high flexibility and strong adaptability. However, the practical challenges including complex and time-consuming robot trajectory planning, insufficient monitoring, and lacking three-dimensional visualization limits its further application. To address these challenges, an intelligent monitoring system for robotic milling process based on transfer learning and digital twin was proposed and developed in this paper. Firstly, the fundamental framework of this system was conducted based on a five-dimensional digital twin model for motion simulation, visualization, and tool wear prediction during the robotic milling process. Secondly, the parsing algorithm converting NC code to robot’s machining trajectory and material removal algorithm based on bounding box and mesh deformation were proposed for robotic dynamic milling simulation. Thirdly, a novel transfer learning algorithm named CNN-LSTM-TrAdaBoost.R2 was developed by integrating CNN-LSTM with TrAdaBoost.R2 for automated feature extraction and real-time prediction of tool wear. Finally, the effective and accuracy of tool wear prediction algorithm is verified by ablation experiment and the robotic milling simulation is validated by real milling experiment, as well. The results indicate that the proposed monitoring system for robotic milling process demonstrates great virtual-real mapping. It can offer new insights and technical support for constructing sophisticated digital twin frameworks and enhancing operational monitoring in manufacturing systems.
期刊介绍:
The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs.
With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.