Jiayi Liu , Zhenlu Xu , Wenjun Xu , Lei Qi , Yuning Han , Zude Zhou
{"title":"基于数字孪生的深度q网络的不确定不可拆卸条件下机器人拆卸序列动态规划","authors":"Jiayi Liu , Zhenlu Xu , Wenjun Xu , Lei Qi , Yuning Han , Zude Zhou","doi":"10.1016/j.rcim.2025.103132","DOIUrl":null,"url":null,"abstract":"<div><div>As an important step in recycling the end-of-life products, robotic disassembly can reduce human labor costs and robotic disassembly sequence planning helps to improve efficiency. The irremovable condition of components is uncertain and must be recognized during the robotic disassembly process. This uncertainty leads to the inapplicability of the optimal disassembly solution generated by pre-planning method, which impossibly considers the accurate irremovable condition prior to disassembly. To address the robotic disassembly sequence dynamic planning problem under the uncertain irremovable condition, this paper leverages a digital twin model and a dueling deep-Q network to dynamically generate the optimal solutions according to the recognized irremovable condition. First, a digital twin framework is proposed and the digital twin of the robotic disassembly process is built. Next, a dueling deep-Q network is utilized to solve the proposed problem. Case studies on a camera and a gear pump are conducted to validate the proposed method. Experimental analyses include the connection tests, the error assessments of the digital twin, and the performance evaluations of the algorithm under different scenarios. Results demonstrate that the trained model dynamically generates superior disassembly sequences tailored to the recognized irremovable condition within a reasonable time compared with the other algorithms.</div></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"98 ","pages":"Article 103132"},"PeriodicalIF":11.4000,"publicationDate":"2025-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robotic disassembly sequence dynamic planning under uncertain irremovable condition using dueling deep Q-network based on digital twin\",\"authors\":\"Jiayi Liu , Zhenlu Xu , Wenjun Xu , Lei Qi , Yuning Han , Zude Zhou\",\"doi\":\"10.1016/j.rcim.2025.103132\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As an important step in recycling the end-of-life products, robotic disassembly can reduce human labor costs and robotic disassembly sequence planning helps to improve efficiency. The irremovable condition of components is uncertain and must be recognized during the robotic disassembly process. This uncertainty leads to the inapplicability of the optimal disassembly solution generated by pre-planning method, which impossibly considers the accurate irremovable condition prior to disassembly. To address the robotic disassembly sequence dynamic planning problem under the uncertain irremovable condition, this paper leverages a digital twin model and a dueling deep-Q network to dynamically generate the optimal solutions according to the recognized irremovable condition. First, a digital twin framework is proposed and the digital twin of the robotic disassembly process is built. Next, a dueling deep-Q network is utilized to solve the proposed problem. Case studies on a camera and a gear pump are conducted to validate the proposed method. Experimental analyses include the connection tests, the error assessments of the digital twin, and the performance evaluations of the algorithm under different scenarios. Results demonstrate that the trained model dynamically generates superior disassembly sequences tailored to the recognized irremovable condition within a reasonable time compared with the other algorithms.</div></div>\",\"PeriodicalId\":21452,\"journal\":{\"name\":\"Robotics and Computer-integrated Manufacturing\",\"volume\":\"98 \",\"pages\":\"Article 103132\"},\"PeriodicalIF\":11.4000,\"publicationDate\":\"2025-09-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Computer-integrated Manufacturing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0736584525001863\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584525001863","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Robotic disassembly sequence dynamic planning under uncertain irremovable condition using dueling deep Q-network based on digital twin
As an important step in recycling the end-of-life products, robotic disassembly can reduce human labor costs and robotic disassembly sequence planning helps to improve efficiency. The irremovable condition of components is uncertain and must be recognized during the robotic disassembly process. This uncertainty leads to the inapplicability of the optimal disassembly solution generated by pre-planning method, which impossibly considers the accurate irremovable condition prior to disassembly. To address the robotic disassembly sequence dynamic planning problem under the uncertain irremovable condition, this paper leverages a digital twin model and a dueling deep-Q network to dynamically generate the optimal solutions according to the recognized irremovable condition. First, a digital twin framework is proposed and the digital twin of the robotic disassembly process is built. Next, a dueling deep-Q network is utilized to solve the proposed problem. Case studies on a camera and a gear pump are conducted to validate the proposed method. Experimental analyses include the connection tests, the error assessments of the digital twin, and the performance evaluations of the algorithm under different scenarios. Results demonstrate that the trained model dynamically generates superior disassembly sequences tailored to the recognized irremovable condition within a reasonable time compared with the other algorithms.
期刊介绍:
The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.