Xiangjia Chen , Lip M. Lai , Zishun Liu , Chengkai Dai , Isaac C.W. Leung , Charlie C.L. Wang , Yeung Yam
{"title":"Computer-controlled 3D freeform surface weaving","authors":"Xiangjia Chen , Lip M. Lai , Zishun Liu , Chengkai Dai , Isaac C.W. Leung , Charlie C.L. Wang , Yeung Yam","doi":"10.1016/j.rcim.2024.102819","DOIUrl":"https://doi.org/10.1016/j.rcim.2024.102819","url":null,"abstract":"<div><p>In this paper, we present a new computer-controlled weaving technology that enables the fabrication of woven structures in the shape of given 3D surfaces by using threads in non-traditional materials with high bending-stiffness, allowing for multiple applications with the resultant woven fabrics. A new weaving machine and a new manufacturing process are developed to realize the function of 3D surface weaving by the principle of short-row shaping. A computational solution is investigated to convert input 3D freeform surfaces into the corresponding weaving operations (indicated as W-code) to guide the operation of this system. A variety of examples using cotton threads, conductive threads and optical fibers are fabricated by our prototype system to demonstrate its functionality.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102819"},"PeriodicalIF":9.1,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001066/pdfft?md5=2a6ff944b243475822b56ec9eee2d066&pid=1-s2.0-S0736584524001066-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141593264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yuming Ning , Tuanjie Li , Cong Yao , Wenqian Du , Yan Zhang , Yonghua Huang
{"title":"MT-RSL: A multitasking-oriented robot skill learning framework based on continuous dynamic movement primitives for improving efficiency and quality in robot-based intelligent operation","authors":"Yuming Ning , Tuanjie Li , Cong Yao , Wenqian Du , Yan Zhang , Yonghua Huang","doi":"10.1016/j.rcim.2024.102817","DOIUrl":"https://doi.org/10.1016/j.rcim.2024.102817","url":null,"abstract":"<div><p>Robot skill learning is one of the international advanced directions in the field of robot-based intelligent manufacturing, which makes it possible for robots to learn and operate autonomously in complex real-world environments. In this paper, we propose a multitasking-oriented robot skill learning framework named MT-RSL to improve the efficiency and robustness of multi-task robot skill learning in complex real-world environments, and present the detailed design steps of three key sub-modules included in MT-RSL, namely, sub-task segmentation module, robot skill learning module, and robot configuration optimization module. Firstly, we design a novel sub-task segmentation module based on a coarse-to-fine sub-task segmentation (CF-STS) strategy, in which the Finite State Machine (FSM) is used to analyze complex robot behaviors to obtain a coarse robot sub-task sequence, and the Beta Process Autoregressive Hidden Markov Model (BP-AR-HMM) is used to establish the connection and dependence between multiple demonstration trajectories and encode these trajectories, so as to obtain a finer robot action sequence. Secondly, we extend the basic DMPs system to a continuous dynamic movement primitives (CDMPs) system to construct a novel robot skill learning module, which improves the efficiency of the robot to learn skills and perform actions by orderly coordinating sub-parts such as the activation signals, motion actuator, DMPs-based learning module, and robot configuration optimization module. Then, we design a novel robot configuration optimization module, which introduces the velocity directional manipulability measure (VDM) as the evaluation index of robot kinematic performance to establish the robot configuration optimization model, and proposes an improved probabilistic adaptive particle swarm optimization (Pro-APSO) algorithm to solve this optimization model, so as to obtain the optimal robot configuration. Finally, we develop an experimental testing platform based on the Robot Operating System (ROS) and conduct a series of prototype experiments in complex real-world scenarios. The experimental results demonstrate that our proposed MT-RSL can significantly improve the effectiveness and robustness of multi-task robot skill learning, and can outperform existing robot skill learning methods in terms of both learning efficiency, VDM, and success rate.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102817"},"PeriodicalIF":9.1,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141593262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A methodology for information modelling and analysis of manufacturing processes for digital twins","authors":"Shuo Su, Aydin Nassehi, Qunfen Qi, Ben Hicks","doi":"10.1016/j.rcim.2024.102813","DOIUrl":"10.1016/j.rcim.2024.102813","url":null,"abstract":"<div><p>This paper introduces a methodology for information modelling and analysis of physical manufacturing processes for digital twins (DTs). It aims to establish a comprehensive and fundamental understanding of manufacturing processes regarding the specific purpose of the DT. Through this methodology, information entities within the manufacturing process that can be represented in DTs, along with their essential attributes, are systematically identified. To achieve this, an information model is firstly proposed to define such entities, termed as representative information. The attributes and hierarchy of entities are formulated based on a requirements analysis of the DT lifecycle. An Integration Definition for Process Modelling 0 (IDEF0) model, Petri nets, and a literature-based identification process are applied to represent the manufacturing process’s workflow and identify information entities. Moreover, the relative importance of representing each information entity in a DT is evaluated by integrating domain-specific knowledge with the specific purpose of the DT. Three types of information analysis are suggested, each with its corresponding methods: empirical analysis, theoretical analysis, and experimental analysis. Specifically, this study explores the material extrusion (MEX) process of the Prusa i3 MK3 printer, resulting in an information model consisting of 128 entities including 21 components, 25 activities and 82 properties. These information entities and associated attributes provide a reference for selecting and synchronizing specific physical information in a DT for estimating dimensional accuracy during the MEX process.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102813"},"PeriodicalIF":9.1,"publicationDate":"2024-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001005/pdfft?md5=61c0aeecf4f7efa0ebdabbc063706c3a&pid=1-s2.0-S0736584524001005-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141557048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Machining quality prediction of multi-feature parts using integrated multi-source domain dynamic adaptive transfer learning","authors":"Pei Wang , Jingshuai Qi , Xun Xu , Sheng Yang","doi":"10.1016/j.rcim.2024.102815","DOIUrl":"10.1016/j.rcim.2024.102815","url":null,"abstract":"<div><p>Machining quality prediction of multi-feature parts has been a challenging problem because of small dataset and inconsistent quality data distribution with respect to each machining feature. Transfer learning that leverages knowledge of one task and can be repurposed on another task seems a good solution for this purpose. However, traditional transfer learning typically has a single source domain and a target domain, which limits its applications in multi-source scenarios (e.g., multi-feature). To solve this issue, this paper proposes a novel integrated multi-source domain dynamic adaptive transfer learning (IMD-DATL) framework for machining quality prediction of multi-feature part machining systems. Specifically, a domain-sample similarity double matching multi-source domain integration method is designed to construct the integration knowledge transfer from multiple source domains to the target domain. A residual feature extraction network based on sample entropy-dynamic channel double-layer attention structure and a fine-grained transferable feature attention module are designed. These three attentions are used to improve the feature learning ability and the adaptation level to the predicted object in the three dimensions of sample, channel and data feature. Finally, multiple sets of comparative experiments in thin-walled part machining systems confirm the effectiveness and superiority of the proposed method for cross-domain quality prediction. Compared with other traditional transfer learning methods, the MAE, RMSE and Score on average of this method are increased by 5.47 %, 4.59 % and 4.84 %, respectively, compared with other multi-source domain adaptation methods, the MAE, RMSE and Score on average of this method are increased by 7.13 %, 7.37 % and 6.52 %, respectively.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102815"},"PeriodicalIF":9.1,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001029/pdfft?md5=fa70f9ca61d04cad04c7b99922f48aa1&pid=1-s2.0-S0736584524001029-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141463395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eugen Šlapak , Enric Pardo , Matúš Dopiriak , Taras Maksymyuk , Juraj Gazda
{"title":"Neural radiance fields in the industrial and robotics domain: Applications, research opportunities and use cases","authors":"Eugen Šlapak , Enric Pardo , Matúš Dopiriak , Taras Maksymyuk , Juraj Gazda","doi":"10.1016/j.rcim.2024.102810","DOIUrl":"10.1016/j.rcim.2024.102810","url":null,"abstract":"<div><p>The proliferation of technologies, such as extended reality (XR), has increased the demand for high-quality three-dimensional (3D) graphical representations. Industrial 3D applications encompass computer-aided design (CAD), finite element analysis (FEA), scanning, and robotics. However, current methods employed for industrial 3D representations suffer from high implementation costs and reliance on manual human input for accurate 3D modeling. To address these challenges, neural radiance fields (NeRFs) have emerged as a promising approach for learning 3D scene representations based on provided training 2D images. Despite a growing interest in NeRFs, their potential applications in various industrial subdomains are still unexplored. In this paper, we deliver a comprehensive examination of NeRF industrial applications while also providing direction for future research endeavors. We also present a series of proof-of-concept experiments that demonstrate the potential of NeRFs in the industrial domain. These experiments include NeRF-based video compression techniques and using NeRFs for 3D motion estimation in the context of collision avoidance. In the video compression experiment, our results show compression savings up to 48% and 74% for resolutions of 1920x1080 and 300x168, respectively. The motion estimation experiment used a 3D animation of a robotic arm to train Dynamic-NeRF (D-NeRF) and achieved an average peak signal-to-noise ratio (PSNR) of disparity map with the value of 23 dB and a structural similarity index measure (SSIM) 0.97.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102810"},"PeriodicalIF":9.1,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141463259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An overview of stiffening approaches for continuum robots","authors":"Yeman Fan , Bowen Yi , Dikai Liu","doi":"10.1016/j.rcim.2024.102811","DOIUrl":"10.1016/j.rcim.2024.102811","url":null,"abstract":"<div><p>Continuum robots have become more popular recently due to their scalable dexterity and mobility. However, they may suffer from issues like insufficient stiffness because they are designed to promote their flexibility. To address this issue and further improve their performance in all different application scenarios, stiffness flexibility is essential for this type of robot. Therefore, it is necessary to integrate <em>stiffening</em> techniques into both their mechanical structure and actuation approaches when developing continuum robots. To this end, it is crucial to explore how different stiffening approaches can be applied to various types of continuum robots across diverse applications. The primary goal of this survey paper is to provide a comprehensive review of the state-of-the-art research on stiffening techniques for continuum robots over the last two decades. We thoroughly analyse key techniques related to stiffness tunability mechanisms and stiffening methods. Additionally, we categorise these stiffening approaches on the basis of their properties and seek to understand the factors that limit their performance. This survey paper aims to assist robotic engineers in selecting appropriate stiffening techniques when designing continuum robots and serve as a basis for developing potential next-generation stiffening mechanisms.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102811"},"PeriodicalIF":9.1,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141463512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marlon Löppenberg , Steve Yuwono , Mochammad Rizky Diprasetya, Andreas Schwung
{"title":"Dynamic robot routing optimization: State–space decomposition for operations research-informed reinforcement learning","authors":"Marlon Löppenberg , Steve Yuwono , Mochammad Rizky Diprasetya, Andreas Schwung","doi":"10.1016/j.rcim.2024.102812","DOIUrl":"10.1016/j.rcim.2024.102812","url":null,"abstract":"<div><p>There is a growing interest in implementing artificial intelligence for operations research in the industrial environment. While numerous classic operations research solvers ensure optimal solutions, they often struggle with real-time dynamic objectives and environments, such as dynamic routing problems, which require periodic algorithmic recalibration. To deal with dynamic environments, deep reinforcement learning has shown great potential with its capability as a self-learning and optimizing mechanism. However, the real-world applications of reinforcement learning are relatively limited due to lengthy training time and inefficiency in high-dimensional state spaces. In this study, we introduce two methods to enhance reinforcement learning for dynamic routing optimization. The first method involves transferring knowledge from classic operations research solvers to reinforcement learning during training, which accelerates exploration and reduces lengthy training time. The second method uses a state–space decomposer to transform the high-dimensional state space into a low-dimensional latent space, which allows the reinforcement learning agent to learn efficiently in the latent space. Lastly, we demonstrate the applicability of our approach in an industrial application of an automated welding process, where our approach identifies the shortest welding pathway of an industrial robotic arm to weld a set of dynamically changing target nodes, poses and sizes. The suggested method cuts computation time by 25% to 50% compared to classic routing algorithms.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102812"},"PeriodicalIF":9.1,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524000991/pdfft?md5=ab4f57a94d511a4d5a4e9b1c724edd3f&pid=1-s2.0-S0736584524000991-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141463396","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Xiaoting Dong , Guangxi Wan , Peng Zeng , Chunhe Song , Shijie Cui , Yiyang Liu
{"title":"Hierarchical online automated planning for a flexible manufacturing system","authors":"Xiaoting Dong , Guangxi Wan , Peng Zeng , Chunhe Song , Shijie Cui , Yiyang Liu","doi":"10.1016/j.rcim.2024.102807","DOIUrl":"10.1016/j.rcim.2024.102807","url":null,"abstract":"<div><p>Task planning and action planning for workshop machines are essential for modern manufacturing. Traditionally, these two problems are solved independently with elaborate manual methods. However, personalized customization introduces more dynamic exogenous events into the manufacturing system, and it is then impossible to consider all possible dynamic scenarios manually. This paper focuses on online automated planning, generating new plans automatically in response to new dynamic situations. We first formulate the planning problem for a flexible manufacturing system as a fully observable nondeterministic planning problem. Second, a hierarchical automated online planning approach is presented. Finally, the effectiveness of the proposed approach is verified by an ARIAC 2022 competition environment.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102807"},"PeriodicalIF":9.1,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141463248","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Cloud-edge collaboration composition and scheduling for flexible manufacturing service with a multi-population co-evolutionary algorithm","authors":"Weimin Jing , Yonghui Zhang , Youling Chen , Huan Zhang , Wen Huang","doi":"10.1016/j.rcim.2024.102814","DOIUrl":"https://doi.org/10.1016/j.rcim.2024.102814","url":null,"abstract":"<div><p>The Cloud Manufacturing Service Composition and Scheduling (CMfg-SCS) are essential processes in cloud manufacturing. Flexible Manufacturing Services (FMS), such as those provided by industrial robots, are widely used in cloud manufacturing to improve service quality and efficiency. Traditional CMfg-SCS methodologies, however, fall short in effectively managing the inherent temporal-dynamic QoS and flexible capability of FMS. To overcome these challenges, we propose a novel Cloud Manufacturing Service Cloud-edge Collaboration Composition and Scheduling (CMfg-SCCCS) method for FMS. Firstly, the service-task matching hypernetwork is constructed, and the temporal-dynamic QoS and flexible capacity of FMS are modeled. Subsequently, we develop a CMfg-SCCCS optimization model aimed at three objectives, along with a cloud-edge collaboration scheduling mechanism to harmonize cloud and edge-local tasks. Finally, a multi-population co-evolution algorithm with adaptive meta-knowledge transfer mechanism is proposed to solve the complex optimization model. The computational experiments serve to validate the effectiveness of the CMfg-SCCCS method and further reveal the superiority of the co-evolution algorithm in enhancing both the convergence and diversity of the population.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102814"},"PeriodicalIF":9.1,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141434743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A novel method to enhance the accuracy of parameter identification in elasto-geometrical calibration for industrial robots","authors":"Shihang Yu, Jie Nan, Yuwen Sun","doi":"10.1016/j.rcim.2024.102809","DOIUrl":"https://doi.org/10.1016/j.rcim.2024.102809","url":null,"abstract":"<div><p>Elasto-geometrical calibration is crucial for enhancing the absolute accuracy of robots in machining operations through the identification and compensation of parameter errors. However, the presence of inconsistent measurement units and improper selection of measuring poses can result in the ill-conditioned identification matrix (ICIM) issue, consequently impacting the accuracy of parameter identification. This paper introduces a novel method to tackle this challenge. Initially, an elasto-geometrical error model is developed based on the orientation-independent measurements (OIM), efficiently reducing the impact of mismatched positions and orientations on the ICIM problem. Subsequently, a PSO-SFFS algorithm is proposed to optimize the measurement configurations and minimize the influence of measurement noise. Furthermore, the incorporation of screw theory and the consideration of parallelogram mechanisms enhance the precision and comprehensiveness of the error model. Subsequent to the development of the error model, calibration comparison experiments are conducted on an industrial robot. Both simulation and experimental results validate the effectiveness of the proposed method in improving parameter identification accuracy.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"90 ","pages":"Article 102809"},"PeriodicalIF":9.1,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141434742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}