Hanbo Yang , Gedong Jiang , Wenwen Tian , Xuesong Mei , A.Y.C. Nee , S.K. Ong
{"title":"Microservice-based digital twin system towards smart manufacturing","authors":"Hanbo Yang , Gedong Jiang , Wenwen Tian , Xuesong Mei , A.Y.C. Nee , S.K. Ong","doi":"10.1016/j.rcim.2024.102858","DOIUrl":"10.1016/j.rcim.2024.102858","url":null,"abstract":"<div><p>Digital Twin (DT) is a promising technology that offers versatile services to enhance manufacturing intelligence. However, the agility, reliability and analysis capabilities of existing DT services are severely challenged when applied and deployed at large-scale production lines. To address the aforementioned issues, a microservice-based DT system with redundant architecture is proposed. First, a scalable microservice-based DT system compatible with standard and tailored plug-and-play DT services is constructed for DT protocol adaptation, stream processing, information and model management. Concurrently, a generic information model is proposed to represent the entire production lifecycle from design, operation, and maintenance in a structured manner. Second, an industrial multi-task DT model is introduced, leveraging the aforementioned architecture, to effectively achieve parallel monitoring of surface roughness and tool wear. Finally, industrial manufacturing cases are introduced to verify the feasibility and effectiveness of the proposed system. The results show that heterogeneous DT data are transferred and managed reliably, with a mean absolute percentage error of 1.28% for surface roughness prediction, and 85.71% accuracy in tool wear diagnosis.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102858"},"PeriodicalIF":9.1,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142045854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wei Ma , Tianliang Hu , Chengrui Zhang , Qizhi Chen
{"title":"Adaptive remanufacturing for freeform surface parts based on linear laser scanner and robotic laser cladding","authors":"Wei Ma , Tianliang Hu , Chengrui Zhang , Qizhi Chen","doi":"10.1016/j.rcim.2024.102855","DOIUrl":"10.1016/j.rcim.2024.102855","url":null,"abstract":"<div><p>Freeform surface parts play a significant role in the aerospace industry, the mold- manufacturing industry and the automobile industry, and it is energy-saving, material-saving, time-saving and environmentally beneficial to remanufacture the damaged components to restore their functionality and performance. Due to the complex geometry of the freeform surface wear, the adaptive remanufacturing of freeform surface parts is confronted with challenges. In this paper, an adaptive remanufacturing method for freeform surface parts based on linear laser scanner and robotic laser cladding is proposed to realize the precise freeform surface measurement and optimized remanufacturing path generation. On the one hand, a systematic wear measurement and assessment method is proposed to precisely locate and quantify the wear. With the noncontact calibration of the laser scanner and industrial robot, the contour of the target surface is real-timely measured and the reverse model is efficiently constructed, which provides detailed 3D morphological information of the worn freeform surface for the latter wear analysis. Next, considering the considerable difference between the reverse model and the nominal model, a refined model aligning method weighted by surface wear segmentation is proposed to minimize the alignment error and, further, the difference entity to be additively manufactured is obtained by discrete model comparison. On the other hand, to cope with the unsatisfactory binding strength over the freeform surface basis and small fragments of the working path for the traditional plane or cylinder slicing method, a novel remanufacturing path generation method is proposed. Considering the curvature distribution of the freeform surface, an optimized equidistant freeform surface slicing method is especially proposed for the difference entity to realize the adaptive fitting to the freeform basin. Furthermore, based on the equivalent volume overlapping model of laser cladding, the cladding track filling method for the freeform surface slicing is designed with the optimized track-to-track distance, which can reduce surface waviness and improve remanufacturing efficiency. Finally, simulations and experiments for the remanufacturing scenario of the steam turbine blade are conducted to verify the validity and feasibility of the proposed adaptive remanufacturing method for freeform surface parts based on linear laser scanner and robotic laser cladding.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102855"},"PeriodicalIF":9.1,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142045943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jiazhen Pang, Pai Zheng, Junming Fan, Tianyuan Liu
{"title":"Towards cognition-augmented human-centric assembly: A visual computation perspective","authors":"Jiazhen Pang, Pai Zheng, Junming Fan, Tianyuan Liu","doi":"10.1016/j.rcim.2024.102852","DOIUrl":"10.1016/j.rcim.2024.102852","url":null,"abstract":"<div><p>Human-centric assembly is emerging as a promising paradigm for achieving mass personalization in the context of Industry 5.0, as it fully capitalizes on the advantages of human flexibility with robot assistance. However, in small-batch and highly customized assembly tasks, frequently changes in production procedures pose significant cognition challenges. To address this, leveraging computer vision technology to enhance human cognition becomes a feasible solution. Therefore, this review aims to explore the cognitive characteristics of human beings and classify existing computer vision technologies in a manner that discusses the future development of cognition-augmented human-centric assembly. The concept of cognition-augmented assembly is first proposed based on the brain's functional structure - the frontal, parietal, temporal, and occipital lobes. Corresponding to these brain regions, cognitive issues in spatiality, memory, knowledge, and decision-making are summarized. Recent studies conducted between 2014 and 2023 on visual computation of assembly are categorized into four groups: position registration, multi-layer recognition, contextual perception, and mixed-reality fusion, all aimed at addressing these cognitive challenges. The applications and limitations of current computer vision technology are discussed. Furthermore, considering the rapidly evolving technologies such as the metaverse, cloud services, large language models, and brain-computer interfaces, future trends on computer vision are prospected to augment human cognition corresponding to the cognitive issues.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102852"},"PeriodicalIF":9.1,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142040690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lai Wei , Yanzhe Wang , Yibo Hu , Tin Lun Lam , Yanding Wei
{"title":"Online dual robot–human collaboration trajectory generation by convex optimization","authors":"Lai Wei , Yanzhe Wang , Yibo Hu , Tin Lun Lam , Yanding Wei","doi":"10.1016/j.rcim.2024.102850","DOIUrl":"10.1016/j.rcim.2024.102850","url":null,"abstract":"<div><p>For dynamic collision-free trajectory planning in dual-robot and human collaborative tasks, this paper develops an online dual-robot Mutual Collision Avoidance (MCA) scheme based on convex optimization. A novel convex optimization formulation model, named Disciplined Convex programming by Shifting reference paths (DCS), is proposed for solving the single-robot trajectory optimization problem. Furthermore, a new dual-robot trajectory convex optimization algorithm is presented for online adjustment of the dual-robot trajectories according to the collaborative task priority. The overall pipeline, named DCS-MCA, generates collision-free and time-optimal dual-robot trajectories, while prioritizing the task accessibility of the high-priority robot. Simulation experiments demonstrate that DCS exhibits comparable performance to the current state-of-the-art single-robot motion planner, while the DCS-MCA outperforms common algorithms by up to 30% in time optimality for dual-robot collaborative tasks. The feasibility and dynamic performance of the proposed approach are further validated in a real collaborative cell, illustrating its suitability for collaborative dual-robot tasks in moderately dynamic environments.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102850"},"PeriodicalIF":9.1,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142006317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Benchmarking for platform-aggregated manufacturing service collaboration: Methodology and implementation","authors":"Jiawei Ren , Ying Cheng , Yongping Zhang , Fei Tao","doi":"10.1016/j.rcim.2024.102853","DOIUrl":"10.1016/j.rcim.2024.102853","url":null,"abstract":"<div><p>In light of the global economic downturn and the intricate division of labor in manufacturing, the imperative for advanced manufacturing services and Manufacturing Service Collaboration (MSC) has escalated significantly. As manufacturing services gravitate towards aggregation on manufacturing service platforms, platform-aggregated MSC has emerged as an inevitable and compelling trend, capturing the attention of researchers worldwide. However, despite the existence of numerous frameworks, models, operational mechanisms, and algorithms proposed for the platform-aggregated MSC, drawing comparisons between these studies remains a complex endeavor. To address this predicament, this article proposes and explores a novel benchmarking methodology for platform-aggregated MSC. By employing complex network theory, a comprehensive model of platform-aggregated MSC is constructed and supplemented with corresponding methodologies for data generation and the configuration of optimization algorithms. Moreover, pertinent performance evaluation metrics are scrutinized to assess their applicability in the context of platform-aggregated MSC. The article culminates with the execution of a series of platform operation experiments designed to test the effectiveness and practicality of the proposed benchmarking system, thereby contributing to the ongoing evolution of the MSC domain.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102853"},"PeriodicalIF":9.1,"publicationDate":"2024-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141993459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A human-centric methodology for the co-evolution of operators’ skills, digital tools and user interfaces to support the Operator 4.0","authors":"Grandi Fabio , Contini Giuditta , Peruzzini Margherita , Roberto Raffaeli","doi":"10.1016/j.rcim.2024.102854","DOIUrl":"10.1016/j.rcim.2024.102854","url":null,"abstract":"<div><p>The concept of Operator 4.0 has been recently defined to evolve the modern industrial scenarios by defining a knowledge sharing process from/to operators and industrial systems, creating personalized skills, and introducing digital tools towards socially sustainable factories. In this context, dynamic and adaptive user interfaces can make humans part of the intelligent factory system, supporting human work contextually and providing specific contents when needed, preserving the human wellbeing. This paper defines a human-centric methodology for the symbiotic co-evolution of operators’ skills, assistive digital tools and user interfaces, developed within the Horizon Europe project titled “DaCapo - Digital assets and tools for Circular value chains and manufacturing products”. The project focuses on defining a new set of human-centric digital tools and services for the manufacturing industry capable of boosting the application of circular economy (CE) throughout the manufacturing value chains. The proposed methodology can link the specific needs of an industrial case to the definition of the most proper assistive digital tools and functionalities to drive the design of adaptive, proactive user interfaces for the Operator 4.0. The method has been applied and validated on one of the project use cases, involving a manufacturing company operating in warehousing and logistics.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102854"},"PeriodicalIF":9.1,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141990859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Efficient routing in robotic movable fulfillment systems with integer programming: A rolling horizon and heuristic approach","authors":"I-Lin Wang, Tsung-Han Wang","doi":"10.1016/j.rcim.2024.102849","DOIUrl":"10.1016/j.rcim.2024.102849","url":null,"abstract":"<div><p>This paper addresses an integrated rack assignment and robot routing problem arising in robotic movable fulfillment systems (RMFS). This NP-hard planning task goes beyond current literature by simultaneously optimizing movable rack selection and multi-agent collision-free path finding, rather than decomposing them. A mixed integer programming (MIP) model with a new level-space-time network representation is proposed, jointly considering reusable racks, robot-rack pairings, storage repositioning, and collision avoidance. To improve computational efficiency, a fast rolling horizon heuristic and greedy algorithm are developed. Extensive experiments demonstrate that the integrated method's solutions can improve by 30 % upon conventional decomposed approaches. Intriguing test cases reveal the model, suggesting non-intuitive robot carryover policies that are unfound by separate selection and routing methods. This indicates potential optimization benefits from explicitly coordinating task assignment, scheduling, and routing decisions in complex automated warehousing systems. The rolling horizon heuristic solutions approach optimality with much greater efficiency than directly solving one large MIP, validating its practical value. This research provides useful integrated modeling insights, efficient solution algorithms, and decision support for efficiently controlling next-generation robotic movable fulfillment systems.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102849"},"PeriodicalIF":9.1,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141978154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Amedeo Carloni , Marcello Valori , Federico Bertolucci , Lorenzo Agostini , Giovanni Berselli , Irene Fassi , Lorenzo Molinari Tosatti , Rocco Vertechy
{"title":"Enhancing compliant gripper performance: Exploiting electro-adhesion to increase lifting force over grasping force","authors":"Amedeo Carloni , Marcello Valori , Federico Bertolucci , Lorenzo Agostini , Giovanni Berselli , Irene Fassi , Lorenzo Molinari Tosatti , Rocco Vertechy","doi":"10.1016/j.rcim.2024.102843","DOIUrl":"10.1016/j.rcim.2024.102843","url":null,"abstract":"<div><p>On the landscape of solutions to deal with delicate objects, the development and use of soft grippers is a topic of increasing interest, with a large number of prototypes proposed by the research community employing non-linear soft materials and based on diverse actuation means. However, increasing compliance usually leads to the reduction of lifting capacity. As a recent promising approach, shear forces exerted by a soft gripper can be enhanced by exploiting the electro-adhesion (EA) effect. Following this research trend, this paper proposes a new gripper that combines a compliant finger structure, with geometry taken from the FESTO FinRay but made of a softer material (a urethane rubber), and custom EA pads that are placed on the fingers at the interface with the grasped object. Following hyper-elastic model identification of the considered material and preliminary functional verification of gripper design via finite element simulations, the gripper is then manufactured and tested by means of a specific setup, replicating the grasping and lifting of cylindrical objects with different diameters. The results clearly show that the new gripper makes it possible to generate holding forces similar to those of the FESTO FinRay, but with significantly lower pressures on the grasped object (77 % less). Besides enabling the handling of more fragile items, the drastic increase in gripper compliance also results in lower mechanical actuation force (namely, 71 % less of gripping energy) required to generate the same holding force, with a consequent reduction of operation costs and sustainability of its application.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102843"},"PeriodicalIF":9.1,"publicationDate":"2024-08-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001303/pdfft?md5=0e71113c1100eb94ff1082aac7fd6192&pid=1-s2.0-S0736584524001303-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141910845","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Patrick Link , Lars Penter , Ulrike Rückert , Lars Klingel , Alexander Verl , Steffen Ihlenfeldt
{"title":"Real-time quality prediction and local adjustment of friction with digital twin in sheet metal forming","authors":"Patrick Link , Lars Penter , Ulrike Rückert , Lars Klingel , Alexander Verl , Steffen Ihlenfeldt","doi":"10.1016/j.rcim.2024.102848","DOIUrl":"10.1016/j.rcim.2024.102848","url":null,"abstract":"<div><p>In sheet metal forming, the quality of a formed part is strongly influenced by the local lubrication conditions on the blank. Fluctuations in lubrication distribution can cause failures such as excessive thinning and cracks. Predicting these failures in real-time for the entire part is still a very challenging task. Machine learning (ML) based digital twins and advanced computing power offer new ways to analyze manufacturing processes inline in the shortest possible time. This study presents a digital twin for simulating a deep drawing process that incorporates an advanced ML model and optimization algorithm. Convolutional neural networks with RES-SE-U-Net architecture, were used to capture the full friction conditions on the blank. The ML model was trained with data from a calibrated finite element model. The ML model establishes a correlation between the local friction conditions across the blank and the quality of the drawn part. It accurately predicts the geometry and thinning of the formed part in real-time by assessing the friction conditions on the blank. A particle swarm optimization algorithm incorporates the ML model and provides tailored recommendations for adjusting local friction conditions to promptly correct detected quality deviations with minimal amount of additional lubricant. Experiments show that the ML model deployed on an industrial control system can predict part quality in real-time and recommend adjustments in case of quality deviation in 1.6 s. The error between prediction and ground truth is on average 0.16 mm for geometric accuracy and 0.02 % for thinning.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102848"},"PeriodicalIF":9.1,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001352/pdfft?md5=5d551b25cc09da72b4f73439592e20c4&pid=1-s2.0-S0736584524001352-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141910846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zipeng Wang , Jihong Yan , Guanzhong Yan , Boshuai Yu
{"title":"Multi-scale control and action recognition based human-robot collaboration framework facing new generation intelligent manufacturing","authors":"Zipeng Wang , Jihong Yan , Guanzhong Yan , Boshuai Yu","doi":"10.1016/j.rcim.2024.102847","DOIUrl":"10.1016/j.rcim.2024.102847","url":null,"abstract":"<div><p>Facing the new generation intelligent manufacturing, traditional manufacturing models are transitioning towards large-scale customized productions, improving the efficiency and flexibility of complex manufacturing processes. This is crucial for enhancing the stability and core competitiveness of the manufacturing industry, and human-robot collaboration systems are an important means to achieve this goal. At present, mainstream manufacturing human-robot collaboration systems are modeled for specific scenarios and actions, with poor scalability and flexibility, making it difficult to flexibly handle actions beyond the set. Therefore, this article proposes a new human-robot collaboration framework based on action recognition and multi-scale control, designs 27 basic gesture actions for motion control, and constructs a robot control instruction library containing 70 different semantics based on these actions. By integrating static gesture recognition, dynamic action process recognition, and You-Only-Look-Once V5 object recognition and positioning technology, accurate recognition of various control actions has been achieved. The recognition accuracy of 27 types of static control actions has reached 100%, and the dynamic action recognition accuracy of the gearbox assembly process based on lightweight MF-AE-NN<img>OBJ has reached 90%. This provides new ideas for simplifying the complexity of human-robot collaboration problems, improving system accuracy, efficiency, and stability.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"91 ","pages":"Article 102847"},"PeriodicalIF":9.1,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141910848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}