Robotics and Computer-integrated Manufacturing最新文献

{"title":"Accurate backside boundary recognition of girth weld beads","authors":"Haibo Liu ,&nbsp;Tian Lan ,&nbsp;Te Li ,&nbsp;Jingchao Ai ,&nbsp;Yongqing Wang ,&nbsp;Yu Sun","doi":"10.1016/j.rcim.2024.102880","DOIUrl":"10.1016/j.rcim.2024.102880","url":null,"abstract":"<div><p>Visual recognition of weld beads is essential for post-weld robotic grinding. The recognition of thin-walled weld bead boundary, especially the backside boundary, remains challenging due to the diverse features such as debris, misalignment, and deformation. Based on point cloud from a laser scanner, we present a robust and accurate backside boundary recognition method for girth weld beads of thin-walled pipes. A boundary point extraction method is designed based on an adaptive sliding window model. Without prior morphology features, the influence of misalignment and deformation on the accuracy of boundary point recognition is greatly reduced by the local model matching strategy. Leveraging the correlation among overall weld bead features, an anomalous boundary point recognition and correction method based on DBSCAN clustering is proposed to further enhance robustness. A series of validation experiments were conducted by the obtained backside point cloud data inside a girth weld pipe, and our proposed method showed a high accuracy and a high robustness to misalignment, deformation and debris features.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102880"},"PeriodicalIF":9.1,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142274889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A method for detecting process design intent in the process route based on heterogeneous graph convolutional networks","authors":"Jiachen Liang ,&nbsp;Shusheng Zhang ,&nbsp;Changhong Xu ,&nbsp;Yajun Zhang ,&nbsp;Rui Huang ,&nbsp;Hang Zhang ,&nbsp;Zhen Wang","doi":"10.1016/j.rcim.2024.102872","DOIUrl":"10.1016/j.rcim.2024.102872","url":null,"abstract":"<div><p>The process design intent is the concentration of the technologists’ design cognitive process which contains the experiential knowledge and skills. It can reproduce technologists’ design thinking process in process design and provides guidance and interpretability for the generation of process results. The machining process route, as a core component of a part's entire manufacturing process, contains substantial process design intent. If the process design intent embedded in the existing process route can be explicitly identified, subsequent technologists will be able to learn and understand the original designers’ thinking, methodologies, and intents. This understanding enables effective reuse of design thinking and logic in the process design of new parts, rather than merely reusing data. It can also promote the propagation of the expertise and skills inherent in the process design intent. However, existing research on process design intent lacks a detailed explanation of its formation and specific structure from the design cognition perspective, making it challenging to effectively predict the process design intent containing interpretable empirical knowledge in the process route. To address this issue, this paper provides a method for predicting process design intent in the process route using heterogeneous graph convolutional networks. First, the heterogeneous graph is used to represent the parts and their associated process routes in the dataset. The nodes in the graph are then labeled based on accumulated and summarized process design intent. The prediction of process design intent in the process route is then converted into a node classification issue with heterogeneous graphs. A node classification network model is constructed using a heterogeneous graph convolutional network where the input is the created heterogeneous graph, and the output is the design reason contained in the machining feature and the intent cognition embedded in the working step, both of which are part of the process design intent. After training, the proposed model accurately predicted design reasons for machining features and intent cognitions for working steps (95.13 % and 96.85 %, respectively). Finally, examples of actual process routes are analyzed to verify the method's feasibility and reliability. The method given in this article can help technologists gain a deeper understanding of process route generation, hence improving their process design capabilities.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102872"},"PeriodicalIF":9.1,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A corrective shared control architecture for human–robot collaborative polishing tasks","authors":"Hao Zhou ,&nbsp;Xin Zhang ,&nbsp;Jinguo Liu","doi":"10.1016/j.rcim.2024.102876","DOIUrl":"10.1016/j.rcim.2024.102876","url":null,"abstract":"<div><p>Human–robot collaborative polishing can integrate the capabilities of humans and automation to deal with complex polishing tasks. Traditional impedance-control-based human–robot collaboration (HRC) requires operators to physically interact with robots for a good polishing performance, which brings unsafety to operators. To address this issue, a corrective shared control architecture using haptic feedback is proposed in this paper, where the direct force-reflection is used to guarantee the exact human-intention intervention. The proposed control architecture is designed with two layers: (i) the transparency layer in which the direct force-reflection and the human–robot collaborative polishing strategy are implemented; (ii) the passivity layer in which two energy tanks are designed and endowed with master and slave sides and a coupling energy scaling policy is employed to guarantee the passivity of the whole system. Under the proposed architecture, the constant force is adopted to polish normal areas of workpieces, and corrective force based on human intention is applied to deal with unexpected issues. Finally, two groups of experiments are conducted to evaluate the proposed architecture from two aspects: polishing effect and user experience.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102876"},"PeriodicalIF":9.1,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A parallel graph network for generating 7-DoF model-free grasps in unstructured scenes using point cloud","authors":"Chungang Zhuang,&nbsp;Haowen Wang,&nbsp;Wanhao Niu,&nbsp;Han Ding","doi":"10.1016/j.rcim.2024.102879","DOIUrl":"10.1016/j.rcim.2024.102879","url":null,"abstract":"<div><p>Generating model-free grasps in complex scattered scenes remains a challenging task. Most current methods adopt PointNet++ as the backbone to extract structural features, while the relative associations of geometry are underexplored, leading to non-optimal grasp prediction results. In this work, a parallelized graph-based pipeline is developed to solve the 7-DoF grasp pose generation problem with point cloud as input. Using the non-textured information of the grasping scene, the proposed pipeline simultaneously performs feature embedding and grasping location focusing in two branches, avoiding the mutual influence of the two learning processes. In the feature learning branch, the geometric features of the whole scene will be fully learned. In the location focusing branch, the high-value grasping locations on the surface of objects will be strategically selected. Using the learned graph features at these locations, the pipeline will eventually output refined grasping directions and widths in conjunction with local spatial features. To strengthen the positional features in the grasping problem, a graph convolution operator based on the positional attention mechanism is designed, and a graph residual network based on this operator is applied in two branches. The above pipeline abstracts the grasping location selection task from the main process of grasp generation, which lowers the learning difficulty while avoiding the performance degradation problem of deep graph networks. The established pipeline is evaluated on the GraspNet-1Billion dataset, demonstrating much better performance and stronger generalization capabilities than the benchmark approach. In robotic bin-picking experiments, the proposed method can effectively understand scattered grasping scenarios and grasp multiple types of unknown objects with a high success rate.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102879"},"PeriodicalIF":9.1,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A vision-guided adaptive and optimized robotic fabric gripping system for garment manufacturing automation","authors":"Young Woon Choi ,&nbsp;Jiho Lee ,&nbsp;Yongho Lee ,&nbsp;Suhyun Lee ,&nbsp;Wonyoung Jeong ,&nbsp;Dae Young Lim ,&nbsp;Sang Won Lee","doi":"10.1016/j.rcim.2024.102874","DOIUrl":"10.1016/j.rcim.2024.102874","url":null,"abstract":"<div><p>Automating fabric manipulation in garment manufacturing remains a challenging task due to the characteristics of limp sheet materials and the diversity of fabrics used. This paper introduces an adaptive and optimized robotic fabric handling system, designed to address these challenges. The system comprises an industrial robot, four needle grippers, and a novel adaptive gripper jig system capable of adjusting the positions of the grippers adaptively to accommodate the shape and material properties of the garment fabric parts. To do this, an in-depth analysis of fabric gripping characteristics—accounting for material properties, gripping position, and fabric deformation—is conducted. A two-stage machine learning model predicting fabric deflection and folding is established from the analyzed data. This model is then incorporated into a vision-guided algorithm that determines the optimal gripping points on garment parts using corresponding CAD data. In addition, the exact position of the target fabric part is swiftly recognized via an algorithm that maps the real-time captured images to the CAD-based shape information. The decision-making information—namely optimal gripping points and garment part position—are subsequently transmitted to the robotic system for automated fabric handling process. The performance of the developed algorithms was quantitatively evaluated, and the integrated robotic system verified to be capable of completing garment manufacturing automation by connecting the processes of automatic fabric cutting and sewing.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102874"},"PeriodicalIF":9.1,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142240698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Robotic grinding and polishing of complex aeroengine blades based on new device design and variable impedance control","authors":"Xiangfei Li,&nbsp;Huan Zhao,&nbsp;Haoyuan Zhou,&nbsp;Yuanhao Cai,&nbsp;Yecan Yin,&nbsp;Han Ding","doi":"10.1016/j.rcim.2024.102875","DOIUrl":"10.1016/j.rcim.2024.102875","url":null,"abstract":"<div><p>Owing to the advantages of good flexibility and low cost, robots are gradually replacing manual labor as an effective carrier for the grinding and polishing of aeroengine blades. However, the geometric features of blades are complex and diverse, and the contour accuracy and surface quality requirements are high, making the robotic grinding and polishing of blades still a challenging task. For this reason, this article first designs a new device by integrating different tools, which can achieve full-feature grinding and polishing of blades. Then, in order to improve the accuracy and stability of force tracking during the robotic grinding and polishing processes, a variable impedance control approach with simultaneous changes in stiffness and damping and parameter boundaries is proposed. Finally, the superiority of the proposed variable impedance control method is verified by comparative experiments on surface tracking. In addition, by combining the device with the variable impedance control method in the robotic grinding and polishing experiments of an aeroengine blade, their effectiveness in practical situations is confirmed.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102875"},"PeriodicalIF":9.1,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142230362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Force–vision fusion fuzzy control for robotic batch precision assembly of flexibly absorbed pegs","authors":"Bin Wang,&nbsp;Jiwen Zhang,&nbsp;Dan Wu","doi":"10.1016/j.rcim.2024.102861","DOIUrl":"10.1016/j.rcim.2024.102861","url":null,"abstract":"<div><p>This article focuses on improving the compliance, efficiency, and robustness of batch precision assembly of small-scale pegs flexibly absorbed by a suction cup. The main contribution is that a force–vision fusion fuzzy control method (FVFFC) is proposed to achieve precision assembly with unknown clearance or interference fit. Both visual and force features are designed to describe the state of the peg and hole with the deformation of the suction cup. Then, a force–vision fusion control framework is proposed, where the visual features dynamically modify the reference position of admittance control and guide compliant adjustment of the peg angles. Furthermore, based on theoretical analysis, two fuzzy logic inference modules are developed to estimate the contact state as well as either the clearance or interference amount between the peg and hole in order to adaptively tune the control parameters. Finally, sufficient experiments are conducted to demonstrate the superiority and robustness of the FVFFC method.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102861"},"PeriodicalIF":9.1,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144046","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Rapid and automated configuration of robot manufacturing cells","authors":"Seemal Asif ,&nbsp;Mikel Bueno ,&nbsp;Pedro Ferreira ,&nbsp;Paul Anandan ,&nbsp;Ze Zhang ,&nbsp;Yue Yao ,&nbsp;Gautham Ragunathan ,&nbsp;Lloyd Tinkler ,&nbsp;Masoud Sotoodeh-Bahraini ,&nbsp;Niels Lohse ,&nbsp;Phil Webb ,&nbsp;Windo Hutabarat ,&nbsp;Ashutosh Tiwari","doi":"10.1016/j.rcim.2024.102862","DOIUrl":"10.1016/j.rcim.2024.102862","url":null,"abstract":"<div><p>This study presents the Reconfigurable and Responsive Robot Manufacturing (R3M) architecture, a novel framework engineered to autonomously adapt to fluctuating product variants and demands within manufacturing environments. At the heart of R3M lies an integrated architecture that ensures a seamless data flow between critical modules, facilitated by an advanced communication platform. These modules are central to delivering a range of services crucial for operational efficiency. Key to the architecture is the incorporation of Automated Risk Assessment aligned with ISO-12100 standards, utilizing ROS2 Gazebo for the dynamic modification of robot skills in a plug-and-produce manner. The architecture's unique approach to requirements definition employs AutomationML (AML), enabling effective system integration and the consolidation of varied information sources. This is achieved through the innovative use of skill-based concepts and AML Class Libraries, enhancing the system's adaptability and integration within manufacturing settings. The narrative delves into the intricate descriptions of products, equipment, and processes within the AML framework, highlighting the strategic consideration of profitability in the product domain and distinguishing between atomic and composite skills in equipment characterization. The process domain serves as an invaluable knowledge repository, bridging the gap between high-level product demands and specific equipment capabilities via process patterns. The culmination of these elements within the R3M framework provides a versatile and scalable solution poised to revolutionize manufacturing processes. Empirical results underscore the architecture's robust perception abilities, with a particular focus on a real-world application in robotic lamination stacking, elucidating both the inherent challenges and the tangible outcomes of the R3M deployment.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102862"},"PeriodicalIF":9.1,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001492/pdfft?md5=e3690479a2a80ae151f70d8a450b9bb7&pid=1-s2.0-S0736584524001492-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A digital twin dynamic migration method for industrial mobile robots","authors":"Yue Wang ,&nbsp;Xiaohu Zhao","doi":"10.1016/j.rcim.2024.102864","DOIUrl":"10.1016/j.rcim.2024.102864","url":null,"abstract":"<div><p>In recent years, with the deepening integration of digital twins (DT) and the Industrial Internet of Things (IIoT), solutions based on digital twins have been widely applied in IIoT scenarios. However, most existing solutions tend to overlook the latency issue during the interaction between mobile devices, such as industrial mobile robots (IMR), and their DTs while in motion. Excessive interaction latency can directly impair the real-time response capability and decision accuracy of industrial mobile robots, and in severe cases, it may lead to the failure of intricate industrial tasks. In order to solve the above problems, we propose a digital twin dynamic migration method for industrial mobile robots. Firstly, we design and implement a STGCN-Transformer-based movement trajectory prediction method for IMR to predict the future movement trajectory of IMR and pre-migrate the DT of IMR to all intelligent gateways (IG) within the prediction range. Then, we design and implement a Proximal Policy Optimization-based DT migration time determination method for IMR and obtain the migration timing of DT under the premise of balancing the DT migration overhead, the load of the IG where the DT is deployed, the load of the IG where the DT is connected, and the communication delay between the IMR and the IG where the DT is deployed. Next, the DT of the IMR is migrated based on the IMR’s anticipated trajectory and optimal times for migration, with the objective of minimizing the interaction latency between the IMR and its DT. Finally, we conduct simulation experiments on the proposed method. Through theoretical and simulation experiments, it has been proven that the proposed method can effectively ensure the dynamic interaction delay between the IMR and its DT during the moving process, thereby enhancing the real-time responsiveness and decision precision of the IMR.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102864"},"PeriodicalIF":9.1,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142144035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A robust assessment method of point cloud quality for enhancing 3D robotic scanning","authors":"Leihui Li,&nbsp;Xuping Zhang","doi":"10.1016/j.rcim.2024.102863","DOIUrl":"10.1016/j.rcim.2024.102863","url":null,"abstract":"<div><p>Point clouds are widely used to construct models of workpieces using 3D scanners, especially where high-quality robotic and automatic 3D scanning is required in industries and manufacturing. In recent years, Point Cloud Quality Assessment (PCQA) has garnered increasing attention as it provides quality scores for entire point clouds, addressing issues such as downsampling and compression distortions. However, current PCQA methods cannot provide specific and local quality scores, which are necessary to facilitate rescanning and recompletion in 3D robotic scanning. Additionally, 3D data produced by robotic view-planning algorithms are usually considered the final result, where PCQA is typically not involved. In this paper, we bridge the gap between PCQA methods and practical robotic 3D scanning. We propose a no-reference PCQA method that recognizes sparse regions during 3D scanning, providing both local and overall quality scores. Unlike traditional methods that primarily consider density as a key metric, our method assumes that an expected 3D scan will have a uniformly distributed point cloud on surfaces. We analyze the quality of points by using geometric information from surfaces fitted to these points, which are mapped to a 2D distribution based on specified distances and angles. We conducted experiments on various datasets, including both synthetic and public datasets, to evaluate the accuracy and robustness of our method. The results show that our method can represent the quality on surfaces more accurately and robustly than density calculation methods. Additionally, it outperforms most existing PCQA methods in scenarios of downsampling, which is a common challenge in high-quality 3D scanning applications. The performance of our quality enhancement experiments on practical 3D scanning, conducted towards the end of our study, demonstrates significant potential for real-world applications. The related code is released at <span><span>https://github.com/leihui6/PCQA</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102863"},"PeriodicalIF":9.1,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0736584524001509/pdfft?md5=181b43bd05959651ed584db609156394&pid=1-s2.0-S0736584524001509-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142136655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}