Bo Yang , Yuhang Huang , Jian Jiao , Wenlong Xu , Lei Liu , Keqiang Xie , Nan Dong
{"title":"Multidomain neural process model based on source attention for industrial robot anomaly detection","authors":"Bo Yang , Yuhang Huang , Jian Jiao , Wenlong Xu , Lei Liu , Keqiang Xie , Nan Dong","doi":"10.1016/j.aei.2024.102910","DOIUrl":null,"url":null,"abstract":"<div><div>Industrial robots are vital intelligent equipment in modern industries. Periodic maintenance, which is costly and cannot prevent unexpected failures, is necessary to reduce the probability of failure and extend their service life. Therefore, this study pioneers the application of neural processes in industrial robot anomaly detection. On the basis of the attentive neural process framework, a multidomain fusion neural process (MNP) model based on source attention (SA), which introduces a multidomain path that improves the ability of the model to decouple latent distributions of observed data in industrial environments, is proposed. The multidomain path consists of the following parts: First, a time–frequency domain feature extraction module (TFDFEM) is proposed to extract rich time–frequency domain features from raw signals. Second, a dual-purpose SA module is designed to calibrate the temporal and spectral features within the signal, enabling the model to prioritize relevant features. Last, an SA-based multidomain fusion strategy (MDFS) is developed to fuse and complement features from different domains. Numerous experiments based on robots in an automotive welding and bolt fastening lines show that the MNP achieves an average accuracy of 90.8%, outperforming existing models by at least 6.2%. The average F1 is 94.7%, which outperforms existing models by 4.2%. Therefore, our model provides a promising tool for the state-based maintenance of industrial robots. The code for this project is available at <span><span>https://github.com/hyh7323/Multi-domain-Neural-Process</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102910"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005615","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Industrial robots are vital intelligent equipment in modern industries. Periodic maintenance, which is costly and cannot prevent unexpected failures, is necessary to reduce the probability of failure and extend their service life. Therefore, this study pioneers the application of neural processes in industrial robot anomaly detection. On the basis of the attentive neural process framework, a multidomain fusion neural process (MNP) model based on source attention (SA), which introduces a multidomain path that improves the ability of the model to decouple latent distributions of observed data in industrial environments, is proposed. The multidomain path consists of the following parts: First, a time–frequency domain feature extraction module (TFDFEM) is proposed to extract rich time–frequency domain features from raw signals. Second, a dual-purpose SA module is designed to calibrate the temporal and spectral features within the signal, enabling the model to prioritize relevant features. Last, an SA-based multidomain fusion strategy (MDFS) is developed to fuse and complement features from different domains. Numerous experiments based on robots in an automotive welding and bolt fastening lines show that the MNP achieves an average accuracy of 90.8%, outperforming existing models by at least 6.2%. The average F1 is 94.7%, which outperforms existing models by 4.2%. Therefore, our model provides a promising tool for the state-based maintenance of industrial robots. The code for this project is available at https://github.com/hyh7323/Multi-domain-Neural-Process.
工业机器人是现代工业的重要智能设备。定期维护成本高昂,且无法避免意外故障的发生,因此有必要定期维护,以降低故障发生概率,延长使用寿命。因此,本研究开创性地将神经过程应用于工业机器人异常检测。在注意神经过程框架的基础上,提出了基于源注意(SA)的多域融合神经过程(MNP)模型,该模型引入了多域路径,提高了模型对工业环境中观测数据潜在分布的解耦能力。多域路径由以下部分组成:首先,提出了一个时频域特征提取模块(TFDFEM),用于从原始信号中提取丰富的时频域特征。其次,设计了一个两用 SA 模块,用于校准信号中的时域和频域特征,使模型能够优先处理相关特征。最后,开发了一种基于 SA 的多域融合策略 (MDFS),用于融合和补充来自不同域的特征。基于汽车焊接和螺栓紧固生产线机器人的大量实验表明,MNP 的平均准确率达到 90.8%,比现有模型至少高出 6.2%。平均 F1 为 94.7%,比现有模型高出 4.2%。因此,我们的模型为基于状态的工业机器人维护提供了一个前景广阔的工具。该项目的代码可在 https://github.com/hyh7323/Multi-domain-Neural-Process 上获取。
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.