Multidomain neural process model based on source attention for industrial robot anomaly detection

IF 8 1区 工程技术 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Bo Yang , Yuhang Huang , Jian Jiao , Wenlong Xu , Lei Liu , Keqiang Xie , Nan Dong
{"title":"Multidomain neural process model based on source attention for industrial robot anomaly detection","authors":"Bo Yang ,&nbsp;Yuhang Huang ,&nbsp;Jian Jiao ,&nbsp;Wenlong Xu ,&nbsp;Lei Liu ,&nbsp;Keqiang Xie ,&nbsp;Nan Dong","doi":"10.1016/j.aei.2024.102910","DOIUrl":null,"url":null,"abstract":"<div><div>Industrial robots are vital intelligent equipment in modern industries. Periodic maintenance, which is costly and cannot prevent unexpected failures, is necessary to reduce the probability of failure and extend their service life. Therefore, this study pioneers the application of neural processes in industrial robot anomaly detection. On the basis of the attentive neural process framework, a multidomain fusion neural process (MNP) model based on source attention (SA), which introduces a multidomain path that improves the ability of the model to decouple latent distributions of observed data in industrial environments, is proposed. The multidomain path consists of the following parts: First, a time–frequency domain feature extraction module (TFDFEM) is proposed to extract rich time–frequency domain features from raw signals. Second, a dual-purpose SA module is designed to calibrate the temporal and spectral features within the signal, enabling the model to prioritize relevant features. Last, an SA-based multidomain fusion strategy (MDFS) is developed to fuse and complement features from different domains. Numerous experiments based on robots in an automotive welding and bolt fastening lines show that the MNP achieves an average accuracy of 90.8%, outperforming existing models by at least 6.2%. The average F1 is 94.7%, which outperforms existing models by 4.2%. Therefore, our model provides a promising tool for the state-based maintenance of industrial robots. The code for this project is available at <span><span>https://github.com/hyh7323/Multi-domain-Neural-Process</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"62 ","pages":"Article 102910"},"PeriodicalIF":8.0000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624005615","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Industrial robots are vital intelligent equipment in modern industries. Periodic maintenance, which is costly and cannot prevent unexpected failures, is necessary to reduce the probability of failure and extend their service life. Therefore, this study pioneers the application of neural processes in industrial robot anomaly detection. On the basis of the attentive neural process framework, a multidomain fusion neural process (MNP) model based on source attention (SA), which introduces a multidomain path that improves the ability of the model to decouple latent distributions of observed data in industrial environments, is proposed. The multidomain path consists of the following parts: First, a time–frequency domain feature extraction module (TFDFEM) is proposed to extract rich time–frequency domain features from raw signals. Second, a dual-purpose SA module is designed to calibrate the temporal and spectral features within the signal, enabling the model to prioritize relevant features. Last, an SA-based multidomain fusion strategy (MDFS) is developed to fuse and complement features from different domains. Numerous experiments based on robots in an automotive welding and bolt fastening lines show that the MNP achieves an average accuracy of 90.8%, outperforming existing models by at least 6.2%. The average F1 is 94.7%, which outperforms existing models by 4.2%. Therefore, our model provides a promising tool for the state-based maintenance of industrial robots. The code for this project is available at https://github.com/hyh7323/Multi-domain-Neural-Process.
基于源关注的多域神经过程模型用于工业机器人异常检测
工业机器人是现代工业的重要智能设备。定期维护成本高昂,且无法避免意外故障的发生,因此有必要定期维护,以降低故障发生概率,延长使用寿命。因此,本研究开创性地将神经过程应用于工业机器人异常检测。在注意神经过程框架的基础上,提出了基于源注意(SA)的多域融合神经过程(MNP)模型,该模型引入了多域路径,提高了模型对工业环境中观测数据潜在分布的解耦能力。多域路径由以下部分组成:首先,提出了一个时频域特征提取模块(TFDFEM),用于从原始信号中提取丰富的时频域特征。其次,设计了一个两用 SA 模块,用于校准信号中的时域和频域特征,使模型能够优先处理相关特征。最后,开发了一种基于 SA 的多域融合策略 (MDFS),用于融合和补充来自不同域的特征。基于汽车焊接和螺栓紧固生产线机器人的大量实验表明,MNP 的平均准确率达到 90.8%,比现有模型至少高出 6.2%。平均 F1 为 94.7%,比现有模型高出 4.2%。因此,我们的模型为基于状态的工业机器人维护提供了一个前景广阔的工具。该项目的代码可在 https://github.com/hyh7323/Multi-domain-Neural-Process 上获取。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advanced Engineering Informatics
Advanced Engineering Informatics 工程技术-工程:综合
CiteScore
12.40
自引率
18.20%
发文量
292
审稿时长
45 days
期刊介绍: Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信