基于多信息融合和深度学习机器视觉的多关节机械臂故障检测与诊断

IF 5.2 2区 计算机科学 Q2 ROBOTICS
Jinghui Pan
{"title":"基于多信息融合和深度学习机器视觉的多关节机械臂故障检测与诊断","authors":"Jinghui Pan","doi":"10.1002/rob.22583","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>The multi-joint manipulator with vision sensors has been widely used in real applications. However, the fault detection and diagnosis accuracy are lowered and the time expense is increased for the increased number of sensors, as there are many factors that are relative with this problem. This paper is focused on the fault detection and diagnosis problem of multi-joint manipulator, and the problem was divided into two sub-problems. The first is that the position estimation strategy based on data fusion of visual sensor and the position sensor was designed to carry out the fault detection, and the whether the faults had happened or not were determined by the position estimation errors. The second was focused on the fault diagnosis problem, where the deep convolutional neural network (DCNN) fault diagnosis model based on time-frequency mixed signal was constructed. The proposed DCNN uses the time and frequency domain information as its inputs and executes the classification tasks. The specific fault was determined through the output of DCNN model. The DCNN model was activated only when the first fault detection unit indicated that there was a fault, so the time expense was reduced from 5.3 to 2.6 s. The experiment based on the AUBO-i5 manipulator was carried out to evaluate the proposed fault detection and diagnosis model, where 10 categories of data sets that represent different working conditions of manipulator were adopted. The experimental results showed that the proposed multi-joint manipulator fault detection could improve the position estimation accuracy by 41.2%, and the fault diagnosis accuracy was improved by 20%.</p>\n </div>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"42 7","pages":"3308-3322"},"PeriodicalIF":5.2000,"publicationDate":"2025-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Fault Detection and Diagnosis of Multi-Joint Manipulator Based on Multi-Information Fusion and Deep-Learning Machine Vision\",\"authors\":\"Jinghui Pan\",\"doi\":\"10.1002/rob.22583\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>The multi-joint manipulator with vision sensors has been widely used in real applications. However, the fault detection and diagnosis accuracy are lowered and the time expense is increased for the increased number of sensors, as there are many factors that are relative with this problem. This paper is focused on the fault detection and diagnosis problem of multi-joint manipulator, and the problem was divided into two sub-problems. The first is that the position estimation strategy based on data fusion of visual sensor and the position sensor was designed to carry out the fault detection, and the whether the faults had happened or not were determined by the position estimation errors. The second was focused on the fault diagnosis problem, where the deep convolutional neural network (DCNN) fault diagnosis model based on time-frequency mixed signal was constructed. The proposed DCNN uses the time and frequency domain information as its inputs and executes the classification tasks. The specific fault was determined through the output of DCNN model. The DCNN model was activated only when the first fault detection unit indicated that there was a fault, so the time expense was reduced from 5.3 to 2.6 s. The experiment based on the AUBO-i5 manipulator was carried out to evaluate the proposed fault detection and diagnosis model, where 10 categories of data sets that represent different working conditions of manipulator were adopted. The experimental results showed that the proposed multi-joint manipulator fault detection could improve the position estimation accuracy by 41.2%, and the fault diagnosis accuracy was improved by 20%.</p>\\n </div>\",\"PeriodicalId\":192,\"journal\":{\"name\":\"Journal of Field Robotics\",\"volume\":\"42 7\",\"pages\":\"3308-3322\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2025-05-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Field Robotics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/rob.22583\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Field Robotics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rob.22583","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

摘要

具有视觉传感器的多关节机械手在实际应用中得到了广泛的应用。然而,由于传感器数量的增加,导致故障检测和诊断的准确性降低,时间开销增加,与此问题相关的因素很多。本文主要研究多关节机械手的故障检测与诊断问题,并将该问题分为两个子问题。首先,设计了基于视觉传感器和位置传感器数据融合的位置估计策略进行故障检测,并通过位置估计误差判断故障是否发生;二是针对故障诊断问题,构建了基于时频混合信号的深度卷积神经网络(DCNN)故障诊断模型;提出的DCNN以时域和频域信息作为输入,执行分类任务。通过DCNN模型的输出来确定具体的故障。DCNN模型只有在第一个故障检测单元提示存在故障时才会被激活,因此时间开销从5.3 s减少到2.6 s。以AUBO-i5机械臂为实验对象,采用代表机械臂不同工况的10类数据集,对所提出的故障检测诊断模型进行了评估。实验结果表明,所提出的多关节机械手故障检测方法可将位置估计精度提高41.2%,故障诊断精度提高20%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Fault Detection and Diagnosis of Multi-Joint Manipulator Based on Multi-Information Fusion and Deep-Learning Machine Vision

Fault Detection and Diagnosis of Multi-Joint Manipulator Based on Multi-Information Fusion and Deep-Learning Machine Vision

The multi-joint manipulator with vision sensors has been widely used in real applications. However, the fault detection and diagnosis accuracy are lowered and the time expense is increased for the increased number of sensors, as there are many factors that are relative with this problem. This paper is focused on the fault detection and diagnosis problem of multi-joint manipulator, and the problem was divided into two sub-problems. The first is that the position estimation strategy based on data fusion of visual sensor and the position sensor was designed to carry out the fault detection, and the whether the faults had happened or not were determined by the position estimation errors. The second was focused on the fault diagnosis problem, where the deep convolutional neural network (DCNN) fault diagnosis model based on time-frequency mixed signal was constructed. The proposed DCNN uses the time and frequency domain information as its inputs and executes the classification tasks. The specific fault was determined through the output of DCNN model. The DCNN model was activated only when the first fault detection unit indicated that there was a fault, so the time expense was reduced from 5.3 to 2.6 s. The experiment based on the AUBO-i5 manipulator was carried out to evaluate the proposed fault detection and diagnosis model, where 10 categories of data sets that represent different working conditions of manipulator were adopted. The experimental results showed that the proposed multi-joint manipulator fault detection could improve the position estimation accuracy by 41.2%, and the fault diagnosis accuracy was improved by 20%.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Field Robotics
Journal of Field Robotics 工程技术-机器人学
CiteScore
15.00
自引率
3.60%
发文量
80
审稿时长
6 months
期刊介绍: The Journal of Field Robotics seeks to promote scholarly publications dealing with the fundamentals of robotics in unstructured and dynamic environments. The Journal focuses on experimental robotics and encourages publication of work that has both theoretical and practical significance.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信