Yi He;Weihua Li;Yanzhong Zhang;Kun Xu;Haiyan Wan;Zhuyun Chen
{"title":"基于数据驱动的多尺度卷积自适应网络的焊接机器人工作状态识别","authors":"Yi He;Weihua Li;Yanzhong Zhang;Kun Xu;Haiyan Wan;Zhuyun Chen","doi":"10.1109/JSEN.2024.3519564","DOIUrl":null,"url":null,"abstract":"The operating states of welding robots are a critical component in the automotive body-in-white assembly process, directly affecting the product quality and production efficiency of the manufacturing line. Therefore, accurate recognition of the operating state patterns is of great importance. Traditional methods relying on sensor signal threshold changes and operator observation are subjective, dependent on human experience, and difficult to implement in intelligent and automated production processes. This study proposes a novel approach to recognize the operating states of welding robots without additional sensors, using a multiscale convolutional adaptive network (MSCAN). First, motion data collection was achieved by leveraging the welding robot’s installed sensors, providing estimates of angular acceleration, angular velocity, and angle of the XYZ-axes. To address the issue of class imbalance in the collected data, the synthetic minority over-sampling technique (SMOTE) algorithm was adopted to generate synthetic samples of the minority class. Then, a MSCAN was constructed, where an attention mechanism was embedded into the convolutional architecture, and a domain adaptation measure was further constructed to mitigate the data distribution discrepancy induced by different operation speeds. Finally, the proposed approach was evaluated and validated on a real welding robot dataset in the body-in-white assembly process. The results showed that the proposed method achieved an accuracy, precision, recall, and <inline-formula> <tex-math>${F}1$ </tex-math></inline-formula>-score of 99.25%, 99.25%, 99.25%, and 99.25%, respectively, outperforming other comparative models. This demonstrates that the proposed model can effectively recognize the operating states of welding robots, possessing significant theoretical and engineering application value in automotive body-in-white assembly.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 3","pages":"5231-5240"},"PeriodicalIF":4.3000,"publicationDate":"2024-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Data-Driven Multiscale Convolutional Adaptive Network for Welding Robot Operating State Recognition\",\"authors\":\"Yi He;Weihua Li;Yanzhong Zhang;Kun Xu;Haiyan Wan;Zhuyun Chen\",\"doi\":\"10.1109/JSEN.2024.3519564\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The operating states of welding robots are a critical component in the automotive body-in-white assembly process, directly affecting the product quality and production efficiency of the manufacturing line. Therefore, accurate recognition of the operating state patterns is of great importance. Traditional methods relying on sensor signal threshold changes and operator observation are subjective, dependent on human experience, and difficult to implement in intelligent and automated production processes. This study proposes a novel approach to recognize the operating states of welding robots without additional sensors, using a multiscale convolutional adaptive network (MSCAN). First, motion data collection was achieved by leveraging the welding robot’s installed sensors, providing estimates of angular acceleration, angular velocity, and angle of the XYZ-axes. To address the issue of class imbalance in the collected data, the synthetic minority over-sampling technique (SMOTE) algorithm was adopted to generate synthetic samples of the minority class. Then, a MSCAN was constructed, where an attention mechanism was embedded into the convolutional architecture, and a domain adaptation measure was further constructed to mitigate the data distribution discrepancy induced by different operation speeds. Finally, the proposed approach was evaluated and validated on a real welding robot dataset in the body-in-white assembly process. The results showed that the proposed method achieved an accuracy, precision, recall, and <inline-formula> <tex-math>${F}1$ </tex-math></inline-formula>-score of 99.25%, 99.25%, 99.25%, and 99.25%, respectively, outperforming other comparative models. This demonstrates that the proposed model can effectively recognize the operating states of welding robots, possessing significant theoretical and engineering application value in automotive body-in-white assembly.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 3\",\"pages\":\"5231-5240\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-12-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10815020/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10815020/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A Data-Driven Multiscale Convolutional Adaptive Network for Welding Robot Operating State Recognition
The operating states of welding robots are a critical component in the automotive body-in-white assembly process, directly affecting the product quality and production efficiency of the manufacturing line. Therefore, accurate recognition of the operating state patterns is of great importance. Traditional methods relying on sensor signal threshold changes and operator observation are subjective, dependent on human experience, and difficult to implement in intelligent and automated production processes. This study proposes a novel approach to recognize the operating states of welding robots without additional sensors, using a multiscale convolutional adaptive network (MSCAN). First, motion data collection was achieved by leveraging the welding robot’s installed sensors, providing estimates of angular acceleration, angular velocity, and angle of the XYZ-axes. To address the issue of class imbalance in the collected data, the synthetic minority over-sampling technique (SMOTE) algorithm was adopted to generate synthetic samples of the minority class. Then, a MSCAN was constructed, where an attention mechanism was embedded into the convolutional architecture, and a domain adaptation measure was further constructed to mitigate the data distribution discrepancy induced by different operation speeds. Finally, the proposed approach was evaluated and validated on a real welding robot dataset in the body-in-white assembly process. The results showed that the proposed method achieved an accuracy, precision, recall, and ${F}1$ -score of 99.25%, 99.25%, 99.25%, and 99.25%, respectively, outperforming other comparative models. This demonstrates that the proposed model can effectively recognize the operating states of welding robots, possessing significant theoretical and engineering application value in automotive body-in-white assembly.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice