基于边缘计算的自适应量化故障诊断方法

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Zhuolin Bao;Xiaofei Zhang;Yinpeng Qu;Haidong Shao;Guojun Qin
{"title":"基于边缘计算的自适应量化故障诊断方法","authors":"Zhuolin Bao;Xiaofei Zhang;Yinpeng Qu;Haidong Shao;Guojun Qin","doi":"10.1109/JSEN.2025.3591151","DOIUrl":null,"url":null,"abstract":"Deep neural networks (DNNs) perform well in the field of industrial equipment fault diagnosis (FD). However, due to the constraints of practical industrial environments, the substantial computational and memory requirements of DNN make them incompatible with resource-constrained edge devices. Current research on lightweight FD models primarily focuses on network architecture simplification and parameter scale compression. However, there is insufficient research addressing the storage and computational resource overhead caused by floating-point representation redundancy in DNN. Therefore, this article proposes an adaptive quantization interval method based on knowledge distillation (AQIKD) for FD. First, a hardware-friendly adaptive quantization interval strategy is proposed, which balances model performance and hardware implementation complexity by differentiating the quantization methods for weights and activation values. Second, the hyperbolic tangent function is employed to optimize the backpropagation process to enhance the model’s convergence capability. Finally, a progressive soft label supervision learning method is introduced, leading to both acceleration in training convergence and improvement in diagnostic performance for low-bit-width models. The stability and efficiency of the proposed quantization method are validated through experiments on both induction motors (IMs) and permanent magnet synchronous motor (PMSM) scenarios. Furthermore, FD models with different bit-widths implemented based on AQIKD are deployed on an FPGA platform. The results demonstrate that the quantized models can achieve up to 74% hardware resource reduction while maintaining satisfactory accuracy.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 17","pages":"33277-33287"},"PeriodicalIF":4.3000,"publicationDate":"2025-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Adaptive Quantization Method for Edge Computing-Based Fault Diagnosis\",\"authors\":\"Zhuolin Bao;Xiaofei Zhang;Yinpeng Qu;Haidong Shao;Guojun Qin\",\"doi\":\"10.1109/JSEN.2025.3591151\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep neural networks (DNNs) perform well in the field of industrial equipment fault diagnosis (FD). However, due to the constraints of practical industrial environments, the substantial computational and memory requirements of DNN make them incompatible with resource-constrained edge devices. Current research on lightweight FD models primarily focuses on network architecture simplification and parameter scale compression. However, there is insufficient research addressing the storage and computational resource overhead caused by floating-point representation redundancy in DNN. Therefore, this article proposes an adaptive quantization interval method based on knowledge distillation (AQIKD) for FD. First, a hardware-friendly adaptive quantization interval strategy is proposed, which balances model performance and hardware implementation complexity by differentiating the quantization methods for weights and activation values. Second, the hyperbolic tangent function is employed to optimize the backpropagation process to enhance the model’s convergence capability. Finally, a progressive soft label supervision learning method is introduced, leading to both acceleration in training convergence and improvement in diagnostic performance for low-bit-width models. The stability and efficiency of the proposed quantization method are validated through experiments on both induction motors (IMs) and permanent magnet synchronous motor (PMSM) scenarios. Furthermore, FD models with different bit-widths implemented based on AQIKD are deployed on an FPGA platform. The results demonstrate that the quantized models can achieve up to 74% hardware resource reduction while maintaining satisfactory accuracy.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 17\",\"pages\":\"33277-33287\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11098588/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/11098588/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

深度神经网络(dnn)在工业设备故障诊断领域有着良好的应用前景。然而,由于实际工业环境的限制,深度神经网络的大量计算和内存需求使其与资源受限的边缘设备不兼容。目前对轻量级FD模型的研究主要集中在网络架构简化和参数尺度压缩方面。然而,对于深度神经网络中浮点表示冗余所带来的存储和计算资源开销,目前还没有足够的研究。为此,本文提出了一种基于知识蒸馏(AQIKD)的自适应量化区间方法。首先,提出了一种硬件友好的自适应量化区间策略,通过区分权重和激活值的量化方法来平衡模型性能和硬件实现复杂性。其次,利用双曲正切函数对反向传播过程进行优化,提高模型的收敛能力;最后,介绍了一种渐进式软标签监督学习方法,该方法既加快了训练收敛速度,又提高了低位宽模型的诊断性能。通过在感应电机和永磁同步电机两种场景下的实验,验证了所提量化方法的稳定性和有效性。此外,在FPGA平台上部署了基于AQIKD实现的不同位宽FD模型。结果表明,量化模型可以在保持满意精度的同时减少74%的硬件资源。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An Adaptive Quantization Method for Edge Computing-Based Fault Diagnosis
Deep neural networks (DNNs) perform well in the field of industrial equipment fault diagnosis (FD). However, due to the constraints of practical industrial environments, the substantial computational and memory requirements of DNN make them incompatible with resource-constrained edge devices. Current research on lightweight FD models primarily focuses on network architecture simplification and parameter scale compression. However, there is insufficient research addressing the storage and computational resource overhead caused by floating-point representation redundancy in DNN. Therefore, this article proposes an adaptive quantization interval method based on knowledge distillation (AQIKD) for FD. First, a hardware-friendly adaptive quantization interval strategy is proposed, which balances model performance and hardware implementation complexity by differentiating the quantization methods for weights and activation values. Second, the hyperbolic tangent function is employed to optimize the backpropagation process to enhance the model’s convergence capability. Finally, a progressive soft label supervision learning method is introduced, leading to both acceleration in training convergence and improvement in diagnostic performance for low-bit-width models. The stability and efficiency of the proposed quantization method are validated through experiments on both induction motors (IMs) and permanent magnet synchronous motor (PMSM) scenarios. Furthermore, FD models with different bit-widths implemented based on AQIKD are deployed on an FPGA platform. The results demonstrate that the quantized models can achieve up to 74% hardware resource reduction while maintaining satisfactory accuracy.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信