基于热可见图像融合和语义分割的高速直驱鼓风机部件热故障检测

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Shanqing Zhang;Zekun Sun;Ning Chu;Li Wang;Li Li;Caifang Cai;Ali Mohammad-Djafari
{"title":"基于热可见图像融合和语义分割的高速直驱鼓风机部件热故障检测","authors":"Shanqing Zhang;Zekun Sun;Ning Chu;Li Wang;Li Li;Caifang Cai;Ali Mohammad-Djafari","doi":"10.1109/JSEN.2025.3561128","DOIUrl":null,"url":null,"abstract":"A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 12","pages":"21151-21161"},"PeriodicalIF":4.3000,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Thermal Fault Detection of High-Speed Direct-Driven Blower Components Using Thermal-Visible Image Fusion and Semantic Segmentation\",\"authors\":\"Shanqing Zhang;Zekun Sun;Ning Chu;Li Wang;Li Li;Caifang Cai;Ali Mohammad-Djafari\",\"doi\":\"10.1109/JSEN.2025.3561128\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 12\",\"pages\":\"21151-21161\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-04-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10971889/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10971889/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

提出了一种基于热图像与可见图像融合和语义分割的高速直驱鼓风机部件热故障检测方法。该方法分为三个步骤:多模态图像融合、融合后图像的分量语义分割和温度级分割。首先,采用基于改进的去噪扩散模型的端到端图像融合网络,引入感知优先级加权损失进行训练,并采用备选训练策略提高融合图像的质量。第二步,提出一种轻量级的分割网络,在提高分割精度的同时减少模型大小和推理时间。最后,对热图像进行聚类处理。在实际工业对象上的实验表明,该方法由红外和光学图像融合、语义分割和温度聚类网络组成,显著提高了风机不同部件的故障温度检测效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Thermal Fault Detection of High-Speed Direct-Driven Blower Components Using Thermal-Visible Image Fusion and Semantic Segmentation
A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信