{"title":"基于热可见图像融合和语义分割的高速直驱鼓风机部件热故障检测","authors":"Shanqing Zhang;Zekun Sun;Ning Chu;Li Wang;Li Li;Caifang Cai;Ali Mohammad-Djafari","doi":"10.1109/JSEN.2025.3561128","DOIUrl":null,"url":null,"abstract":"A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 12","pages":"21151-21161"},"PeriodicalIF":4.3000,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Thermal Fault Detection of High-Speed Direct-Driven Blower Components Using Thermal-Visible Image Fusion and Semantic Segmentation\",\"authors\":\"Shanqing Zhang;Zekun Sun;Ning Chu;Li Wang;Li Li;Caifang Cai;Ali Mohammad-Djafari\",\"doi\":\"10.1109/JSEN.2025.3561128\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 12\",\"pages\":\"21151-21161\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-04-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10971889/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10971889/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Thermal Fault Detection of High-Speed Direct-Driven Blower Components Using Thermal-Visible Image Fusion and Semantic Segmentation
A thermal fault detection method for high-speed direct-driven blower components is proposed, using thermal and visible image fusion along with semantic segmentation. The proposed method follows three steps: multimodal image fusion, component semantic segmentation of the fused image, and temperature level segmentation. First, an end-to-end image fusion network based on an improved denoising diffusion model is used, a perceptually prioritized weighted loss is introduced for training, and an alternate training strategy is used to improve the quality of the fused images. In the second step, a lightweight segmentation network is proposed to reduce the model size and inference time while improving the segmentation accuracy. Finally, thermal images are processed by clustering methods. Experiments on real industrial objects show that the proposed method composed of infrared and optical image fusion, semantic segmentation, and temperature clustering networks improves significantly the fault temperature detection on different blower components.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice