{"title":"红外图像去条纹的知识嵌入扩散模型","authors":"Lingxiao Li;Xin Wang;Dan Huang;Yunan He;Zhuqiang Zhong;Qingling Xia","doi":"10.1109/JPHOT.2025.3564831","DOIUrl":null,"url":null,"abstract":"Infrared imaging systems are widely used across industries. However, their output images often exhibit striped noise due to the nonuniform response of the detection system, which significantly affects image quality and visual fidelity. To address challenges such as incomplete stripe removal, potential loss of image details and textures, and the generation of artificial artifacts during destriping, we propose a novel stripe removal method based on a knowledge-embedded diffusion model (KEDM). This approach effectively integrates the spatial distribution characteristics of stripe noise with an innovative, data-driven diffusion network model, creating a hybrid knowledge and data-driven framework for stripe correction. The core components of KEDM are the latent diffusion model (LDM) architecture and the directional wavelet convolution module (DWCM). Specifically, LDM leverages a pretrained variational autoencoder (VAE) to transform the input image into latent feature space for efficient diffusion propagation, reducing computational complexity while preserving image restoration quality. Meanwhile, DWCM uses wavelet convolution operations to construct prior loss functions for stripe noise, precisely guiding the diffusion reconstruction process to achieve a clean, stripe-free image. Empirical evaluations on several benchmark datasets demonstrate that the proposed KEDM outperforms other state-of-the-art destriping algorithms in terms of visual quality and quantitative metrics, validating its excellent performance.","PeriodicalId":13204,"journal":{"name":"IEEE Photonics Journal","volume":"17 3","pages":"1-9"},"PeriodicalIF":2.1000,"publicationDate":"2025-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10978030","citationCount":"0","resultStr":"{\"title\":\"KEDM: Knowledge-Embedded Diffusion Model for Infrared Image Destriping\",\"authors\":\"Lingxiao Li;Xin Wang;Dan Huang;Yunan He;Zhuqiang Zhong;Qingling Xia\",\"doi\":\"10.1109/JPHOT.2025.3564831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Infrared imaging systems are widely used across industries. However, their output images often exhibit striped noise due to the nonuniform response of the detection system, which significantly affects image quality and visual fidelity. To address challenges such as incomplete stripe removal, potential loss of image details and textures, and the generation of artificial artifacts during destriping, we propose a novel stripe removal method based on a knowledge-embedded diffusion model (KEDM). This approach effectively integrates the spatial distribution characteristics of stripe noise with an innovative, data-driven diffusion network model, creating a hybrid knowledge and data-driven framework for stripe correction. The core components of KEDM are the latent diffusion model (LDM) architecture and the directional wavelet convolution module (DWCM). Specifically, LDM leverages a pretrained variational autoencoder (VAE) to transform the input image into latent feature space for efficient diffusion propagation, reducing computational complexity while preserving image restoration quality. Meanwhile, DWCM uses wavelet convolution operations to construct prior loss functions for stripe noise, precisely guiding the diffusion reconstruction process to achieve a clean, stripe-free image. Empirical evaluations on several benchmark datasets demonstrate that the proposed KEDM outperforms other state-of-the-art destriping algorithms in terms of visual quality and quantitative metrics, validating its excellent performance.\",\"PeriodicalId\":13204,\"journal\":{\"name\":\"IEEE Photonics Journal\",\"volume\":\"17 3\",\"pages\":\"1-9\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2025-04-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10978030\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Photonics Journal\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10978030/\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Photonics Journal","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10978030/","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
KEDM: Knowledge-Embedded Diffusion Model for Infrared Image Destriping
Infrared imaging systems are widely used across industries. However, their output images often exhibit striped noise due to the nonuniform response of the detection system, which significantly affects image quality and visual fidelity. To address challenges such as incomplete stripe removal, potential loss of image details and textures, and the generation of artificial artifacts during destriping, we propose a novel stripe removal method based on a knowledge-embedded diffusion model (KEDM). This approach effectively integrates the spatial distribution characteristics of stripe noise with an innovative, data-driven diffusion network model, creating a hybrid knowledge and data-driven framework for stripe correction. The core components of KEDM are the latent diffusion model (LDM) architecture and the directional wavelet convolution module (DWCM). Specifically, LDM leverages a pretrained variational autoencoder (VAE) to transform the input image into latent feature space for efficient diffusion propagation, reducing computational complexity while preserving image restoration quality. Meanwhile, DWCM uses wavelet convolution operations to construct prior loss functions for stripe noise, precisely guiding the diffusion reconstruction process to achieve a clean, stripe-free image. Empirical evaluations on several benchmark datasets demonstrate that the proposed KEDM outperforms other state-of-the-art destriping algorithms in terms of visual quality and quantitative metrics, validating its excellent performance.
期刊介绍:
Breakthroughs in the generation of light and in its control and utilization have given rise to the field of Photonics, a rapidly expanding area of science and technology with major technological and economic impact. Photonics integrates quantum electronics and optics to accelerate progress in the generation of novel photon sources and in their utilization in emerging applications at the micro and nano scales spanning from the far-infrared/THz to the x-ray region of the electromagnetic spectrum. IEEE Photonics Journal is an online-only journal dedicated to the rapid disclosure of top-quality peer-reviewed research at the forefront of all areas of photonics. Contributions addressing issues ranging from fundamental understanding to emerging technologies and applications are within the scope of the Journal. The Journal includes topics in: Photon sources from far infrared to X-rays, Photonics materials and engineered photonic structures, Integrated optics and optoelectronic, Ultrafast, attosecond, high field and short wavelength photonics, Biophotonics, including DNA photonics, Nanophotonics, Magnetophotonics, Fundamentals of light propagation and interaction; nonlinear effects, Optical data storage, Fiber optics and optical communications devices, systems, and technologies, Micro Opto Electro Mechanical Systems (MOEMS), Microwave photonics, Optical Sensors.