用于弱光图像融合的并行文本引导蒸馏网络

IF 3.4 3区 物理与天体物理 Q2 INSTRUMENTS & INSTRUMENTATION
Quan Wang , Fengyuan Liu , Yi Cao , Farhan Ullah , Jin Jiang
{"title":"用于弱光图像融合的并行文本引导蒸馏网络","authors":"Quan Wang ,&nbsp;Fengyuan Liu ,&nbsp;Yi Cao ,&nbsp;Farhan Ullah ,&nbsp;Jin Jiang","doi":"10.1016/j.infrared.2025.106198","DOIUrl":null,"url":null,"abstract":"<div><div>A common issue in low-light image fusion is overexposure during the daytime and overexposure of point light sources at night. Existing brightness enhancement networks used in low-light image fusion often lost significant information, due to the lack of supervision from high-brightness images. As a result, it is difficult for the existing low-light image fusion networks to handle complex, low-light environments. To address the challenge of enhancing image details while avoiding information loss, a novel image enhancement and fusion network (PTDNet) is proposed in this paper. PTDNet combines text guidance and knowledge distillation techniques to enhance image details and preserve information in low-light conditions. Moreover, PTDNet employs parallel CNNs and Mamba-based feature extraction and fusion modules, in order to effectively handle overexposure issues in low-light environments while preserving the accuracy and naturalness of image details under various lighting conditions. Therefore, PTDNet cannot only overcomes the brightness inconsistency issues found in traditional methods, but also enhances image visibility and clarity in low-light conditions. In the experimental section, PTDNet was qualitative and quantitatively validated on three datasets. The qualitative experimental results show that PTDNet effectively addresses the overexposure problem in traditional methods, significantly improving image quality and making details more transparent and naturally visualized. The quantitative experimental results indicate that PTDNet performed better on key metrics such as AG, EN, SF, and SD for the LLVIP and MSRS datasets.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"152 ","pages":"Article 106198"},"PeriodicalIF":3.4000,"publicationDate":"2025-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PTDNet: Parallel text-guided distillation network for low-light image fusion\",\"authors\":\"Quan Wang ,&nbsp;Fengyuan Liu ,&nbsp;Yi Cao ,&nbsp;Farhan Ullah ,&nbsp;Jin Jiang\",\"doi\":\"10.1016/j.infrared.2025.106198\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>A common issue in low-light image fusion is overexposure during the daytime and overexposure of point light sources at night. Existing brightness enhancement networks used in low-light image fusion often lost significant information, due to the lack of supervision from high-brightness images. As a result, it is difficult for the existing low-light image fusion networks to handle complex, low-light environments. To address the challenge of enhancing image details while avoiding information loss, a novel image enhancement and fusion network (PTDNet) is proposed in this paper. PTDNet combines text guidance and knowledge distillation techniques to enhance image details and preserve information in low-light conditions. Moreover, PTDNet employs parallel CNNs and Mamba-based feature extraction and fusion modules, in order to effectively handle overexposure issues in low-light environments while preserving the accuracy and naturalness of image details under various lighting conditions. Therefore, PTDNet cannot only overcomes the brightness inconsistency issues found in traditional methods, but also enhances image visibility and clarity in low-light conditions. In the experimental section, PTDNet was qualitative and quantitatively validated on three datasets. The qualitative experimental results show that PTDNet effectively addresses the overexposure problem in traditional methods, significantly improving image quality and making details more transparent and naturally visualized. The quantitative experimental results indicate that PTDNet performed better on key metrics such as AG, EN, SF, and SD for the LLVIP and MSRS datasets.</div></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"152 \",\"pages\":\"Article 106198\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-10-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449525004918\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449525004918","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0

摘要

低光图像融合的一个常见问题是白天过度曝光和夜晚点光源过度曝光。现有的用于低照度图像融合的亮度增强网络,由于缺乏来自高照度图像的监督,往往会丢失大量的信息。因此,现有的低光图像融合网络难以处理复杂的低光环境。为了解决在增强图像细节的同时避免信息丢失的难题,本文提出了一种新的图像增强融合网络(PTDNet)。PTDNet结合了文本指导和知识蒸馏技术,以增强图像细节,并在低光条件下保留信息。此外,PTDNet采用并行cnn和基于mamba的特征提取和融合模块,在有效处理低光环境下的过度曝光问题的同时,保持了各种光照条件下图像细节的准确性和自然性。因此,PTDNet不仅克服了传统方法的亮度不一致问题,而且提高了低光条件下图像的可见度和清晰度。在实验部分,PTDNet在三个数据集上进行了定性和定量验证。定性实验结果表明,PTDNet有效地解决了传统方法中的过度曝光问题,显著提高了图像质量,使细节更加透明和自然可视化。定量实验结果表明,PTDNet在LLVIP和MSRS数据集的AG、EN、SF和SD等关键指标上表现更好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
PTDNet: Parallel text-guided distillation network for low-light image fusion
A common issue in low-light image fusion is overexposure during the daytime and overexposure of point light sources at night. Existing brightness enhancement networks used in low-light image fusion often lost significant information, due to the lack of supervision from high-brightness images. As a result, it is difficult for the existing low-light image fusion networks to handle complex, low-light environments. To address the challenge of enhancing image details while avoiding information loss, a novel image enhancement and fusion network (PTDNet) is proposed in this paper. PTDNet combines text guidance and knowledge distillation techniques to enhance image details and preserve information in low-light conditions. Moreover, PTDNet employs parallel CNNs and Mamba-based feature extraction and fusion modules, in order to effectively handle overexposure issues in low-light environments while preserving the accuracy and naturalness of image details under various lighting conditions. Therefore, PTDNet cannot only overcomes the brightness inconsistency issues found in traditional methods, but also enhances image visibility and clarity in low-light conditions. In the experimental section, PTDNet was qualitative and quantitatively validated on three datasets. The qualitative experimental results show that PTDNet effectively addresses the overexposure problem in traditional methods, significantly improving image quality and making details more transparent and naturally visualized. The quantitative experimental results indicate that PTDNet performed better on key metrics such as AG, EN, SF, and SD for the LLVIP and MSRS datasets.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.70
自引率
12.10%
发文量
400
审稿时长
67 days
期刊介绍: The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region. Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine. Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信