UMD-NOIR: Unified Multiscale Diffusion Model for Navigation-Orientated Image Restoration

IF 2.7 4区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Maria Siddiqua, Samir Brahim Belhaouari, Muneer Raza
{"title":"UMD-NOIR: Unified Multiscale Diffusion Model for Navigation-Orientated Image Restoration","authors":"Maria Siddiqua,&nbsp;Samir Brahim Belhaouari,&nbsp;Muneer Raza","doi":"10.1049/itr2.70110","DOIUrl":null,"url":null,"abstract":"<p>Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.</p>","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":"19 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2025-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.70110","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/itr2.70110","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.

Abstract Image

Abstract Image

面向导航图像恢复的统一多尺度扩散模型
图像恢复对于基于视觉的导航、监视和遥感至关重要,但现实世界的图像经常受到雾霾、雾、雨、雪、云和水下浑浊的影响。现有的方法通常针对单一降解或狭窄的领域,限制了它们在具有重叠效应的复杂环境中的泛化。我们介绍了UMD-NOIR,一种用于导航图像恢复的统一多尺度扩散模型,它将变压器增强的UNet集成到去噪扩散概率模型中。该体系结构将多尺度通道和空间关注与门控反卷积前馈网络结合在一起,实现了鲁棒的特征聚合、空间感知增强、细节恢复和结构一致性。结合Huber和感知术语的混合损失进一步提高了清晰度,色彩准确性和感知保真度。对13个最先进的扩散和基于变压器的模型的定量评估表明,UMD-NOIR在地面、空中和海洋退化方面的平均峰值信噪比(PSNR)为28.07 dB,结构相似性指数(SSIM)为0.888,平均绝对误差(MAE)为0.032。在五个未见过的数据集(DAWN、residency、RICE、LSUI和CDD-11)上验证了泛化,展示了对现实世界和复合退化的适应性。无参考评估进一步得出雾霾图像的NIQE = 3.91和PIQE = 20.85,证实了感知真实感。使用YOLOv11的下游评估强调了分类、检测和分割方面的改进,而消融研究验证了多尺度处理、注意机制和混合损失在实现一致增益方面的重要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Intelligent Transport Systems
IET Intelligent Transport Systems 工程技术-运输科技
CiteScore
6.50
自引率
7.40%
发文量
159
审稿时长
3 months
期刊介绍: IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following: Sustainable traffic solutions Deployments with enabling technologies Pervasive monitoring Applications; demonstrations and evaluation Economic and behavioural analyses of ITS services and scenario Data Integration and analytics Information collection and processing; image processing applications in ITS ITS aspects of electric vehicles Autonomous vehicles; connected vehicle systems; In-vehicle ITS, safety and vulnerable road user aspects Mobility as a service systems Traffic management and control Public transport systems technologies Fleet and public transport logistics Emergency and incident management Demand management and electronic payment systems Traffic related air pollution management Policy and institutional issues Interoperability, standards and architectures Funding scenarios Enforcement Human machine interaction Education, training and outreach Current Special Issue Call for papers: Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书