Maria Siddiqua, Samir Brahim Belhaouari, Muneer Raza
{"title":"UMD-NOIR: Unified Multiscale Diffusion Model for Navigation-Orientated Image Restoration","authors":"Maria Siddiqua, Samir Brahim Belhaouari, Muneer Raza","doi":"10.1049/itr2.70110","DOIUrl":null,"url":null,"abstract":"<p>Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.</p>","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":"19 1","pages":""},"PeriodicalIF":2.7000,"publicationDate":"2025-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.70110","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/itr2.70110","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Image restoration is essential for vision-based navigation, surveillance, and remote sensing, yet real-world images are often degraded by haze, fog, rain, snow, clouds, and underwater turbidity. Existing methods are typically tailored to single degradations or narrow domains, limiting their generalisation in complex environments with overlapping effects. We introduce UMD-NOIR, a unified multiscale diffusion model for navigation-orientated image restoration that integrates a Transformer-enhanced UNet into a denoising diffusion probabilistic model. The architecture incorporates multiscale channel and spatial attention together with a gated deconvolutional feed-forward network, enabling robust feature aggregation, spatially aware enhancement, detail recovery, and structural consistency. A hybrid loss combining Huber and perceptual terms further improves sharpness, colour accuracy, and perceptual fidelity. Quantitative evaluations against 13 state-of-the-art diffusion and transformer-based models show that UMD-NOIR achieves an average peak signal-to-noise ratio (PSNR) of 28.07 dB, structural similarity index measure (SSIM) of 0.888, and mean absolute error (MAE) of 0.032 across ground, aerial, and marine degradations. Generalisation is validated on five unseen datasets (DAWN, RESIDE, RICE, LSUI, and CDD-11), demonstrating adaptability to real-world and composite degradations. No-reference assessments further yield NIQE = 3.91 and PIQE = 20.85 on haze images, confirming perceptual realism. Downstream evaluations with YOLOv11 highlight improvements in classification, detection, and segmentation, while ablation studies verify the importance of multiscale processing, attention mechanisms, and hybrid loss in achieving consistent gains.
期刊介绍:
IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following:
Sustainable traffic solutions
Deployments with enabling technologies
Pervasive monitoring
Applications; demonstrations and evaluation
Economic and behavioural analyses of ITS services and scenario
Data Integration and analytics
Information collection and processing; image processing applications in ITS
ITS aspects of electric vehicles
Autonomous vehicles; connected vehicle systems;
In-vehicle ITS, safety and vulnerable road user aspects
Mobility as a service systems
Traffic management and control
Public transport systems technologies
Fleet and public transport logistics
Emergency and incident management
Demand management and electronic payment systems
Traffic related air pollution management
Policy and institutional issues
Interoperability, standards and architectures
Funding scenarios
Enforcement
Human machine interaction
Education, training and outreach
Current Special Issue Call for papers:
Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf
Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf
Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf