Binh An Nguyen , Minh Bao Kha , Duc Manh Dao , Huu Kien Nguyen , My Duyen Nguyen , The Vu Nguyen , Namal Rathnayake , Yukinobu Hoshino , Tuan Linh Dang
{"title":"UFR-GAN:一种轻量级的多退化图像恢复模型","authors":"Binh An Nguyen , Minh Bao Kha , Duc Manh Dao , Huu Kien Nguyen , My Duyen Nguyen , The Vu Nguyen , Namal Rathnayake , Yukinobu Hoshino , Tuan Linh Dang","doi":"10.1016/j.patrec.2025.08.008","DOIUrl":null,"url":null,"abstract":"<div><div>Real-world pattern recognition systems often face challenges in simultaneously handling images degraded by multiple factors such as rain, haze, and low-light conditions. Existing single-degradation models fail to generalize across diverse scenarios, while specialized models are computationally expensive and inefficient. This paper introduces UFR-GAN, a lightweight multi-degradation restoration GAN-based framework. Our model integrates transformer-driven feature aggregation to enhance long-range dependencies while maintaining computational efficiency. Additionally, we employ frequency-domain contrastive learning to disentangle overlapping artifacts, thereby improving the restoration of fine details. This approach may enable unified restoration across diverse degradation types. Our UFR-GAN, which only had 45.4 M parameters, achieved state-of-the-art (SOTA) performance with 26.87 PSNR and 0.83 SSIM in various degradation scenarios. It also had significantly lower computational complexity than SOTA approaches. Crucially, we demonstrated its broader impact on downstream pattern recognition tasks: integrating UFR-GAN with YOLOv11 improved vehicle detection accuracy by 23% at 0.73 mAP50 while reducing the inference time to only <span><math><mrow><mn>2</mn><mo>.</mo><mn>7</mn><mspace></mspace><mi>m</mi><mi>s</mi></mrow></math></span> under adverse weather conditions. These results indicated that our UFR-GAN could be used in many important areas of pattern recognition, including computer vision, remote sensing, traffic surveillance, and self-driving systems. Efficient and generalizable restoration techniques are essential in these domains.</div></div>","PeriodicalId":54638,"journal":{"name":"Pattern Recognition Letters","volume":"197 ","pages":"Pages 282-287"},"PeriodicalIF":3.3000,"publicationDate":"2025-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"UFR-GAN: A lightweight multi-degradation image restoration model\",\"authors\":\"Binh An Nguyen , Minh Bao Kha , Duc Manh Dao , Huu Kien Nguyen , My Duyen Nguyen , The Vu Nguyen , Namal Rathnayake , Yukinobu Hoshino , Tuan Linh Dang\",\"doi\":\"10.1016/j.patrec.2025.08.008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Real-world pattern recognition systems often face challenges in simultaneously handling images degraded by multiple factors such as rain, haze, and low-light conditions. Existing single-degradation models fail to generalize across diverse scenarios, while specialized models are computationally expensive and inefficient. This paper introduces UFR-GAN, a lightweight multi-degradation restoration GAN-based framework. Our model integrates transformer-driven feature aggregation to enhance long-range dependencies while maintaining computational efficiency. Additionally, we employ frequency-domain contrastive learning to disentangle overlapping artifacts, thereby improving the restoration of fine details. This approach may enable unified restoration across diverse degradation types. Our UFR-GAN, which only had 45.4 M parameters, achieved state-of-the-art (SOTA) performance with 26.87 PSNR and 0.83 SSIM in various degradation scenarios. It also had significantly lower computational complexity than SOTA approaches. Crucially, we demonstrated its broader impact on downstream pattern recognition tasks: integrating UFR-GAN with YOLOv11 improved vehicle detection accuracy by 23% at 0.73 mAP50 while reducing the inference time to only <span><math><mrow><mn>2</mn><mo>.</mo><mn>7</mn><mspace></mspace><mi>m</mi><mi>s</mi></mrow></math></span> under adverse weather conditions. These results indicated that our UFR-GAN could be used in many important areas of pattern recognition, including computer vision, remote sensing, traffic surveillance, and self-driving systems. Efficient and generalizable restoration techniques are essential in these domains.</div></div>\",\"PeriodicalId\":54638,\"journal\":{\"name\":\"Pattern Recognition Letters\",\"volume\":\"197 \",\"pages\":\"Pages 282-287\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-08-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pattern Recognition Letters\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167865525002879\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition Letters","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167865525002879","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
UFR-GAN: A lightweight multi-degradation image restoration model
Real-world pattern recognition systems often face challenges in simultaneously handling images degraded by multiple factors such as rain, haze, and low-light conditions. Existing single-degradation models fail to generalize across diverse scenarios, while specialized models are computationally expensive and inefficient. This paper introduces UFR-GAN, a lightweight multi-degradation restoration GAN-based framework. Our model integrates transformer-driven feature aggregation to enhance long-range dependencies while maintaining computational efficiency. Additionally, we employ frequency-domain contrastive learning to disentangle overlapping artifacts, thereby improving the restoration of fine details. This approach may enable unified restoration across diverse degradation types. Our UFR-GAN, which only had 45.4 M parameters, achieved state-of-the-art (SOTA) performance with 26.87 PSNR and 0.83 SSIM in various degradation scenarios. It also had significantly lower computational complexity than SOTA approaches. Crucially, we demonstrated its broader impact on downstream pattern recognition tasks: integrating UFR-GAN with YOLOv11 improved vehicle detection accuracy by 23% at 0.73 mAP50 while reducing the inference time to only under adverse weather conditions. These results indicated that our UFR-GAN could be used in many important areas of pattern recognition, including computer vision, remote sensing, traffic surveillance, and self-driving systems. Efficient and generalizable restoration techniques are essential in these domains.
期刊介绍:
Pattern Recognition Letters aims at rapid publication of concise articles of a broad interest in pattern recognition.
Subject areas include all the current fields of interest represented by the Technical Committees of the International Association of Pattern Recognition, and other developing themes involving learning and recognition.