Yeting Huang, Lei Dai, Zhihua Chen, Wenlong Hu, Shouli Wang
{"title":"特征细化自适应调制变压器图像脱轨","authors":"Yeting Huang, Lei Dai, Zhihua Chen, Wenlong Hu, Shouli Wang","doi":"10.1016/j.engappai.2025.111373","DOIUrl":null,"url":null,"abstract":"<div><div>Recent image deraining methods demonstrate impressive reconstruction performance by leveraging the global modeling capability of Transformer architecture. However, unlike convolutional approach, Transformer inherently struggles to capture high-frequency detail effectively. Furthermore, existing methods primarily focus on spatial information while largely neglecting the frequency-domain characteristics of rain streaks, which are crucial for rain removal. To address these challenges, we propose a feature-refined adaptive modulation Transformer (FRAMT), which effectively integrates spatial-domain features with frequency-domain modulation to enhance deraining performance. To accurately identify rain streaks and efficiently separate them from the background, the detail-guided attention block enhances sensitivity to high-frequency components by integrating pooling operation with convolution. To mitigate image blurring and detail loss induced by rain streaks, the local feature refinement block employs a multi-scale content decomposition strategy, utilizing a parallel multi-branch architecture to extract diverse contextual features across varying spatial scales. Additionally, the adaptive fusion modulation block incorporates a frequency selection mechanism that dynamically modulates feature response, effectively suppressing redundant information and irrelevant features. Extensive experiments conducted on widely used benchmark datasets demonstrate that the proposed method is more competitive than advanced methods.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"157 ","pages":"Article 111373"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Feature-refined adaptive modulation transformer for image deraining\",\"authors\":\"Yeting Huang, Lei Dai, Zhihua Chen, Wenlong Hu, Shouli Wang\",\"doi\":\"10.1016/j.engappai.2025.111373\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Recent image deraining methods demonstrate impressive reconstruction performance by leveraging the global modeling capability of Transformer architecture. However, unlike convolutional approach, Transformer inherently struggles to capture high-frequency detail effectively. Furthermore, existing methods primarily focus on spatial information while largely neglecting the frequency-domain characteristics of rain streaks, which are crucial for rain removal. To address these challenges, we propose a feature-refined adaptive modulation Transformer (FRAMT), which effectively integrates spatial-domain features with frequency-domain modulation to enhance deraining performance. To accurately identify rain streaks and efficiently separate them from the background, the detail-guided attention block enhances sensitivity to high-frequency components by integrating pooling operation with convolution. To mitigate image blurring and detail loss induced by rain streaks, the local feature refinement block employs a multi-scale content decomposition strategy, utilizing a parallel multi-branch architecture to extract diverse contextual features across varying spatial scales. Additionally, the adaptive fusion modulation block incorporates a frequency selection mechanism that dynamically modulates feature response, effectively suppressing redundant information and irrelevant features. Extensive experiments conducted on widely used benchmark datasets demonstrate that the proposed method is more competitive than advanced methods.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"157 \",\"pages\":\"Article 111373\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-06-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625013752\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625013752","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Feature-refined adaptive modulation transformer for image deraining
Recent image deraining methods demonstrate impressive reconstruction performance by leveraging the global modeling capability of Transformer architecture. However, unlike convolutional approach, Transformer inherently struggles to capture high-frequency detail effectively. Furthermore, existing methods primarily focus on spatial information while largely neglecting the frequency-domain characteristics of rain streaks, which are crucial for rain removal. To address these challenges, we propose a feature-refined adaptive modulation Transformer (FRAMT), which effectively integrates spatial-domain features with frequency-domain modulation to enhance deraining performance. To accurately identify rain streaks and efficiently separate them from the background, the detail-guided attention block enhances sensitivity to high-frequency components by integrating pooling operation with convolution. To mitigate image blurring and detail loss induced by rain streaks, the local feature refinement block employs a multi-scale content decomposition strategy, utilizing a parallel multi-branch architecture to extract diverse contextual features across varying spatial scales. Additionally, the adaptive fusion modulation block incorporates a frequency selection mechanism that dynamically modulates feature response, effectively suppressing redundant information and irrelevant features. Extensive experiments conducted on widely used benchmark datasets demonstrate that the proposed method is more competitive than advanced methods.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.