{"title":"MMamba: Enhancing image deraining with Morton curve-driven locality learning","authors":"Zongzhi Ouyang , Wenhui Li","doi":"10.1016/j.neucom.2025.130161","DOIUrl":null,"url":null,"abstract":"<div><div>Rain streaks in images exhibit complex forms and spatial structures. Their removal not only requires restoring the clarity of the image but also aims to preserve as much of the original information as possible. Transformer-based deep learning models have made significant progress in image deraining, effectively capturing the diversity of rain streaks and removing them through deep feature learning. However, when handling long sequence data, the computational complexity rises sharply, severely limiting the efficiency of practical applications. In recent years, the Mamba module, with its unique design, has demonstrated great potential in handling long sequences and enabling fast inference in image deraining tasks. It reduces computational complexity while preserving the underlying features of the image, thus improving efficiency. However, compared to Transformer-based models, the Mamba model still faces certain limitations in preserving local information and dealing with complex rain streaks. To address these issues, this paper proposes an efficient MMamba model, which combines the Morton curve-based state space model (SSM) to further enhance the ability to retain local information. Additionally, a dynamic channel attention mechanism is introduced, which significantly improves image detail restoration by partitioning channels and assigning learnable weights to each subset. Finally, for images with rich and complex rain streaks, a Selective Rain Stripe Compensator is proposed, effectively identifying and removing these intricate rain streaks. Extensive experiments on five commonly used benchmark datasets demonstrate that our method outperforms state-of-the-art techniques in terms of performance.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"638 ","pages":"Article 130161"},"PeriodicalIF":5.5000,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225008331","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
MMamba: Enhancing image deraining with Morton curve-driven locality learning
Rain streaks in images exhibit complex forms and spatial structures. Their removal not only requires restoring the clarity of the image but also aims to preserve as much of the original information as possible. Transformer-based deep learning models have made significant progress in image deraining, effectively capturing the diversity of rain streaks and removing them through deep feature learning. However, when handling long sequence data, the computational complexity rises sharply, severely limiting the efficiency of practical applications. In recent years, the Mamba module, with its unique design, has demonstrated great potential in handling long sequences and enabling fast inference in image deraining tasks. It reduces computational complexity while preserving the underlying features of the image, thus improving efficiency. However, compared to Transformer-based models, the Mamba model still faces certain limitations in preserving local information and dealing with complex rain streaks. To address these issues, this paper proposes an efficient MMamba model, which combines the Morton curve-based state space model (SSM) to further enhance the ability to retain local information. Additionally, a dynamic channel attention mechanism is introduced, which significantly improves image detail restoration by partitioning channels and assigning learnable weights to each subset. Finally, for images with rich and complex rain streaks, a Selective Rain Stripe Compensator is proposed, effectively identifying and removing these intricate rain streaks. Extensive experiments on five commonly used benchmark datasets demonstrate that our method outperforms state-of-the-art techniques in terms of performance.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.