{"title":"移动设备上单图像训练网络的损失平衡感知算法","authors":"Rong Chen;Sihai Qiao;Yushi Li;Yulong Fan","doi":"10.1109/TCE.2025.3534680","DOIUrl":null,"url":null,"abstract":"Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"71 1","pages":"260-272"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Loss Balance Aware Algorithms for Single Image Deraining Network on Mobile Devices\",\"authors\":\"Rong Chen;Sihai Qiao;Yushi Li;Yulong Fan\",\"doi\":\"10.1109/TCE.2025.3534680\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.\",\"PeriodicalId\":13208,\"journal\":{\"name\":\"IEEE Transactions on Consumer Electronics\",\"volume\":\"71 1\",\"pages\":\"260-272\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-01-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Consumer Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10854562/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10854562/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Loss Balance Aware Algorithms for Single Image Deraining Network on Mobile Devices
Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.
期刊介绍:
The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.