移动设备上单图像训练网络的损失平衡感知算法

IF 4.3 2区 计算机科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Rong Chen;Sihai Qiao;Yushi Li;Yulong Fan
{"title":"移动设备上单图像训练网络的损失平衡感知算法","authors":"Rong Chen;Sihai Qiao;Yushi Li;Yulong Fan","doi":"10.1109/TCE.2025.3534680","DOIUrl":null,"url":null,"abstract":"Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"71 1","pages":"260-272"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Loss Balance Aware Algorithms for Single Image Deraining Network on Mobile Devices\",\"authors\":\"Rong Chen;Sihai Qiao;Yushi Li;Yulong Fan\",\"doi\":\"10.1109/TCE.2025.3534680\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.\",\"PeriodicalId\":13208,\"journal\":{\"name\":\"IEEE Transactions on Consumer Electronics\",\"volume\":\"71 1\",\"pages\":\"260-272\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-01-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Consumer Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10854562/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10854562/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

尽管最近在单图像脱轨方面取得了许多进展,但资源有限或移动设备负担得起的脱轨神经网络仍然是可取的。与依赖于庞大的网络架构和仔细的超参数调优的方法不同,我们引入了一个轻量级模型,集成了简化的部署原理图和动态加权算法,以实现移动设备上高效和自动化的单图像训练。首先,我们构建网络,并将其与多个损失函数关联,以高效有效地捕获期望的背景纹理和由雨条引起的高频振荡。为了提高手持仪器的可用性,我们通过省略一些耗时的离线操作来简化部署过程。重要的是,我们提出了两种动态加权算法来自动协同不同的优化目标。这些算法使我们的框架避免了繁琐的人工调节,增强了我们的模型在便携式设备上的灵活性。我们对降雨图像的合成数据集和真实数据集进行定性和定量评价。实验结果表明,我们的模型可以很容易地部署在移动设备上,并且在强大的降雨去除方面优于其他最先进的方法,即使是在大雨中捕获的真实图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Loss Balance Aware Algorithms for Single Image Deraining Network on Mobile Devices
Despite many recent advances in single-image deraining, a deraining neural network affordable for resource-limited or mobile devices remains desirable. Unlike the methods relying on enormous network architectures and careful hyperparameter tuning, we introduce a lightweight model integrated with a streamlined deployment schematic and dynamic weighting algorithms to achieve efficient and automated single-image deraining on mobile devices. At first, we construct the network and associate it with multiple loss functions to efficiently and effectively capture expected background textures and high-frequency oscillations caused by rain streaks. To improve usability on handheld instruments, we simplify the deployment process by omitting some time-consuming offline operations. Importantly, we present two dynamic weighting algorithms to automatically synergize varied optimization goals. These algorithms prevent our framework from tedious manual regulation, which enhances the flexibility our model on portable devices. We conduct qualitative and quantitative evaluations on synthetic and real datasets of rainy images. The experimental results demonstrate that our model can be easily deployed on mobile devices and outperforms other state-of-the-art approaches in robust rain removal, even for real images captured in heavy rain.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.70
自引率
9.30%
发文量
59
审稿时长
3.3 months
期刊介绍: The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信