基于高效模块的多问题单图像超分辨率

Dongwon Park, Kwanyoung Kim, S. Chun
{"title":"基于高效模块的多问题单图像超分辨率","authors":"Dongwon Park, Kwanyoung Kim, S. Chun","doi":"10.1109/CVPRW.2018.00133","DOIUrl":null,"url":null,"abstract":"Example based single image super resolution (SR) is a fundamental task in computer vision. It is challenging, but recently, there have been significant performance improvements using deep learning approaches. In this article, we propose efficient module based single image SR networks (EMBSR) and tackle multiple SR problems in NTIRE 2018 SR challenge by recycling trained networks. Our proposed EMBSR allowed us to reduce training time with effectively deeper networks, to use modular ensemble for improved performance, and to separate subproblems for better performance. We also proposed EDSR-PP, an improved version of previous ESDR by incorporating pyramid pooling so that global as well as local context information can be utilized. Lastly, we proposed a novel denoising / deblurring residual convolutional network (DnResNet) using residual block and batch normalization. Our proposed EMBSR with DnResNet and EDSR-PP demonstrated that multiple SR problems can be tackled efficiently and effectively by winning the 2nd place for Track 2 (× 4 SR with mild adverse condition) and the 3rd place for Track 3 (×4 SR with difficult adverse condition). Our proposed method with EDSR-PP also achieved the ninth place for Track 1 (×8 SR) with the fastest run time among top nine teams.","PeriodicalId":150600,"journal":{"name":"2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"15","resultStr":"{\"title\":\"Efficient Module Based Single Image Super Resolution for Multiple Problems\",\"authors\":\"Dongwon Park, Kwanyoung Kim, S. Chun\",\"doi\":\"10.1109/CVPRW.2018.00133\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Example based single image super resolution (SR) is a fundamental task in computer vision. It is challenging, but recently, there have been significant performance improvements using deep learning approaches. In this article, we propose efficient module based single image SR networks (EMBSR) and tackle multiple SR problems in NTIRE 2018 SR challenge by recycling trained networks. Our proposed EMBSR allowed us to reduce training time with effectively deeper networks, to use modular ensemble for improved performance, and to separate subproblems for better performance. We also proposed EDSR-PP, an improved version of previous ESDR by incorporating pyramid pooling so that global as well as local context information can be utilized. Lastly, we proposed a novel denoising / deblurring residual convolutional network (DnResNet) using residual block and batch normalization. Our proposed EMBSR with DnResNet and EDSR-PP demonstrated that multiple SR problems can be tackled efficiently and effectively by winning the 2nd place for Track 2 (× 4 SR with mild adverse condition) and the 3rd place for Track 3 (×4 SR with difficult adverse condition). Our proposed method with EDSR-PP also achieved the ninth place for Track 1 (×8 SR) with the fastest run time among top nine teams.\",\"PeriodicalId\":150600,\"journal\":{\"name\":\"2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"15\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CVPRW.2018.00133\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CVPRW.2018.00133","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 15

摘要

基于实例的单幅图像超分辨率(SR)是计算机视觉领域的一项基本任务。这是一个挑战,但最近,使用深度学习方法已经有了显著的性能改进。在本文中,我们提出了高效的基于模块的单图像SR网络(EMBSR),并通过回收训练好的网络来解决整个2018年SR挑战中的多个SR问题。我们提出的EMBSR允许我们使用有效的深度网络减少训练时间,使用模块化集成来提高性能,并分离子问题以获得更好的性能。我们还提出了EDSR-PP,这是先前ESDR的改进版本,通过纳入金字塔池,可以利用全局和局部上下文信息。最后,我们提出了一种基于残差块和批处理归一化的去噪/去模糊残差卷积网络(DnResNet)。我们提出的基于DnResNet和EDSR-PP的EMBSR表明,通过获得轨道2(轻度不利条件的x4 SR)的第二名和轨道3(不良条件严重的×4 SR)的第三名,可以有效地解决多个SR问题。我们提出的EDSR-PP方法也以最快的运行时间在前九名车队中获得了赛道1 (×8 SR)的第九名。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Efficient Module Based Single Image Super Resolution for Multiple Problems
Example based single image super resolution (SR) is a fundamental task in computer vision. It is challenging, but recently, there have been significant performance improvements using deep learning approaches. In this article, we propose efficient module based single image SR networks (EMBSR) and tackle multiple SR problems in NTIRE 2018 SR challenge by recycling trained networks. Our proposed EMBSR allowed us to reduce training time with effectively deeper networks, to use modular ensemble for improved performance, and to separate subproblems for better performance. We also proposed EDSR-PP, an improved version of previous ESDR by incorporating pyramid pooling so that global as well as local context information can be utilized. Lastly, we proposed a novel denoising / deblurring residual convolutional network (DnResNet) using residual block and batch normalization. Our proposed EMBSR with DnResNet and EDSR-PP demonstrated that multiple SR problems can be tackled efficiently and effectively by winning the 2nd place for Track 2 (× 4 SR with mild adverse condition) and the 3rd place for Track 3 (×4 SR with difficult adverse condition). Our proposed method with EDSR-PP also achieved the ninth place for Track 1 (×8 SR) with the fastest run time among top nine teams.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信