单幅图像超分辨率的双鉴别生成对抗网络

Piaoyi Yuan, Yaping Zhang
{"title":"单幅图像超分辨率的双鉴别生成对抗网络","authors":"Piaoyi Yuan, Yaping Zhang","doi":"10.1109/CISP-BMEI48845.2019.8965727","DOIUrl":null,"url":null,"abstract":"Single image super-resolution(SISR) is to reconstruct a high resolution(HR) image from a single low resolution(LR) image. In this paper, with generative adversarial networks(GAN) model as the basic component, we build a dual discriminator super-resolution reconstruction network(DDSRRN) to improve the quality of image super-resolution reconstruction. By adding another discriminator based on GAN, we combine the Kullback-Leibler(KL) with reverse KL divergence to make a unified objective function to train the two discriminators, and by using the complementary statistical characteristics of these two divergences, the prediction density is effectively dispersed in multi-mode, which can avoid collapse of the network model during the reconstruction process and improve the stability of model training. We build the content loss function using the Charbonnier loss and use the intermediate features information of the two discriminators to build the perceptual loss function and style loss function. The experimental results show that the proposed method has sharp edges and rich details in subjective vision, and obtains better subjective visual evaluation and objective quantitative evaluation.","PeriodicalId":257666,"journal":{"name":"2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)","volume":"231 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Dual Discriminator Generative Adversarial Network for Single Image Super-Resolution\",\"authors\":\"Piaoyi Yuan, Yaping Zhang\",\"doi\":\"10.1109/CISP-BMEI48845.2019.8965727\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Single image super-resolution(SISR) is to reconstruct a high resolution(HR) image from a single low resolution(LR) image. In this paper, with generative adversarial networks(GAN) model as the basic component, we build a dual discriminator super-resolution reconstruction network(DDSRRN) to improve the quality of image super-resolution reconstruction. By adding another discriminator based on GAN, we combine the Kullback-Leibler(KL) with reverse KL divergence to make a unified objective function to train the two discriminators, and by using the complementary statistical characteristics of these two divergences, the prediction density is effectively dispersed in multi-mode, which can avoid collapse of the network model during the reconstruction process and improve the stability of model training. We build the content loss function using the Charbonnier loss and use the intermediate features information of the two discriminators to build the perceptual loss function and style loss function. The experimental results show that the proposed method has sharp edges and rich details in subjective vision, and obtains better subjective visual evaluation and objective quantitative evaluation.\",\"PeriodicalId\":257666,\"journal\":{\"name\":\"2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)\",\"volume\":\"231 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CISP-BMEI48845.2019.8965727\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CISP-BMEI48845.2019.8965727","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

单幅图像超分辨率(SISR)是将单幅低分辨率图像重建成高分辨率图像。本文以生成对抗网络(GAN)模型为基本组成部分,构建了双鉴别器超分辨重建网络(DDSRRN),以提高图像超分辨重建的质量。通过添加另一个基于GAN的判别器,将Kullback-Leibler(KL)与逆KL散度结合,形成统一的目标函数来训练两个判别器,并利用这两个散度的互补统计特性,将预测密度有效分散到多模式,避免了网络模型在重建过程中崩溃,提高了模型训练的稳定性。我们利用Charbonnier损失构建了内容损失函数,并利用两个鉴别器的中间特征信息构建了感知损失函数和风格损失函数。实验结果表明,该方法在主观视觉上边缘清晰,细节丰富,获得了较好的主观视觉评价和客观定量评价。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Dual Discriminator Generative Adversarial Network for Single Image Super-Resolution
Single image super-resolution(SISR) is to reconstruct a high resolution(HR) image from a single low resolution(LR) image. In this paper, with generative adversarial networks(GAN) model as the basic component, we build a dual discriminator super-resolution reconstruction network(DDSRRN) to improve the quality of image super-resolution reconstruction. By adding another discriminator based on GAN, we combine the Kullback-Leibler(KL) with reverse KL divergence to make a unified objective function to train the two discriminators, and by using the complementary statistical characteristics of these two divergences, the prediction density is effectively dispersed in multi-mode, which can avoid collapse of the network model during the reconstruction process and improve the stability of model training. We build the content loss function using the Charbonnier loss and use the intermediate features information of the two discriminators to build the perceptual loss function and style loss function. The experimental results show that the proposed method has sharp edges and rich details in subjective vision, and obtains better subjective visual evaluation and objective quantitative evaluation.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信