基于生成对抗网络的大气湍流退化图像恢复研究

Jiuming Cheng, Jianyu Li, Congming Dai, Y. Ren, Gang Xu, Shuai Li, Xiaowei Chen, Wenyue Zhu
{"title":"基于生成对抗网络的大气湍流退化图像恢复研究","authors":"Jiuming Cheng, Jianyu Li, Congming Dai, Y. Ren, Gang Xu, Shuai Li, Xiaowei Chen, Wenyue Zhu","doi":"10.1117/12.2681805","DOIUrl":null,"url":null,"abstract":"The imaging equipment working in the atmosphere will not only be limited by the performance of the imaging system, but also be affected by turbulence. In the fields of astronomical observation, ground-based remote sensing and remote monitoring, there is an urgent need for corresponding methods and technologies to eliminate the impact of atmospheric turbulence and obtain clear images. With the development of computer technology, atmospheric optics theory and image processing technology, more and more researchers hope to combine deep learning technology with atmospheric turbulence theory to reduce the impact of turbulence on imaging and obtain clear and stable images. In this paper, a turbulence image restoration technique based on Generative Adversarial Networks (GAN) is proposed, which is divided into generator network and discriminator network. The generator network is used to convert blurred images affected by turbulence into clear images. The discriminator network is used to compare the converted image with the real clear image to determine whether the image is real or generated. After the whole GAN is optimized and trained, the image transformed by the generator and the real and clear image cannot be distinguished from each other. Because the training of the GAN requires a large number of corresponding samples, it is difficult to obtain the images affected and unaffected by turbulence at the same time in real life, so this paper uses the statistical characteristics of turbulence to simulate a large number of images affected by turbulence. We used the trained GAN model to simulate turbulence image restoration and got some achievements.","PeriodicalId":130374,"journal":{"name":"Semantic Ambient Media Experiences","volume":"76 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on atmospheric turbulence-degraded image restoration based on generative adversarial networks\",\"authors\":\"Jiuming Cheng, Jianyu Li, Congming Dai, Y. Ren, Gang Xu, Shuai Li, Xiaowei Chen, Wenyue Zhu\",\"doi\":\"10.1117/12.2681805\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The imaging equipment working in the atmosphere will not only be limited by the performance of the imaging system, but also be affected by turbulence. In the fields of astronomical observation, ground-based remote sensing and remote monitoring, there is an urgent need for corresponding methods and technologies to eliminate the impact of atmospheric turbulence and obtain clear images. With the development of computer technology, atmospheric optics theory and image processing technology, more and more researchers hope to combine deep learning technology with atmospheric turbulence theory to reduce the impact of turbulence on imaging and obtain clear and stable images. In this paper, a turbulence image restoration technique based on Generative Adversarial Networks (GAN) is proposed, which is divided into generator network and discriminator network. The generator network is used to convert blurred images affected by turbulence into clear images. The discriminator network is used to compare the converted image with the real clear image to determine whether the image is real or generated. After the whole GAN is optimized and trained, the image transformed by the generator and the real and clear image cannot be distinguished from each other. Because the training of the GAN requires a large number of corresponding samples, it is difficult to obtain the images affected and unaffected by turbulence at the same time in real life, so this paper uses the statistical characteristics of turbulence to simulate a large number of images affected by turbulence. We used the trained GAN model to simulate turbulence image restoration and got some achievements.\",\"PeriodicalId\":130374,\"journal\":{\"name\":\"Semantic Ambient Media Experiences\",\"volume\":\"76 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Semantic Ambient Media Experiences\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2681805\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Semantic Ambient Media Experiences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2681805","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在大气中工作的成像设备不仅会受到成像系统性能的限制,还会受到湍流的影响。在天文观测、地面遥感和远程监测等领域,迫切需要相应的方法和技术来消除大气湍流的影响,获得清晰的图像。随着计算机技术、大气光学理论和图像处理技术的发展,越来越多的研究者希望将深度学习技术与大气湍流理论相结合,减少湍流对成像的影响,获得清晰稳定的图像。本文提出了一种基于生成对抗网络(GAN)的湍流图像恢复技术,该技术分为生成器网络和鉴别器网络。利用生成器网络将受湍流影响的模糊图像转换为清晰图像。鉴别器网络用于将转换后的图像与真实的清晰图像进行比较,判断图像是真实的还是生成的。整个GAN经过优化训练后,无法将生成器变换后的图像与真实清晰的图像区分开来。由于GAN的训练需要大量的对应样本,在现实生活中很难同时获得受湍流影响和不受湍流影响的图像,因此本文利用湍流的统计特性来模拟大量受湍流影响的图像。我们将训练好的GAN模型用于模拟湍流图像的恢复,并取得了一些成果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Research on atmospheric turbulence-degraded image restoration based on generative adversarial networks
The imaging equipment working in the atmosphere will not only be limited by the performance of the imaging system, but also be affected by turbulence. In the fields of astronomical observation, ground-based remote sensing and remote monitoring, there is an urgent need for corresponding methods and technologies to eliminate the impact of atmospheric turbulence and obtain clear images. With the development of computer technology, atmospheric optics theory and image processing technology, more and more researchers hope to combine deep learning technology with atmospheric turbulence theory to reduce the impact of turbulence on imaging and obtain clear and stable images. In this paper, a turbulence image restoration technique based on Generative Adversarial Networks (GAN) is proposed, which is divided into generator network and discriminator network. The generator network is used to convert blurred images affected by turbulence into clear images. The discriminator network is used to compare the converted image with the real clear image to determine whether the image is real or generated. After the whole GAN is optimized and trained, the image transformed by the generator and the real and clear image cannot be distinguished from each other. Because the training of the GAN requires a large number of corresponding samples, it is difficult to obtain the images affected and unaffected by turbulence at the same time in real life, so this paper uses the statistical characteristics of turbulence to simulate a large number of images affected by turbulence. We used the trained GAN model to simulate turbulence image restoration and got some achievements.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信