基于深度学习的大气湍流退化图像恢复方法设计

Xiangxi Li, Haotong Ma, Junqiu Chu
{"title":"基于深度学习的大气湍流退化图像恢复方法设计","authors":"Xiangxi Li, Haotong Ma, Junqiu Chu","doi":"10.1117/12.2668458","DOIUrl":null,"url":null,"abstract":"When imaging long-range targets using ground-based optical systems, the presence of atmospheric turbulence can cause blurring, dithering, and other degradations in the observed images. In previous research work, the research objects are mostly point targets, and the research work on the recovery of extended targets is yet to be perfected. With the rapid development of deep learning, neural networks driven by data can be used to obtain the recovered images directly by establishing a nonlinear mapping relationship between the degraded and original images. Therefore, the use of wavefront phase detection devices can be avoided by deep learning algorithms. The neural network directly reconstructs the original target of the turbulent degraded image that solves the problem of image blurring due to dynamic turbulence. In this paper, we propose DeblurNet, which employs the global self-attentive module. It improves channel and spatial information extraction, reduces information loss between network layers and global interaction representation to improve the performance of deep neural networks. DeblurNet is used to minimize the effect of turbulence on images and is validated on the NWPU-RESISC45 dataset. We refer to two image evaluation criteria, PSNR and SSIM. From the results, the direct reconstruction of the original target image by deep learning has a good recovery effect.","PeriodicalId":259102,"journal":{"name":"Optical Technology, Semiconductor Materials, and Devices","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The design of a method for recovering degraded images of atmospheric turbulence based on deep learning\",\"authors\":\"Xiangxi Li, Haotong Ma, Junqiu Chu\",\"doi\":\"10.1117/12.2668458\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"When imaging long-range targets using ground-based optical systems, the presence of atmospheric turbulence can cause blurring, dithering, and other degradations in the observed images. In previous research work, the research objects are mostly point targets, and the research work on the recovery of extended targets is yet to be perfected. With the rapid development of deep learning, neural networks driven by data can be used to obtain the recovered images directly by establishing a nonlinear mapping relationship between the degraded and original images. Therefore, the use of wavefront phase detection devices can be avoided by deep learning algorithms. The neural network directly reconstructs the original target of the turbulent degraded image that solves the problem of image blurring due to dynamic turbulence. In this paper, we propose DeblurNet, which employs the global self-attentive module. It improves channel and spatial information extraction, reduces information loss between network layers and global interaction representation to improve the performance of deep neural networks. DeblurNet is used to minimize the effect of turbulence on images and is validated on the NWPU-RESISC45 dataset. We refer to two image evaluation criteria, PSNR and SSIM. From the results, the direct reconstruction of the original target image by deep learning has a good recovery effect.\",\"PeriodicalId\":259102,\"journal\":{\"name\":\"Optical Technology, Semiconductor Materials, and Devices\",\"volume\":\"10 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optical Technology, Semiconductor Materials, and Devices\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2668458\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optical Technology, Semiconductor Materials, and Devices","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2668458","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

当使用地面光学系统成像远程目标时,大气湍流的存在会导致观测图像的模糊、抖动和其他退化。在以往的研究工作中,研究对象多为点目标,扩展目标的回收研究工作尚不完善。随着深度学习的快速发展,数据驱动的神经网络可以通过建立退化图像与原始图像之间的非线性映射关系,直接获得恢复图像。因此,可以通过深度学习算法避免使用波前相位检测设备。神经网络直接重建湍流退化图像的原始目标,解决了动态湍流导致图像模糊的问题。本文提出了采用全局自关注模块的DeblurNet。它改进了信道和空间信息的提取,减少了网络层间的信息丢失和全局交互表示,提高了深度神经网络的性能。DeblurNet用于最小化湍流对图像的影响,并在NWPU-RESISC45数据集上进行了验证。我们参考了两个图像评价标准,PSNR和SSIM。从结果来看,通过深度学习直接重建原始目标图像具有良好的恢复效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The design of a method for recovering degraded images of atmospheric turbulence based on deep learning
When imaging long-range targets using ground-based optical systems, the presence of atmospheric turbulence can cause blurring, dithering, and other degradations in the observed images. In previous research work, the research objects are mostly point targets, and the research work on the recovery of extended targets is yet to be perfected. With the rapid development of deep learning, neural networks driven by data can be used to obtain the recovered images directly by establishing a nonlinear mapping relationship between the degraded and original images. Therefore, the use of wavefront phase detection devices can be avoided by deep learning algorithms. The neural network directly reconstructs the original target of the turbulent degraded image that solves the problem of image blurring due to dynamic turbulence. In this paper, we propose DeblurNet, which employs the global self-attentive module. It improves channel and spatial information extraction, reduces information loss between network layers and global interaction representation to improve the performance of deep neural networks. DeblurNet is used to minimize the effect of turbulence on images and is validated on the NWPU-RESISC45 dataset. We refer to two image evaluation criteria, PSNR and SSIM. From the results, the direct reconstruction of the original target image by deep learning has a good recovery effect.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信