基于注意力动态调整机制的光场图像超分辨率重建

IF 2.2 3区 物理与天体物理 Q2 OPTICS
Wei Feng, Jichen Sun, Bincheng Wang, Jiangtao Xu, Zhongsheng Zhai
{"title":"基于注意力动态调整机制的光场图像超分辨率重建","authors":"Wei Feng,&nbsp;Jichen Sun,&nbsp;Bincheng Wang,&nbsp;Jiangtao Xu,&nbsp;Zhongsheng Zhai","doi":"10.1016/j.optcom.2024.131317","DOIUrl":null,"url":null,"abstract":"<div><div>The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.</div></div>","PeriodicalId":19586,"journal":{"name":"Optics Communications","volume":"575 ","pages":"Article 131317"},"PeriodicalIF":2.2000,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Super-resolution reconstruction of light field image based on dynamic adjustment of attention mechanism\",\"authors\":\"Wei Feng,&nbsp;Jichen Sun,&nbsp;Bincheng Wang,&nbsp;Jiangtao Xu,&nbsp;Zhongsheng Zhai\",\"doi\":\"10.1016/j.optcom.2024.131317\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.</div></div>\",\"PeriodicalId\":19586,\"journal\":{\"name\":\"Optics Communications\",\"volume\":\"575 \",\"pages\":\"Article 131317\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-11-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics Communications\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S003040182401054X\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics Communications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S003040182401054X","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

摘要

光场成像存在空间分辨率和角度分辨率相互制约的问题。本文提出了一种基于注意力动态调整机制的新型盲法网络,该网络可以重建具有多种模糊核和噪声水平的低分辨率图像,实现光场图像的超分辨率重建。首先,利用原始的低分辨率子孔径图像阵列作为辅助信息来估计模糊核和噪声水平。然后,通过动态调整模块提取参数特征,并将退化表示与图像特征相结合,以适应各种模糊核和噪声。之后,光场图像的特征信息会被 distg-block 注意模块计算,从而获得更精细的特征图,用于后续的网络学习。最后,对特征图进行上采样,得到子孔径图像阵列。实验结果表明,所提出的方法可将光场图像的空间分辨率提高四倍,并获得更清晰、细节更多的光场图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Super-resolution reconstruction of light field image based on dynamic adjustment of attention mechanism
The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Optics Communications
Optics Communications 物理-光学
CiteScore
5.10
自引率
8.30%
发文量
681
审稿时长
38 days
期刊介绍: Optics Communications invites original and timely contributions containing new results in various fields of optics and photonics. The journal considers theoretical and experimental research in areas ranging from the fundamental properties of light to technological applications. Topics covered include classical and quantum optics, optical physics and light-matter interactions, lasers, imaging, guided-wave optics and optical information processing. Manuscripts should offer clear evidence of novelty and significance. Papers concentrating on mathematical and computational issues, with limited connection to optics, are not suitable for publication in the Journal. Similarly, small technical advances, or papers concerned only with engineering applications or issues of materials science fall outside the journal scope.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信