{"title":"基于注意力动态调整机制的光场图像超分辨率重建","authors":"Wei Feng, Jichen Sun, Bincheng Wang, Jiangtao Xu, Zhongsheng Zhai","doi":"10.1016/j.optcom.2024.131317","DOIUrl":null,"url":null,"abstract":"<div><div>The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.</div></div>","PeriodicalId":19586,"journal":{"name":"Optics Communications","volume":"575 ","pages":"Article 131317"},"PeriodicalIF":2.2000,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Super-resolution reconstruction of light field image based on dynamic adjustment of attention mechanism\",\"authors\":\"Wei Feng, Jichen Sun, Bincheng Wang, Jiangtao Xu, Zhongsheng Zhai\",\"doi\":\"10.1016/j.optcom.2024.131317\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.</div></div>\",\"PeriodicalId\":19586,\"journal\":{\"name\":\"Optics Communications\",\"volume\":\"575 \",\"pages\":\"Article 131317\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-11-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics Communications\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S003040182401054X\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics Communications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S003040182401054X","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
Super-resolution reconstruction of light field image based on dynamic adjustment of attention mechanism
The light field imaging has the problem of mutual restriction between spatial resolution and angular resolution. In this paper, we propose a new blind network based on dynamic adjustment of attention mechanism, and the network can reconstruct the low-resolution images with the multiple blur kernels and noise levels to realize super-resolution reconstruction of the light field images. Firstly, the original sub-aperture images array with low-resolution is used to estimate the blur kernel and noise level as auxiliary information. Then, the parameter features are extracted by the dynamic adjustment module, and the degradation representation is combined with the image features to adapt to various blur kernels and noises. After that, the feature information of the light field image is calculated by the distg-block attention block, and a finer feature map can be obtained for subsequent network learning. Finally, the feature map is up-sampled to obtain a sub-aperture image array. The experimental results show that the proposed method can improve the spatial resolution of the light field images by four times, and obtain clearer light field images with more details.
期刊介绍:
Optics Communications invites original and timely contributions containing new results in various fields of optics and photonics. The journal considers theoretical and experimental research in areas ranging from the fundamental properties of light to technological applications. Topics covered include classical and quantum optics, optical physics and light-matter interactions, lasers, imaging, guided-wave optics and optical information processing. Manuscripts should offer clear evidence of novelty and significance. Papers concentrating on mathematical and computational issues, with limited connection to optics, are not suitable for publication in the Journal. Similarly, small technical advances, or papers concerned only with engineering applications or issues of materials science fall outside the journal scope.