Song Chang;Youfang Lin;Wenqi Wang;Da An;Shuo Zhang
{"title":"Learning Light Field Denoising With Symmetrical Refocusing Strategy","authors":"Song Chang;Youfang Lin;Wenqi Wang;Da An;Shuo Zhang","doi":"10.1109/TCI.2024.3507642","DOIUrl":null,"url":null,"abstract":"Due to hardware restrictions, Light Field (LF) images are often captured with heavy noise, which seriously obstructs the subsequent LF applications. In this paper, we propose a novel symmetrical refocusing strategy to construct the focal stack for every view in LF images and design a simple learning-based framework for LF denoising. Specifically, we first select views that are symmetrically arranged around a target view in LF images. Then we shift and average the selected views to calculate the focal stack, in which all refocused images are aligned with the target view and the noises are effectively suppressed. Then, a Fusion Network is designed to fuse the sharp regions in the focal stack to obtain the denoised target view with sharp details. We further exploit more angular and spatial detail information in LF images and combine the fusion outputs to obtain the final denoised LF images. We evaluate our method in various noise levels and kinds of noisy LF images with different disparity ranges. The experiments show that our method achieves the highest quality in both qualitative and quantitative evaluation than state-of-the-art methods. The proposed symmetrical refocusing strategy is also verified to highly improve the denoising performances.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"1786-1798"},"PeriodicalIF":4.2000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10769003/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Due to hardware restrictions, Light Field (LF) images are often captured with heavy noise, which seriously obstructs the subsequent LF applications. In this paper, we propose a novel symmetrical refocusing strategy to construct the focal stack for every view in LF images and design a simple learning-based framework for LF denoising. Specifically, we first select views that are symmetrically arranged around a target view in LF images. Then we shift and average the selected views to calculate the focal stack, in which all refocused images are aligned with the target view and the noises are effectively suppressed. Then, a Fusion Network is designed to fuse the sharp regions in the focal stack to obtain the denoised target view with sharp details. We further exploit more angular and spatial detail information in LF images and combine the fusion outputs to obtain the final denoised LF images. We evaluate our method in various noise levels and kinds of noisy LF images with different disparity ranges. The experiments show that our method achieves the highest quality in both qualitative and quantitative evaluation than state-of-the-art methods. The proposed symmetrical refocusing strategy is also verified to highly improve the denoising performances.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.