{"title":"NeRF-DA: Neural Radiance Fields Deblurring With Active Learning","authors":"Sejun Hong;Eunwoo Kim","doi":"10.1109/LSP.2024.3511350","DOIUrl":null,"url":null,"abstract":"Neural radiance fields (NeRF) represent multi-view images as 3D scenes, achieving a photo-realistic novel view synthesis quality. However, capturing multi-view images in real-world scenarios is not well aligned and often results in blur or noise. Deblur-NeRF, which uses kernel deformation to improve sharpness, is effective but the quantity of training blur samples and imbalance significantly affect the overall results. In this study, we propose neural radiance fields deblurring with active learning (NeRF-DA), focusing on high-quality blurred images for 3D scene modeling. NeRF-DA uses pool-based active learning with uncertainty estimation to improve model efficiency with a high-quality training set. Subsequently, we deblur the data using the trained model and proceed with NeRF training by selecting the best-sharpened images for querying. Experiments on both camera motion blur and defocus blur demonstrate that NeRF-DA significantly enhances the quality of the existing Deblur-NeRF.","PeriodicalId":13154,"journal":{"name":"IEEE Signal Processing Letters","volume":"32 ","pages":"261-265"},"PeriodicalIF":3.2000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Signal Processing Letters","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10777589/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Neural radiance fields (NeRF) represent multi-view images as 3D scenes, achieving a photo-realistic novel view synthesis quality. However, capturing multi-view images in real-world scenarios is not well aligned and often results in blur or noise. Deblur-NeRF, which uses kernel deformation to improve sharpness, is effective but the quantity of training blur samples and imbalance significantly affect the overall results. In this study, we propose neural radiance fields deblurring with active learning (NeRF-DA), focusing on high-quality blurred images for 3D scene modeling. NeRF-DA uses pool-based active learning with uncertainty estimation to improve model efficiency with a high-quality training set. Subsequently, we deblur the data using the trained model and proceed with NeRF training by selecting the best-sharpened images for querying. Experiments on both camera motion blur and defocus blur demonstrate that NeRF-DA significantly enhances the quality of the existing Deblur-NeRF.
期刊介绍:
The IEEE Signal Processing Letters is a monthly, archival publication designed to provide rapid dissemination of original, cutting-edge ideas and timely, significant contributions in signal, image, speech, language and audio processing. Papers published in the Letters can be presented within one year of their appearance in signal processing conferences such as ICASSP, GlobalSIP and ICIP, and also in several workshop organized by the Signal Processing Society.