DF-NeRf: A geometrically consistent 3D reconstruction method for blurry images with decoupled and spatial fusion

IF 8.1 1区 管理学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Information Processing & Management Pub Date : 2026-07-01 Epub Date: 2026-02-05 DOI:10.1016/j.ipm.2026.104669
Xiaohui Wang , Zhenyu Yin , Feiqing Zhang
{"title":"DF-NeRf: A geometrically consistent 3D reconstruction method for blurry images with decoupled and spatial fusion","authors":"Xiaohui Wang ,&nbsp;Zhenyu Yin ,&nbsp;Feiqing Zhang","doi":"10.1016/j.ipm.2026.104669","DOIUrl":null,"url":null,"abstract":"<div><div>Reliable 3D scene understanding is fundamental to intelligent information systems, but motion blur in visual data often disrupts geometric consistency, making the reconstruction results unreliable. This paper proposes a novel blurred image NeRF framework named DF-NeRF, incorporating three core innovations. Firstly, the Multi-Scale Position Feature Fusion (MSPF) structure performs multi-scale feature fusion within the blurred kernel space to precisely estimate ray displacement ranges, thereby preserving multi-view geometric consistency. Secondly, the Multi-layer Independent Weight and Shifting Network (MIWS) is designed to achieve explicit decoupling between geometry and appearance. Within MIWS, the Dual-head Network (DHNet) employs a separate optimisation strategy, independently learning ray offsets (geometric attributes) and rendering weights (appearance attributes), effectively suppressing geometric distortions caused by motion blur. Meanwhile, the Prior-weighted Network (PWNet) employs prior-guided adaptive weighting to fuse different blur kernels, ensuring high-frequency detail geometric continuity. Finally, an edge-aware loss function is introduced to constrain gradient discrepancies in depth discontinuities, explicitly guaranteeing contour structure consistency and detail fidelity. We evaluated on public benchmarks, including 5 synthetic scenes and 10 real scenes, covering both indoor and outdoor environments. Experimental results demonstrate that DF-NeRF outperforms SOTA on PSNR, SSIM, and LPIPS metrics, with the most notable improvement in LPIPS. In synthetic scenes, DF-NeRF achieves an average LPIPS improvement of 14.32% over SOTA. In real-world scenes, DF-NeRF achieves an average LPIPS improvement of 19.79% over SOTA. DF-NeRF significantly enhances 3D reconstruction quality and robustness under blurred images, making it suitable for applications such as autonomous driving and robot vision. Code is available at: <span><span>https://github.com/luckhui0505/DF-NeRF</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"63 5","pages":"Article 104669"},"PeriodicalIF":8.1000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457326000610","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/5 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Reliable 3D scene understanding is fundamental to intelligent information systems, but motion blur in visual data often disrupts geometric consistency, making the reconstruction results unreliable. This paper proposes a novel blurred image NeRF framework named DF-NeRF, incorporating three core innovations. Firstly, the Multi-Scale Position Feature Fusion (MSPF) structure performs multi-scale feature fusion within the blurred kernel space to precisely estimate ray displacement ranges, thereby preserving multi-view geometric consistency. Secondly, the Multi-layer Independent Weight and Shifting Network (MIWS) is designed to achieve explicit decoupling between geometry and appearance. Within MIWS, the Dual-head Network (DHNet) employs a separate optimisation strategy, independently learning ray offsets (geometric attributes) and rendering weights (appearance attributes), effectively suppressing geometric distortions caused by motion blur. Meanwhile, the Prior-weighted Network (PWNet) employs prior-guided adaptive weighting to fuse different blur kernels, ensuring high-frequency detail geometric continuity. Finally, an edge-aware loss function is introduced to constrain gradient discrepancies in depth discontinuities, explicitly guaranteeing contour structure consistency and detail fidelity. We evaluated on public benchmarks, including 5 synthetic scenes and 10 real scenes, covering both indoor and outdoor environments. Experimental results demonstrate that DF-NeRF outperforms SOTA on PSNR, SSIM, and LPIPS metrics, with the most notable improvement in LPIPS. In synthetic scenes, DF-NeRF achieves an average LPIPS improvement of 14.32% over SOTA. In real-world scenes, DF-NeRF achieves an average LPIPS improvement of 19.79% over SOTA. DF-NeRF significantly enhances 3D reconstruction quality and robustness under blurred images, making it suitable for applications such as autonomous driving and robot vision. Code is available at: https://github.com/luckhui0505/DF-NeRF.
DF-NeRf:一种具有解耦和空间融合的模糊图像几何一致性三维重建方法
可靠的三维场景理解是智能信息系统的基础,但视觉数据中的运动模糊往往会破坏几何一致性,使重建结果不可靠。本文提出了一种新的模糊图像NeRF框架,命名为DF-NeRF,包含三个核心创新。首先,多尺度位置特征融合(MSPF)结构在模糊核空间内进行多尺度特征融合,以精确估计射线位移范围,从而保持多视图几何一致性;其次,设计了多层独立权重与移位网络(MIWS),实现了几何与外观的显式解耦;在MIWS中,双头网络(DHNet)采用单独的优化策略,独立学习光线偏移(几何属性)和渲染权重(外观属性),有效地抑制运动模糊引起的几何扭曲。同时,先验加权网络(PWNet)采用先验引导自适应加权融合不同的模糊核,保证了高频细节的几何连续性。最后,引入边缘感知损失函数来约束深度不连续的梯度差异,明确地保证了轮廓结构的一致性和细节保真度。我们对公共基准进行了评估,包括5个合成场景和10个真实场景,涵盖室内和室外环境。实验结果表明,DF-NeRF在PSNR、SSIM和LPIPS指标上优于SOTA,其中LPIPS的改进最为显著。在合成场景中,DF-NeRF比SOTA平均LPIPS提高了14.32%。在实际场景中,DF-NeRF实现了比SOTA平均LPIPS提高19.79%。DF-NeRF显著增强了模糊图像下的3D重建质量和鲁棒性,适用于自动驾驶和机器人视觉等应用。代码可从https://github.com/luckhui0505/DF-NeRF获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Processing & Management
Information Processing & Management 工程技术-计算机:信息系统
CiteScore
17.00
自引率
11.60%
发文量
276
审稿时长
39 days
期刊介绍: Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing. We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书