OptiViewNeRF: Optimizing 3D reconstruction via batch view selection and scene uncertainty in Neural Radiance Fields

Abstract

In situations with a limited number of posed images, choosing the most suitable viewpoints becomes crucial for accurate Neural Radiance Fields (NeRF) modeling. Current approaches for view selection often rely on heuristic methods or are computationally intensive. To address these challenges, we introduce a new framework, OptiViewNeRF, which leverages scene uncertainty to guide the view selection process. Initially, an uncertainty estimation model of the entire scene is developed based on a preliminary NeRF model. This model then informs the selection of new perception viewpoints using a batch view selection strategy, allowing the entire process to be completed in a single iteration. By selecting viewpoints that provide informative data, this approach improves novel view synthesis results and accurately reconstructs 3D scenes. Experimental results on two selected datasets show that the proposed method effectively identifies informative viewpoints, resulting in more accurate scene reconstructions compared to baseline and state-of-the-art methods.