Color Mapping for 3D Geometric Models without Reference Image Locations

Abstract

Color mapping for 3D models with captured images is a classical problem in computer vision. Typically, registration between 3D model and images is assumed to be provided, otherwise corresponding points need to be labeled. For many applications, 3D model and images are acquired from different devices, since registration cannot be directly obtained, manual labeling has to be adopted. In this paper, a novel color mapping approach is proposed to deal with the case when only a 3D model and a set of multi-view color images are given. A new 3D model is reconstructed by all the images. By aligning the reconstructed model with the input model, the reference image locations are calculated. After camera pose refinement, the color value of each point in the input model is finally determined. In the whole process, we only need to select several point pairs between the two models, and all the other processes are conducted automatically. Experimental results demonstrate the effectiveness of our proposal.