Sketch based modeling via manifold regularization

This paper proposes a novel method to automatically generate the realistic 3D model for a 2D free-hand sketch drawn by a user. Specifically, the proposed method first retrieves 3D shapes based on the sketch, and then implements a deformation procedure to make the most similar model retrieved more consistent with the provided sketch. In the retrieval stage, a locality preserving view selection scheme is adopted to generate views that are well-suited to create sketch images for the 3D object. Our method predicates the sketch views accurately while significantly reduces the amount of rendering views. In the deformation stage, retrieved models are modified according to the input sketches. Since free-hand sketches always contain various kinds of drawing errors such as stroke jittering and asymmetry, extracting plausible deforming information from sketches while discarding undesirable drawing errors is difficult. To address these issues, we obtain the plausible deformation for the corresponding sketch by exploring a shape manifold trained on a collection of similar 3D models. Experimental results show that the proposed method can generate 3D shapes that correspond quite well with 2D sketches.