Broomrocket: Open Source Text-to-3D Algorithm for 3D Object Placement

Abstract

Story writers and other creative professionals often rely on concept artists to visualize and then further iterate on their work during game development and other visualization processes. This exchange and its various stages are time-consuming, and there is no easy remedy for creating a walkable 3D concept art without involving a 3D artist yet. As a first step, we present Broomrocket, an open source text-to-3D algorithm for 3D concept art. Broomrocket’s contribution is an object relation and placement algorithm that transforms user input describing a 3D scene given in plain English language into actual models placed in a 3D scene. It runs locally using an existing downloaded natural language processing model and does not require third party services unless a connection to an online 3D model distribution platform is desired. In that case, Broomrocket will search for the keywords from the user’s narrative input and desired license, and place them in the 3D scene, adding each model’s individual license to a license file for further usage.