PromptNavi: Text-to-image generation through interactive prompt visual exploration

Abstract

Modern text-to-image generative models can create high-quality and impressive images, but require extensive trial-and-error to interpret user intents. To solve this issue, we propose PromptNavi, a visual exploration interface for node-based prompt composition leveraging large language models to enhance the efficiency of text-to-image generation. In contrast to conventional prompting interfaces, PromptNavi allows users to manipulate and combine visual attributes of target images directly to refine outputs iteratively. Our user study confirmed that the results generated using PromptNavi achieved significant improvements in user usability, reduced cognitive load, and superior image quality rated by independent evaluators. It is verified that users achieved better results with less effort across all measured dimensions, including creativity, atmosphere, coherence, and overall impression. We believe PromptNavi may bridge the gap between user intent and generative AI outputs, advancing human-centered generative AI by making generative models accessible to novices with an enhanced user experience. Source codes are available at: https://github.com/BofeiHuang/PromptNavi.