Alchemist: LLM-Aided End-User Development of Robot Applications

Abstract

Large Language Models (LLMs) have the potential to catalyze a paradigm shift in end-user robot programming—moving from the conventional process of user specifying programming logic to an iterative, collaborative process in which the user speci � es desired program outcomes while LLM produces detailed speci � cations. We introduce a novel integrated development system, Alchemist , that leverages LLMs to empower end-users in creating, testing, and running robot programs using natural language inputs, aiming to reduce the required knowledge for developing robot applications.