System software architecture for advancing human robot interaction by cloud services and multi-robot cooperation

Human-like interactions with robots based on Conversational AI facilitate assistance and teamwork in various contexts. Those interactions are further enhanced by utilizing physical presence and context from the robot's hardware. Robot cooperation is also especially useful, when software or hardware resources have to be shared in a multi-robot system. Therefore, we propose a modular software architecture for multi-robot cooperation that extends the integration of Conversational AI into Socially Assistive Robots, previously suggested by authors. It utilizes a flow-based approach that involves shared repositories and direct or message-driven communication to convey natural language transcriptions among robots in order to support their cooperation. By experiments we evaluated the cooperation between NAOqi based robots and Furhat robot. Our experimental results demonstrate architecture's modularity and adaptability to different cloud services, along with its effectiveness for interactions involving multiple robots.