Friendly human-machine interaction on home care robot

Abstract

In this paper, we proposed a friendly human-machine interaction on home care robot. Our system is able to interact with people, provide information and entertainment. In addition, we commit to a better user-experience, making the interaction friendlier and affable. The system is divided into two parts, friendly user interface and friendly Automatic Speech Recognition. The friendly user interface takes a significant responsibility for direct interaction with people. We improve the operating procedures and add a touch mode for operation. We progress the tasks with parallel processing to enhance the fluency of the system, making the operation friendlier. A friendly ASR needs to have ability to handle noisy environment and deal with multi-person conversation. We apply sound source localization to identify the speaker's position and find out the talking person with face recognition and mouth opening recognition in front of the robot. When the robot extracts the user intent from the speaker, the system will decide an appropriate action and display the information on the user interface.