Research and experiment of lip coordination with speech for the humanoid head robot-“H&Frobot-III”

Abstract

This paper proposes a method of lip shape coordination with speech in the facial expression robot system ldquoH&Frobot-IIIrdquo. The proposed method can model the talking robotpsilas lip shape using visual speech system, which includes three modules: speech recognition, lip shape recognition and lip pose actuator. In the lip shape recognition module, a viseme representation method is proposed for synthesising the human visual speech. To analyze the robotpsilas lip shape, lip shape model is developed based on the anatomy and facial action coding system (FACS). When robot speaking, the lip shape coordination with speech can be realized through basic lip shape or the combination of basic lip shape. In the ldquoH&Frobot-IIIrdquo system, the lip shape is realized through slide and guide slot mechanism, which implements the two-way movement of muscle in the lip. Finally, the result of the experiment, which is the lip coordination with speech, is shown. When speaking same word, the lip shape of robot is similarity to that of human.