Recognition of arm and body postures as social cues for proactive HRI

Abstract Artificial agents can uplift the living standards of domestic population considerably. One hindrance for this is that the robot is less competent to perceive complex human behaviors. With such perceptive skills in the robot, nonexpert users will find it easier to cope with their robot companion with less and less instructions to follow. Perception of the internal state of a user or “user situation” before interaction is crucial in this regard. There are a variety of factors that affect this user situation. Out of these, posture becomes prominent in displaying the emotional state of a person. This article presents a novel approach to identify diverse human postures often encountered in domestic environments and how a robot could assess its user’s emotional state of mind before an interaction based on postures. Therefore, the robot evaluates posture and the overall postural behavior of its user throughout the period of observation before initiating an interaction with its user. Aforementioned user evaluation is nonverbal and decisions are made through observation as well. We introduced a variable called “valence” to measure how “relaxed” or “stressed” a user is, in a certain encounter. The robot decides upon an appropriate approach behavior accordingly. Furthermore, the proposed concept was capable of recognizing both arm and body postures and both postural behaviors over time. This leads to an interaction initiated by robot itself in a favorable situation so that the scenario looks more intelligent. Hence more humanlike. The system has been implemented, and experiments have been conducted on an assistive robot placed in an artificially created domestic environment. Results of the experiments have been used to validate the proposed concept and critical observations are discussed.