From the Definition to the Automatic Assessment of Engagement in Human–Robot Interaction: A Systematic Review

Abstract

The concept of engagement is widely adopted in the human–robot interaction (HRI) field, as a core social phenomenon in the interaction. Despite the wide usage of the term, the meaning of this concept is still characterized by great vagueness. A common approach is to evaluate it through self-reports and observational grids. While the former solution suffers from a time-discrepancy problem, since the perceived engagement is evaluated at the end of the interaction, the latter solution may be affected by the subjectivity of the observers. From the perspective of developing socially intelligent robots that autonomously adapt their behaviors during the interaction, replicating the ability to properly detect engagement represents a challenge in the social robotics community. This systematic review investigates the conceptualization of engagement, starting with the works that attempted to automatically detect it in interactions involving robots and real users (i.e., online surveys are excluded). The goal is to describe the most worthwhile research efforts and to outline the commonly adopted definitions (which define the authors’ perspective on the topic) and their connection with the methodology used for the assessment (if any). The research was conducted within two databases (Web of Science and Scopus) between November 2009 and January 2023. A total of 590 articles were found in the initial search. Thanks to an accurate definition of the exclusion criteria, the most relevant papers on automatic engagement detection and assessment in HRI were identified. Finally, 28 papers were fully evaluated and included in this review. The analysis illustrates that the engagement detection task is mostly addressed as a binary or multi-class classification problem, considering user behavioral cues and context-based features extracted from recorded data. One outcome of this review is the identification of current research barriers and future challenges on the topic, which could be clustered in the following fields: engagement components, annotation procedures, engagement features, prediction techniques, and experimental sessions.