Evaluating Human-Artificial Agent Decision Congruence in a Coordinated Action Task

Recommender systems designed to augment human decision-making in multi-agent tasks need to not only recommend actions that align with the task goal, but which also maintain coordinative behaviors between agents. Further, if these systems are to be used for skill training, they need to impart implicit learning to its users. This work compared a recommender system trained using deep reinforcement learning to a heuristic-based system in recommending actions to human participants teaming with an artificial agent during a collaborative problem-solving task. In addition to evaluating task performance and learning, we also evaluate the extent to which the human action are congruent with the recommended actions.