Can Moral Rightness (Utilitarian Approach) Outweigh the Ingroup Favoritism Bias in Human-Agent Interaction

Abstract

As robots increasingly assist more people, tendencies of becoming attached to these robots and treat them well have risen; even to the point of treating robot teammates better than human opponents in laboratory settings. We examined how far this ingroup favoritism extends and how to mitigate it. We did this by making participants play an online game in teams of two humans and two robots against two humans and two robots. After the game, they selected someone to perform an additional unpleasant task (according to the results of our pilot test); we manipulated that task to be equally unpleasant for ingroup and outgroup members in one condition, and more unpleasant for outgroup than for ingroup members in the other condition. We did this to examine if the moral principle of utilitarianism (i.e., social justice and fairness) would outweigh ingroup favoritism. In the results, participants showed typical group dynamics like ingroup favoritism. The opportunity to behave in a utilitarian way failed to reverse the ingroup favoritism effect. Interestingly, participants sacrificed their ingroup robot more than they sacrificed even outgroup players. We speculate about why the study showed these unexpected findings and what it may mean for HRI.