Advanced cooperative decentralized decision making using a cooperative reward system

Abstract

Agents can benefit from cooperative behavior as it intends to increase the total utility. In traffic situations, one agent may behave cooperatively by yielding to another. In recurring situations, this may lead to an imbalanced distribution of the benefit. However, humans prefer balanced utility distributions over imbalanced ones. While state-of-the-art cooperative decentralized decision making may promote such an imbalanced utility distribution, advanced cooperative decentralized decision making can support equality among the agents. Three different approaches are compared: Considering the agents' utilities perfect substitutes, imperfect substitutes, and perfect substitutes with time-variable rates of substitution based on a cooperative reward system. Simulations of a highway scenario reveal the differences in recurring situations: Perfect substitutes indeed maximize total utility, but at the expense of a highly unequal utility distribution that may lead to poor long-term user acceptance; imperfect substitutes promote an equal utility distribution, but leave much of the potential of cooperative behavior unused; introducing a cooperative reward system based on memories of costs is shown to allow for a trade-off between both - altruistic-cooperative behavior without constant preference of one agent over the other, which is assumed to improve user acceptance.