Diversifying experiences in multi agent reinforcement learning

Abstract

Deep Reinforcement learning algorithms have traditionally been applied to tasks that train challenging control behavior. Actor Critic based versions of these algorithms have been used to train agents in state of the art settings. While proving to be sample efficient in multi agent learning, these algorithms tend to perform poorly in the exploration phases. In this paper, the experience gained by the replay buffer during the exploration phase is improved by diversifying the input results using a genetic algorithm. We have tested this method on predator prey environment and other team based tasks. The evaluation shows that our method tends to produce a more robust solutions outperforming the traditional methods.