CONFLICT RESOLUTION STRATEGY BASED ON DEEP REINFORCEMENT LEARNING FOR AIR TRAFFIC MANAGEMENT

Abstract

With the continuous increase in flight flows, the flight conflict risk in the airspace has increased. Aiming at the problem of conflict resolution in actual operation, this paper proposes a tactical conflict resolution strategy based on Deep Reinforcement Learning. The process of the controllers resolving conflicts is modelled as the Markov Decision Process. The Deep Q Network algorithm trains the agent and obtains the resolution strategy. The agent uses the command of altitude adjustment, speed adjustment, or heading adjustment to resolve a conflict, and the design of the reward function fully considers the air traffic control regulations. Finally, simulation experiments were performed to verify the feasibility of the strategy given by the conflict resolution model, and the experimental results were statistically analyzed. The results show that the conflict resolution strategy based on Deep Reinforcement Learning closely reflected actual operations regarding flight safety and conflict resolution rules.