Power Control Based on Deep Q Network with Modified Reward Function in Cognitive Networks

Abstract

This paper aims to design an appropriate power control policy of the secondary user (SU) to share the spectrum with the primary user without harmful interference. With dynamic spectrum environment, we develop a power control policy based on deep reinforcement learning with Deep Q network (DQN) that the secondary can intelligently adjust his transmit power. And reward function is properly designed to avoid the sparse reward problem which may cause the secondary user cannot adjust to effective power in limited steps and finally fails to transmit. Our experiment result reveals that under the help of the proposed network and reward function, the secondary user can fast and efficiently adjust to effective power from any initial state.