Dynamic Channel Access and Power Control via Deep Reinforcement Learning

Abstract

Efficient use of spectral and energy resources is critical in wireless networks and has been extensively studied in recent years. In particular, dynamic spectrum access and power control have been addressed primarily via optimization and game-theoretic tools. In this paper, motivated by recent advances in machine learning and, more specifically, the success of reinforcement learning for addressing dynamic control problems, we consider deep reinforcement learning to jointly perform dynamic channel access and power control in wireless interference channels. We propose a deep Q-learning model, develop an algorithm, and evaluate the performance considering different utilities and reward mechanisms. We provide comparisons with the optimal centralized strategies that require complete information and use weighted minimum mean square error (WMMSE) based power control and exhaustive search over all channel selection policies. We highlight the performance improvements with power control.