A Deep Learning Approach for Throughput Enhanced Clustering and Spectrally Efficient Resource Allocation in Ultra-Dense Networks

Abstract

The primary obstacle for the wireless industry is meeting the growing demand for cellular services, which necessitates the deployment of numerous femto base stations (FBSs) in ultra-dense networks. Effective resource distribution among densely and randomly distributed FBSs in ultra-dense is difficult, mainly because of intensified interference problems. The K-means clustering is improved by employing the Davies Bouldin index, which separates the clusters to prevent overlapping and mitigate interference. The elbow approach is utilized to determine the optimal number of clusters. Afterward, attention is directed toward addressing efficient resource allocation through a distributive methodology. The proposed approach makes use of a replay buffer-based multi-agent framework and uses the generative adversarial networks deep distributional Q-network (GAN-DDQN) to efficiently model and learn state-action value distributions for intelligent resource allocation. To further improve control over the training error, the distributions are estimated by approximating a whole quantile function. The numerical results validate the effectiveness of both the proposed clustering method and the GAN-DDQN-based resource allocation scheme in optimizing throughput, fairness, energy efficiency, and spectrum efficiency, all while maintaining the QoS for all users.