DRMQ: Dynamic Resource Management for Enhanced QoS in Collaborative Edge-Edge Industrial Environments

Abstract

In the fast-developing industrial environments, extensive focus on resource management within Mobile Edge Computing (MEC) aims to ensure low-latency QoS, however, some tasks offloaded to the cloud still experience high latency. Additionally, high energy consumption, poor link reliability, and excessive processing delays are intolerable for industrial applications. Compared to general servers, edge computing devices based on Arm architecture exhibit lower latency and higher energy efficiency. This highlights the need for improved heterogeneous Collaborative Edge-Edge Industrial Environments (CEIE) and precise multi-user QoS metrics. Thus, we focus on dynamic resource management within the CEIE architecture to better satisfy diverse industrial applications, formulating a multi-stage Mixed Integer Nonlinear Programming (MINLP) problem to minimize system costs. To reduce the computational complexity of solving the MINLP, we decompose the original problem into multi-user task offloading, Communication Resource Allocation (CmRA), and Computational Resource Allocation (CpRA) problems. These transformed problems are then tackled using DRMQ: an integrated learning optimization approach that combines model-free, priority experience replay-based Double Deep Q-Network (iDDQN) with model-based optimization, accelerating the Q-value function's convergence speed and reducing training time. Extensive simulations show that our proposed optimization scheme can reduce the average weighted system cost by at least 43.168% . Moreover, testbed experiments demonstrate that the proposed algorithm can reduce the average system cost by at least 42.650% in real-world applications, outperforming existing methods.