A Fastformer Assisted DRL Method on Energy Efficient and Interference Aware Service Provisioning

Abstract

Network function virtualization (NFV) empowered by virtualization technology can achieve flexible virtual network function (VNF) placement. To improve resource utilization and energy efficiency, different VNFs tend to be co-located on common servers, which inevitably intrigues VNF performance degradation induced by hardware resource competition. The problem of energy-efficient and interference-aware service function chain (SFC) provisioning is considered in this paper and envisioned to yield minimum activated servers and maximum average throughput. It is formulated as a mixed integer linear programming (MILP) model to achieve optimal solutions. Then, a gale-shapley based offline approximation algorithm is designed through bipartite matching, to yield an SFC allocation decision in one go with proved competitive ratio. In online scenario, Transformer and its efficient model Fastformer, combined with Graph Attention Network (GAT) respectively, are introduced into deep reinforcement learning (DRL) structure for the first time to quickly and accurately abstract features of substrate network and SFC. A DRL-based Fastformer-assisted energy efficient and interference aware SFC provisioning (DRL-EI) algorithm is proposed with an elaborately designed reward function to balance energy consumption and VNF interference. Simulations indicate the gap between DRL-EI and MILP is marginal. DRL-EI outperforms state-of-art work in terms of energy consumption, VNF normalized throughput and acceptance rate.