Self-Adaptive Dynamic In-Band Network Telemetry Orchestration for Balancing Accuracy and Stability

Abstract

In-band network telemetry (INT) is an emerging network measurement technique that offers real-time and fine-grained visualization capabilities for networks. However, the utilization of INT for network measurement introduces additional overheads to the network. The process of data collection consumes extra bandwidth resources, and adjustments to the data collection scheme can impact network stability. Additionally, the INT orchestration scheme requires adaptation to dynamics in the network to improve measurement accuracy. Therefore, striking a balance between accuracy and stability becomes a critical problem. In this paper, our focus lies in the trade-off between measurement accuracy and network stability. We consider the long-term orchestration of multiple telemetry tasks, rationally deploying distinct telemetry tasks to different application flows. To address the challenge, we propose a self-adaptive Dynamic INT Orchestration scheme, D-INTO. Specifically, we formulate a stochastic optimization problem for dynamic INT orchestration. Then we employ Lyapunov optimization to decouple the stochastic optimization problem and use surrogate Lagrangian relaxation to construct a polynomial-time approximation algorithm. Theoretical analysis and experimental results demonstrate that our proposed D-INTO outperforms existing schemes in terms of adaptability to the network dynamics.