EdgeMan: Ensuring Real-Time Service for Containerized Edge Systems

Abstract

Containers have emerged as a popular technology for edge computing platforms. Although there are varieties of container orchestration frameworks, e.g., Kubernetes to provide high-reliable services for cloud infrastructure, ensuring realtime service at the containerized edge systems (CESs) remains a challenge. In this paper, we propose Edgeman,a holistic edge service management framework for CESs, which consists of (1) a model-assisted event-driven lightweight online scheduling algorithm to provide request-level execution plans; (2) a bottleneck-metric-aware progressive resource allocation mechanism to improve resource efficiency. We then build a testbed that installed three containerized services with different latency sensitivities for concrete evaluation. Besides, we adopt real-world data traces from Alibaba and Twitter for large-scale emulations. Extensive experiments demonstrate that the deadline miss ratio of Edgemanis reduced 85.9% on average compared with existing methods in both industry and academia.