SLO-Aware Scheduling Deep Learning Inference for Digital Twin-Enabled Serverless Edge

Abstract

The digital twin (DT) technique employs virtual models to accurately represent physical entities and their dynamic behaviors, enabling applications in prediction, optimization, and real-time monitoring. When integrated with deep learning (DL) and offered as a service, DTs significantly enhance system intelligence and operational efficiency. However, resource constraints in edge environments pose significant challenges for GPU resource scheduling, particularly under concurrent execution of DLI tasks for DT services. To address these challenges, this article introduces an service level objective (SLO)-aware scheduling framework designed to optimize DL inference for DT-enabled intelligent edge systems, which combines accurate task processing latency prediction with a dynamic synchronization strategy. The proposed strategy optimizes GPU resource allocation to meet task-specific performance objectives, thereby improving system productivity and efficiency. Comprehensive evaluations show that our method significantly reduces SLO violations by 31.2%–90.1% and JCT by 16.2%–80.3% compared to baseline methods, demonstrating its effectiveness in resource-limited edge computing environments under high workload scenarios.