Online Scheduling Unbiased Distributed Learning over Wireless Edge Networks

Abstract

To realize high quality smart IoT services, such as intelligent video surveillance in Auto Driving and Smart City, tremendous amount of distributed machine learning jobs train unbiased models in wireless edge networks, adopting the parameter server (PS) architecture. Due to the large datasets collected geo-distributedly, the training of unbiased distributed learning (UDL) brings high response latency and bandwidth consumption. In this paper, we propose an online scheduling algorithm, Okita, to minimize both the latency cost and bandwidth cost in UDL. Okita schedules UDL jobs at each time slot to jointly decide the execution time window, the amount of training data, the number and the location of concurrent workers and PSs in each site. To evaluate the practical performance of Okita, we implement a testbed based on Kubernetes. Extensive experiments and simulations show that Okita can reduce up to 60% of total cost, compared with the state-of-the-art schedulers in cloud systems.