Federated Learning With Server Learning for Non-IID Data

Federated Learning (FL) has gained popularity as a means of distributed learning using local data samples at clients. However, recent studies showed that FL may experience slow learning and poor performance when client samples have different distributions. In this paper, we consider a server with access to a small dataset, on which it can perform its own learning. This approach is complementary to and can be combined with other approaches, e.g., sample sharing among clients. We study and demonstrate the benefits of proposed approach via experimental results obtained using two datasets - EMNIST and CIFAR10.