Model-Heterogeneous Federated Graph Learning With Prototype Propagation

Abstract

Federated graph learning (FGL) enables clients to collaboratively train a robust graph neural network (GNN) while ensuring their private graph data never leaves the local. However, existing FGL frameworks require all clients to train the identical GNN model, which limits their real-world applicability. Although many model-heterogenous frameworks have been proposed for traditional nongraph federated learning settings, directly transferring them to the FGL setting typically results in suboptimal performance. To fill the gap, this article presents federated prototype propagation network (FedPPN), a lightweight FGL framework that supports clients to train fully customized models. FedPPN only transmits prototypes between clients and the server for knowledge sharing. The core idea is propagating global prototypes on each client's local graph, generating prototype-based node representations and predictions. The prototype-based prediction can then be ensembled with the prediction of local GNN, allowing clients to achieve accurate prediction. We evaluate our FedPPN on six benchmark datasets with different heterogeneous model setups. Experimental results show that our FedPPN outperforms advanced baselines in model accuracy without adding any trainable parameters on clients or the server. Besides, FedPPN's communication cost is significantly lower than methods that rely on model parameter exchange.