{"title":"Towards an Efficient System for Differentially-private, Cross-device Federated Learning","authors":"Kunlong Liu, Richa Wadaskar, Trinabh Gupta","doi":"10.1145/3477114.3488762","DOIUrl":"https://doi.org/10.1145/3477114.3488762","url":null,"abstract":"This paper describes fresh ideas for a new system for federated averaging that aims to efficiently provide differential privacy even when a fraction of devices is malicious and there is no trusted core.","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131215497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Community-Structured Decentralized Learning for Resilient EI","authors":"Harikrishna S. Kuttivelil, K. Obraczka","doi":"10.1145/3477114.3488764","DOIUrl":"https://doi.org/10.1145/3477114.3488764","url":null,"abstract":"","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127662447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Aghiles Ait Messaoud, Sonia Ben Mokhtar, Vlad Nitu, V. Schiavoni
{"title":"GradSec","authors":"Aghiles Ait Messaoud, Sonia Ben Mokhtar, Vlad Nitu, V. Schiavoni","doi":"10.1145/3477114.3488763","DOIUrl":"https://doi.org/10.1145/3477114.3488763","url":null,"abstract":"HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. GradSec: a TEE-based Scheme Against Federated Learning Inference Attacks Aghiles Ait Messaoud, Sonia Ben Mokhtar, Vlad Nitu, Valerio Schiavoni","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117217514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Fan Lai, Yinwei Dai, Xiangfeng Zhu, H. Madhyastha, Mosharaf Chowdhury
{"title":"FedScale","authors":"Fan Lai, Yinwei Dai, Xiangfeng Zhu, H. Madhyastha, Mosharaf Chowdhury","doi":"10.1145/3477114.3488760","DOIUrl":"https://doi.org/10.1145/3477114.3488760","url":null,"abstract":"We present FedScale, a diverse set of challenging and realistic benchmark datasets to facilitate scalable, comprehensive, and reproducible federated learning (FL) research. FedScale datasets are large-scale, encompassing a diverse range of important FL tasks, such as image classification, object detection, language modeling, speech recognition, and reinforcement learning. For each dataset, we provide a unified evaluation protocol using realistic data splits and evaluation metrics. To meet the pressing need for reproducing realistic FL at scale, we have also built an efficient evaluation platform to simplify and standardize the process of FL experimental setup and model evaluation. Our evaluation platform provides flexible APIs to implement new FL algorithms and includes new execution backends with minimal developer efforts. Finally, we perform indepth benchmark experiments on these datasets. Our experiments suggest fruitful opportunities in heterogeneityaware co-optimizations of the system and statistical efficiency under realistic FL characteristics. FedScale is open-source with permissive licenses and actively maintained,1 and we welcome feedback and contributions from the community.","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"113 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124348254","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Redundancy in cost functions for Byzantine fault-tolerant federated learning","authors":"Shuo Liu, Nirupam Gupta, N. Vaidya","doi":"10.1145/3477114.3488761","DOIUrl":"https://doi.org/10.1145/3477114.3488761","url":null,"abstract":"Federated learning has gained significant attention in recent years owing to the development of hardware and rapid growth in data collection. However, its ability to incorporate a large number of participating agents with various data sources makes federated learning susceptible to adversarial agents. This paper summarizes our recent results on server-based Byzantine fault-tolerant distributed optimization with applicability to resilience in federated learning. Specifically, we characterize redundancies in agents' cost functions that are necessary and sufficient for provable Byzantine resilience in distributed optimization. We discuss the implications of these results in the context of federated learning.","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132246908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Cheng, Kevin Eykholt, Zhongshu Gu, H. Jamjoom, K. R. Jayaram, Enriquillo Valdez, Ashish Verma
{"title":"Separation of Powers in Federated Learning (Poster Paper)","authors":"P. Cheng, Kevin Eykholt, Zhongshu Gu, H. Jamjoom, K. R. Jayaram, Enriquillo Valdez, Ashish Verma","doi":"10.1145/3477114.3488765","DOIUrl":"https://doi.org/10.1145/3477114.3488765","url":null,"abstract":"In federated learning (FL), model updates from mutually distrusting parties are aggregated in a centralized fusion server. The concentration of model updates simplifies FL's model building process, but might lead to unforeseeable information leakage. This problem has become acute due to recent FL attacks that can reconstruct large fractions of training data from ostensibly \"sanitized\" model updates. In this paper, we re-examine the current design of FL systems under the new security model of reconstruction attacks. To break down information concentration, we build TRUDA, a new cross-silo FL system, employing a trustworthy and decentralized aggregation architecture. Based on the unique computational properties of model-fusion algorithms, we disassemble all exchanged model updates at the parameter-granularity and re-stitch them to form random partitions designated for multiple hardware-protected aggregators. Thus, each aggregator only has a fragmentary and shuffled view of model updates and is oblivious to the model architecture. The deployed security mechanisms in TRUDA can effectively mitigate training data reconstruction attacks, while still preserving the accuracy of trained models and keeping performance overheads low.","PeriodicalId":288476,"journal":{"name":"Proceedings of the First Workshop on Systems Challenges in Reliable and Secure Federated Learning","volume":"124 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131985277","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}