Yiying Li, Wei Zhou, Haibo Mi, Yijie Wang, Huaimin Wang
{"title":"FedH2L: A Federated Learning Approach with Model and Statistical Heterogeneity","authors":"Yiying Li, Wei Zhou, Haibo Mi, Yijie Wang, Huaimin Wang","doi":"10.1109/JCC59055.2023.00009","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00009","url":null,"abstract":"Federated learning (FL) enables distributed participants to collectively learn a strong global model without sacrificing their individual data privacy. Mainstream FL approaches require each participant to share a common network architecture and further assume that data are sampled IID across participants. However, in real-world deployments, participants may require heterogeneous network architectures; and the data distribution is almost non-uniform. To address these issues we introduce FedH2L, which is agnostic to the model architecture and robust to different data distributions across participants. In contrast to approaches sharing parameters or gradients, FedH2L relies on mutual distillation, exchanging only posteriors on a shared seed set between participants in a decentralized manner. This makes it extremely bandwidth efficient, model agnostic, and crucially produces models capable of performing well on the whole data distribution when learning from heterogeneous silos.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130382080","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Crop Enclave Interface for SGX Programs","authors":"Yaqi Fan, Z. Chen, Qingbao Li, Wenbo Deng","doi":"10.1109/JCC59055.2023.00015","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00015","url":null,"abstract":"Existing memory attacks against SGX use the enclave interface, such as ECALLs and OCALLs, to inject malicious data into the enclave’s trusted memory to trigger memory corruption vulnerabilities therein. Therefore, enclave interface security becomes a key issue in defending against such attacks. However, a comprehensive static analysis of source SGX programs is currently lacking to obtain sufficient a priori knowledge to provide effective runtime interface protection for the enclave. In view of this, we identify 8 types of unsafe input data of enclave and design a new interface cropping method, SGXCrop. This method extracts critical interface information from source SGX programs, including ECALLs in use and unsafe input data, which are cropped at runtime of SGX programs. Tests in real SGX environment verify that the proposed method can effectively crop illegal ECALLs and unsafe input data.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123831623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fault Tolerance of Stateful Microservices for Industrial Edge Scenarios","authors":"Yuke Jia, Tiejun Wang, Tianbo Qiu, Xiaohan Zhang, Rui Wang, Tianyu Wo","doi":"10.1109/JCC59055.2023.00013","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00013","url":null,"abstract":"Due to the ubiquitous increase of Industrial Internet of Things(IIoT) devices, there is a tendency to move some of the microservices-based applications from Cloud to Edge. However, edge devices are prone to node failures because of weak reliability, resulting in the loss of stateful microservices computing state, which may involve fault tolerance of stateful microservices. Moreover, the method of traditional mechanisms for microservices fault tolerance could not meet the real-time requirement. Within this context, based on stateful microservices characteristics, we propose a novel fault tolerant mechanism for IIoT Edge, which mainly consists of causal logging and distributed checkpoint algorithm. This fault recovery mechanism utilizes causal logging to record the nondeterministic events of microservices, and completes the state recovery of microservices by loading checkpoint and replaying log records, which achieves exactly-once guarantees for distributed microservices. In addition, a set of experiments was performed to evaluate the proposed mechanism by integration with Kubernetes. The results show that the proposed mechanism has less impact on service performance compared with other methods.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126994755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wanghan Xu, Bin Shi, Jiqiang Zhang, Zhiyuan Feng, Tianze Pan, Bo Dong
{"title":"MDP: Privacy-Preserving GNN Based on Matrix Decomposition and Differential Privacy","authors":"Wanghan Xu, Bin Shi, Jiqiang Zhang, Zhiyuan Feng, Tianze Pan, Bo Dong","doi":"10.1109/JCC59055.2023.00011","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00011","url":null,"abstract":"In recent years, graph neural networks (GNN) have developed rapidly in various fields, but the high computational consumption of its model training often discourages some graph owners who want to train GNN models but lack computing power. Therefore, these data owners often cooperate with external calculators during the model training process, which will raise critical severe privacy concerns. Protecting private information in graph, however, is difficult due to the complex graph structure consisting of node features and edges. To solve this problem, we propose a new privacy-preserving GNN named MDP based on matrix decomposition and differential privacy (DP), which allows external calculators train GNN models without knowing the original data. Specifically, we first introduce the concept of topological secret sharing (TSS), and design a novel matrix decomposition method named eigenvalue selection (ES) according to TSS, which can preserve the message passing ability of adjacency matrix while hiding edge information. We evaluate the feasibility and performance of our model through extensive experiments, which demonstrates that MDP model achieves accuracy comparable to the original model, with practically affordable overhead.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"39 8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131450029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ying Zhang, Tianyu Wo, Kun Fan, Tianyu Ye, Jiwei Zhang, Junhua Zhang, Xiao Feng
{"title":"Optimization Strategies for Data Placement in Satellite Cloud-oriented Distributed File Systems","authors":"Ying Zhang, Tianyu Wo, Kun Fan, Tianyu Ye, Jiwei Zhang, Junhua Zhang, Xiao Feng","doi":"10.1109/JCC59055.2023.00016","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00016","url":null,"abstract":"Forming a collaborative computing network among the deployed satellites in space can process data rapidly and reduce data transmission delay by leveraging the communication, storage, and computing capacities of the satellites. Due to the dynamics of satellite orbits, the distance between satellites varies over time, bringing new challenges to the designing of dedicated distributed file systems for collaborative satellites. Traditional distributed file systems did not consider the network topology and dynamics of satellite clouds and the limited computing resources of satellite node cores. In view of the torus network topology of satellite clouds, we design a highly available distributed metadata management mechanism for satellite clouds to ensure efficient metadata reading and reliability. On this basis, a topology-aware replica placement strategy is proposed to minimize communication costs and energy consumption for replica placement. Based on the metadata strategy and replica placement strategy mentioned above, we design and implement a distributed file system for satellite clouds. Experimental results demonstrate that our proposed placement strategy can improve the data transmission performance of the replica placement by more than double compared to the random placement strategy.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"07 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129710342","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"FCloudless: A Performance-Aware Collaborative Mechanism for JointCloud Serverless","authors":"Jianfei Liu, Huaimin Wang, Peichang Shi, Yaojie Li, Penghui Ma, Guodong Yi","doi":"10.1109/JCC59055.2023.00019","DOIUrl":"https://doi.org/10.1109/JCC59055.2023.00019","url":null,"abstract":"As a new stage in the development of the cloud computing paradigm, serverless computing has the high-level abstraction characteristic of shielding underlying details. This makes it extremely challenging for users to choose a suitable serverless platform. To address this, targeting the jointcloud computing scenario of heterogeneous serverless platforms across multiple clouds, this paper presents a jointcloud collaborative mechanism called FCloudless with cross-cloud detection of the full lifecycle performance of serverless platforms. Based on the benchmark metrics set that probe performance critical stages of the full lifecycle, this paper proposes a performance optimization algorithm based on detected performance data that takes into account all key stages that affect the performance during the lifecycle of a function and predicts the overall performance by combining the scores of local stages and dynamic weights. We evaluate FCloudless on AWS, AliYun, and Azure. The experimental results show that FCloudless can detect the underlying performance of serverless platforms hidden in the black box and its optimization algorithm can select the optimal scheduling strategy for various applications in a jointcloud environment. FCloudless reduces the runtime by 23.3% and 24.7% for cold and warm invocations respectively under cost constraints.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124414168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}