Optimization Strategies for Data Placement in Satellite Cloud-oriented Distributed File Systems

Ying Zhang, Tianyu Wo, Kun Fan, Tianyu Ye, Jiwei Zhang, Junhua Zhang, Xiao Feng
{"title":"Optimization Strategies for Data Placement in Satellite Cloud-oriented Distributed File Systems","authors":"Ying Zhang, Tianyu Wo, Kun Fan, Tianyu Ye, Jiwei Zhang, Junhua Zhang, Xiao Feng","doi":"10.1109/JCC59055.2023.00016","DOIUrl":null,"url":null,"abstract":"Forming a collaborative computing network among the deployed satellites in space can process data rapidly and reduce data transmission delay by leveraging the communication, storage, and computing capacities of the satellites. Due to the dynamics of satellite orbits, the distance between satellites varies over time, bringing new challenges to the designing of dedicated distributed file systems for collaborative satellites. Traditional distributed file systems did not consider the network topology and dynamics of satellite clouds and the limited computing resources of satellite node cores. In view of the torus network topology of satellite clouds, we design a highly available distributed metadata management mechanism for satellite clouds to ensure efficient metadata reading and reliability. On this basis, a topology-aware replica placement strategy is proposed to minimize communication costs and energy consumption for replica placement. Based on the metadata strategy and replica placement strategy mentioned above, we design and implement a distributed file system for satellite clouds. Experimental results demonstrate that our proposed placement strategy can improve the data transmission performance of the replica placement by more than double compared to the random placement strategy.","PeriodicalId":117254,"journal":{"name":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","volume":"07 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE International Conference on Joint Cloud Computing (JCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/JCC59055.2023.00016","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Forming a collaborative computing network among the deployed satellites in space can process data rapidly and reduce data transmission delay by leveraging the communication, storage, and computing capacities of the satellites. Due to the dynamics of satellite orbits, the distance between satellites varies over time, bringing new challenges to the designing of dedicated distributed file systems for collaborative satellites. Traditional distributed file systems did not consider the network topology and dynamics of satellite clouds and the limited computing resources of satellite node cores. In view of the torus network topology of satellite clouds, we design a highly available distributed metadata management mechanism for satellite clouds to ensure efficient metadata reading and reliability. On this basis, a topology-aware replica placement strategy is proposed to minimize communication costs and energy consumption for replica placement. Based on the metadata strategy and replica placement strategy mentioned above, we design and implement a distributed file system for satellite clouds. Experimental results demonstrate that our proposed placement strategy can improve the data transmission performance of the replica placement by more than double compared to the random placement strategy.
面向卫星云的分布式文件系统中数据放置的优化策略
在空间部署的卫星之间形成协同计算网络,可以利用卫星的通信、存储和计算能力,快速处理数据,减少数据传输延迟。由于卫星轨道的动态性,卫星之间的距离随时间的变化而变化,这给协同卫星专用分布式文件系统的设计带来了新的挑战。传统的分布式文件系统没有考虑卫星云的网络拓扑结构和动态特性,也没有考虑卫星节点核有限的计算资源。针对卫星云的环面网络拓扑结构,设计了一种高可用的分布式卫星云元数据管理机制,保证了卫星云元数据的高效读取和可靠性。在此基础上,提出了一种拓扑感知的副本放置策略,以最小化副本放置的通信成本和能耗。基于上述元数据策略和副本放置策略,我们设计并实现了一个面向卫星云的分布式文件系统。实验结果表明,与随机放置策略相比,我们提出的放置策略可以将副本放置的数据传输性能提高一倍以上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书