ZoneFS: Stripe remodeling in cloud data centers

2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST) Pub Date : 2011-05-23 DOI:10.1109/MSST.2011.5937223

Lanyue Lu, Dean Hildebrand, Renu Tewari

{"title":"ZoneFS: Stripe remodeling in cloud data centers","authors":"Lanyue Lu, Dean Hildebrand, Renu Tewari","doi":"10.1109/MSST.2011.5937223","DOIUrl":null,"url":null,"abstract":"Cloud data centers will contain tens of thousands of servers with massive aggregate bandwidth requirements for generating, accessing, and analyzing immense amounts of data. The I/O requirements of the myriad applications that these data centers must support run the gamut from extreme IOPS intensive to extreme bandwidth intensive. Delivering high performance with unreliable commodity hardware for this range of workloads is truly a grand challenge. ZoneFS is a parallel file system that targets cloud data center infrastructures built up of commodity network switches. ZoneFS employs a highly-available and flexible storage architecture that divides a cluster switch hierarchy into zones and stripes data across servers and disks to maximize aggregate I/O throughput and avoid storage server hotspots. In this paper, we present the overall design and implementation of ZoneFS and evaluate its key features with several cloud computing workloads. Our experimental results show that ZoneFS can improve application runtime performance by up to 76% over standard parallel file systems and by up to 85% over Internet-scale file systems.","PeriodicalId":136636,"journal":{"name":"2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST)","volume":"110 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MSST.2011.5937223","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

Cloud data centers will contain tens of thousands of servers with massive aggregate bandwidth requirements for generating, accessing, and analyzing immense amounts of data. The I/O requirements of the myriad applications that these data centers must support run the gamut from extreme IOPS intensive to extreme bandwidth intensive. Delivering high performance with unreliable commodity hardware for this range of workloads is truly a grand challenge. ZoneFS is a parallel file system that targets cloud data center infrastructures built up of commodity network switches. ZoneFS employs a highly-available and flexible storage architecture that divides a cluster switch hierarchy into zones and stripes data across servers and disks to maximize aggregate I/O throughput and avoid storage server hotspots. In this paper, we present the overall design and implementation of ZoneFS and evaluate its key features with several cloud computing workloads. Our experimental results show that ZoneFS can improve application runtime performance by up to 76% over standard parallel file systems and by up to 85% over Internet-scale file systems.

查看原文本刊更多论文

ZoneFS:云数据中心中的条纹重塑

云数据中心将包含数以万计的服务器，它们需要大量的聚合带宽来生成、访问和分析大量的数据。这些数据中心必须支持的无数应用程序的I/O需求从极端的IOPS密集型到极端的带宽密集型不等。在这种工作负载范围内，使用不可靠的商用硬件交付高性能确实是一个巨大的挑战。ZoneFS是一个并行文件系统，目标是建立在商品网络交换机上的云数据中心基础设施。ZoneFS采用高可用性和灵活的存储架构，将集群交换机层次结构划分为服务器和磁盘之间的区域和条带，以最大限度地提高总I/O吞吐量并避免存储服务器热点。在本文中，我们介绍了ZoneFS的总体设计和实现，并在几种云计算工作负载下评估了其关键特性。我们的实验结果表明，ZoneFS可以将应用程序运行时性能比标准并行文件系统提高76%，比internet规模的文件系统提高85%。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST)

自引率

0.00%

发文量