HDFSbench:了解云文件系统的效率和瓶颈

2012 7th Open Cirrus Summit Pub Date : 2012-06-19 DOI:10.1109/OCS.2012.31

J. Dai, T. Xie, Shengsheng Huang, Jie Huang

{"title":"HDFSbench:了解云文件系统的效率和瓶颈","authors":"J. Dai, T. Xie, Shengsheng Huang, Jie Huang","doi":"10.1109/OCS.2012.31","DOIUrl":null,"url":null,"abstract":"We have conducted intensive experiments on an in-house Hadoop cluster using HDFSbench (a file system benchmark tool we build for HDFS). Our experimental results provide valuable insights into the performance characteristics (e.g., general efficiency and potential bottlenecks) of cloud file systems for different application usages (e.g., MapReduce and Bigtable access patterns), and on how these traits change with new storage technologies (e.g., SSD vs. HDD).","PeriodicalId":244833,"journal":{"name":"2012 7th Open Cirrus Summit","volume":"77 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"HDFSbench: Understanding the Efficiency and Bottlenecks of Cloud File Systems\",\"authors\":\"J. Dai, T. Xie, Shengsheng Huang, Jie Huang\",\"doi\":\"10.1109/OCS.2012.31\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We have conducted intensive experiments on an in-house Hadoop cluster using HDFSbench (a file system benchmark tool we build for HDFS). Our experimental results provide valuable insights into the performance characteristics (e.g., general efficiency and potential bottlenecks) of cloud file systems for different application usages (e.g., MapReduce and Bigtable access patterns), and on how these traits change with new storage technologies (e.g., SSD vs. HDD).\",\"PeriodicalId\":244833,\"journal\":{\"name\":\"2012 7th Open Cirrus Summit\",\"volume\":\"77 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2012-06-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2012 7th Open Cirrus Summit\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/OCS.2012.31\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 7th Open Cirrus Summit","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/OCS.2012.31","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

摘要

我们在内部Hadoop集群上使用HDFSbench(我们为HDFS构建的文件系统基准工具)进行了密集的实验。我们的实验结果为不同应用程序使用(例如，MapReduce和Bigtable访问模式)的云文件系统的性能特征(例如，一般效率和潜在瓶颈)以及这些特征如何随着新的存储技术(例如，SSD与HDD)而变化提供了有价值的见解。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

HDFSbench: Understanding the Efficiency and Bottlenecks of Cloud File Systems

We have conducted intensive experiments on an in-house Hadoop cluster using HDFSbench (a file system benchmark tool we build for HDFS). Our experimental results provide valuable insights into the performance characteristics (e.g., general efficiency and potential bottlenecks) of cloud file systems for different application usages (e.g., MapReduce and Bigtable access patterns), and on how these traits change with new storage technologies (e.g., SSD vs. HDD).

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2012 7th Open Cirrus Summit

自引率

0.00%

发文量