2013 IEEE International Symposium on Workload Characterization (IISWC)最新文献

筛选

英文中文

HcBench: Methodology, development, and characterization of a customer usage representative big data/Hadoop benchmark HcBench:一个具有客户使用代表性的大数据/Hadoop基准的方法论、开发和特征

2013 IEEE International Symposium on Workload Characterization (IISWC) Pub Date : 2013-07-16 DOI: 10.1109/IISWC.2013.6704672

V. Saletore, Karthik Krishnan, Vish Viswanathan, Matthew E. Tolentino

{"title":"HcBench: Methodology, development, and characterization of a customer usage representative big data/Hadoop benchmark","authors":"V. Saletore, Karthik Krishnan, Vish Viswanathan, Matthew E. Tolentino","doi":"10.1109/IISWC.2013.6704672","DOIUrl":"https://doi.org/10.1109/IISWC.2013.6704672","url":null,"abstract":"Big Data analytics using Map-Reduce over Hadoop has become a leading edge paradigm for distributed programming over large server clusters. The Hadoop platform is used extensively for interactive and batch analytics in ecommerce, telecom, media, retail, social networking, and being actively evaluated for use in other areas. However, to date no industry standard or customer representative benchmarks exist to measure and evaluate the true performance of a Hadoop cluster. Current Hadoop micro-benchmarks such as HiBench-2, GridMix-3, Terasort, etc. are narrow functional slices of applications that customers run to evaluate their Hadoop clusters. However, these benchmarks fail to capture the real usages and performance in a datacenter environment. Given that typical datacenter deployments of Hadoop process a wide variety of analytic interactive and query jobs in addition to batch transform jobs under strict Service Level Agreement (SLA) requirements, performance benchmarks used to evaluate clusters must capture the effects of concurrently running such diverse job types in production environments. In this paper, we present the methodology and the development of a customer datacenter usage representative Hadoop benchmark \"HcBench\" which includes a mix of large number of customer representative interactive, query, machine learning, and transform jobs, a variety of data sizes, and includes compute, storage 110, and network intensive jobs, with inter-job arrival times as in a typical datacenter environment. We present the details of this benchmark and discuss application level, server and cluster level performance characterization collected on an Intel Sandy Bridge Xeon Processor Hadoop cluster.","PeriodicalId":365868,"journal":{"name":"2013 IEEE International Symposium on Workload Characterization (IISWC)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2013-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131970225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 14

Front al 前阿尔

2013 IEEE International Symposium on Workload Characterization (IISWC) Pub Date : 1900-01-01 DOI: 10.1109/sispad.2015.7292242

引用次数: 0

首页上一页