混合云中基于QoS的MapReduce任务优化调度算法

XiJun Mao, Chunlin Li, Wei Yan, Shumeng Du
{"title":"混合云中基于QoS的MapReduce任务优化调度算法","authors":"XiJun Mao, Chunlin Li, Wei Yan, Shumeng Du","doi":"10.1109/PDCAT.2016.038","DOIUrl":null,"url":null,"abstract":"Research on MapReduce tasks scheduling method for the hybrid cloud environment to meet QoS is of great significance. Considering that traditional scheduling algorithms cannot fully maximize efficiency of the private cloud and minimize costs under the public cloud, this paper proposes a MapReduce task optimal scheduling algorithm named MROSA to meet deadline and cost constraints. Private cloud scheduling improves the Max-Min strategy, reducing job execution time. The algorithm improves the resource utilization of the private cloud and the QoS satisfaction. In order to minimize the public cloud cost, public cloud scheduling based on cost optimization selects the best public cloud resources according to the deadline. Experimental results show that the proposed algorithm in this paper has less job execution time, higher QoS satisfaction than the Fair scheduler and FIFO scheduler. It also has more cost savings and shorter job completion time than recent similar studies.","PeriodicalId":203925,"journal":{"name":"2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":"{\"title\":\"Optimal Scheduling Algorithm of MapReduce Tasks Based on QoS in the Hybrid Cloud\",\"authors\":\"XiJun Mao, Chunlin Li, Wei Yan, Shumeng Du\",\"doi\":\"10.1109/PDCAT.2016.038\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Research on MapReduce tasks scheduling method for the hybrid cloud environment to meet QoS is of great significance. Considering that traditional scheduling algorithms cannot fully maximize efficiency of the private cloud and minimize costs under the public cloud, this paper proposes a MapReduce task optimal scheduling algorithm named MROSA to meet deadline and cost constraints. Private cloud scheduling improves the Max-Min strategy, reducing job execution time. The algorithm improves the resource utilization of the private cloud and the QoS satisfaction. In order to minimize the public cloud cost, public cloud scheduling based on cost optimization selects the best public cloud resources according to the deadline. Experimental results show that the proposed algorithm in this paper has less job execution time, higher QoS satisfaction than the Fair scheduler and FIFO scheduler. It also has more cost savings and shorter job completion time than recent similar studies.\",\"PeriodicalId\":203925,\"journal\":{\"name\":\"2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)\",\"volume\":\"38 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"12\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/PDCAT.2016.038\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PDCAT.2016.038","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12

摘要

研究MapReduce任务调度方法对混合云环境下满足QoS要求具有重要意义。针对传统调度算法在公有云下无法充分实现私有云效率最大化和成本最小化的问题,本文提出了一种MapReduce任务最优调度算法MROSA,以满足工期和成本约束。私有云调度改进了Max-Min策略,减少了作业的执行时间。该算法提高了私有云的资源利用率和服务质量满意度。为了使公有云成本最小化,基于成本优化的公有云调度根据期限选择最优的公有云资源。实验结果表明,该算法比Fair调度程序和FIFO调度程序具有更短的作业执行时间和更高的QoS满意度。与最近的类似研究相比,它还节省了更多的成本,缩短了工作完成时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Optimal Scheduling Algorithm of MapReduce Tasks Based on QoS in the Hybrid Cloud
Research on MapReduce tasks scheduling method for the hybrid cloud environment to meet QoS is of great significance. Considering that traditional scheduling algorithms cannot fully maximize efficiency of the private cloud and minimize costs under the public cloud, this paper proposes a MapReduce task optimal scheduling algorithm named MROSA to meet deadline and cost constraints. Private cloud scheduling improves the Max-Min strategy, reducing job execution time. The algorithm improves the resource utilization of the private cloud and the QoS satisfaction. In order to minimize the public cloud cost, public cloud scheduling based on cost optimization selects the best public cloud resources according to the deadline. Experimental results show that the proposed algorithm in this paper has less job execution time, higher QoS satisfaction than the Fair scheduler and FIFO scheduler. It also has more cost savings and shorter job completion time than recent similar studies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信