HRMF-DRP: A next-generation solution for overcoming provisioning challenges in cloud environments

IF 7.7 2区 计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Devi D, Godfrey Winster S
{"title":"HRMF-DRP: A next-generation solution for overcoming provisioning challenges in cloud environments","authors":"Devi D,&nbsp;Godfrey Winster S","doi":"10.1016/j.jnca.2024.103982","DOIUrl":null,"url":null,"abstract":"<div><p>The cloud computing infrastructure is a distributed environment and the existing research works have some provisioning problems such as suboptimal resource utilization and high execution time. The Heterogeneity Resource Management Framework for Dynamic Resource Provisioning (HRMF-DRP) is proposed for focusing on task scheduling and workload management. This framework incorporates advanced algorithms for dataset preprocessing, task clustering, workload prediction, and dynamic resource provisioning. For data preprocessing, the real-world workload traces were captured from the Planet Lab dataset that are taken as input for the preprocessing stage. The data preprocessing is responsible for ensuring data quality and reliability by using different models like missing data handling, outlier detection and removal as well as standardization and normalization. In this paper, the tasks are grouped into clusters by utilizing Density-Based Spatial Clustering of Applications with Noise (DBSCAN) model and this model categorizes the data points into border points, core points and noise points based on their density. The temporal dependencies are captured for the workload prediction by using Long Short-Term Memory (LSTM) neural network model. A Gaussian Mixture Model (GMM) model is responsible for estimating the number of Virtual machines (VMs) present in the workload prediction process. The Self-Adaptive Genetic Algorithm (SAGA) is implemented for task mapping that adjusts the parameters to change workload patterns for contributing adaptability and robustness. The different experimental evaluations are conducted based on the task completion time, workload balance index, resource utilization efficiency and workload prediction accuracy. The proposed model achieved the workload prediction accuracy of 98.5%, cost of $89.6, execution time of 125ms, Task Completion Time (TCT) of 40ms, Workload Balance Index (WBI) of 0.96 and Resource Utilization Efficiency (RUE) of 0.93. The quantitative results collectively position HRMF-DRP as a practical and efficient solution, promising advancements in dynamic resource provisioning for cloud computing, particularly within the Infrastructure as a Service (IaaS) cloud model.</p></div>","PeriodicalId":54784,"journal":{"name":"Journal of Network and Computer Applications","volume":"231 ","pages":"Article 103982"},"PeriodicalIF":7.7000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Network and Computer Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1084804524001590","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

Abstract

The cloud computing infrastructure is a distributed environment and the existing research works have some provisioning problems such as suboptimal resource utilization and high execution time. The Heterogeneity Resource Management Framework for Dynamic Resource Provisioning (HRMF-DRP) is proposed for focusing on task scheduling and workload management. This framework incorporates advanced algorithms for dataset preprocessing, task clustering, workload prediction, and dynamic resource provisioning. For data preprocessing, the real-world workload traces were captured from the Planet Lab dataset that are taken as input for the preprocessing stage. The data preprocessing is responsible for ensuring data quality and reliability by using different models like missing data handling, outlier detection and removal as well as standardization and normalization. In this paper, the tasks are grouped into clusters by utilizing Density-Based Spatial Clustering of Applications with Noise (DBSCAN) model and this model categorizes the data points into border points, core points and noise points based on their density. The temporal dependencies are captured for the workload prediction by using Long Short-Term Memory (LSTM) neural network model. A Gaussian Mixture Model (GMM) model is responsible for estimating the number of Virtual machines (VMs) present in the workload prediction process. The Self-Adaptive Genetic Algorithm (SAGA) is implemented for task mapping that adjusts the parameters to change workload patterns for contributing adaptability and robustness. The different experimental evaluations are conducted based on the task completion time, workload balance index, resource utilization efficiency and workload prediction accuracy. The proposed model achieved the workload prediction accuracy of 98.5%, cost of $89.6, execution time of 125ms, Task Completion Time (TCT) of 40ms, Workload Balance Index (WBI) of 0.96 and Resource Utilization Efficiency (RUE) of 0.93. The quantitative results collectively position HRMF-DRP as a practical and efficient solution, promising advancements in dynamic resource provisioning for cloud computing, particularly within the Infrastructure as a Service (IaaS) cloud model.

HRMF-DRP:克服云环境中供应挑战的新一代解决方案
云计算基础设施是一种分布式环境,现有的研究工作存在一些资源调配问题,如资源利用率不理想和执行时间过长。为重点解决任务调度和工作量管理问题,提出了动态资源调配的异构资源管理框架(HRMF-DRP)。该框架采用先进的算法进行数据集预处理、任务聚类、工作量预测和动态资源调配。在数据预处理方面,从 Planet Lab 数据集中获取了真实世界的工作负载轨迹,作为预处理阶段的输入。数据预处理负责使用不同的模型确保数据质量和可靠性,如缺失数据处理、离群点检测和移除以及标准化和规范化。本文利用基于密度的带噪声应用空间聚类(DBSCAN)模型将任务分组,该模型根据密度将数据点分为边界点、核心点和噪声点。利用长短期记忆(LSTM)神经网络模型捕捉时间依赖性,进行工作量预测。高斯混杂模型(GMM)负责估算工作量预测过程中出现的虚拟机(VM)数量。自适应遗传算法(SAGA)用于任务映射,可根据工作量模式的变化调整参数,以提高适应性和鲁棒性。根据任务完成时间、工作量平衡指数、资源利用效率和工作量预测准确性进行了不同的实验评估。所提模型的工作量预测准确率为 98.5%,成本为 89.6 美元,执行时间为 125 毫秒,任务完成时间(TCT)为 40 毫秒,工作量平衡指数(WBI)为 0.96,资源利用效率(RUE)为 0.93。这些定量结果共同将 HRMF-DRP 定义为实用高效的解决方案,有望推动云计算动态资源调配的发展,特别是在基础设施即服务(IaaS)云模式中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Network and Computer Applications
Journal of Network and Computer Applications 工程技术-计算机:跨学科应用
CiteScore
21.50
自引率
3.40%
发文量
142
审稿时长
37 days
期刊介绍: The Journal of Network and Computer Applications welcomes research contributions, surveys, and notes in all areas relating to computer networks and applications thereof. Sample topics include new design techniques, interesting or novel applications, components or standards; computer networks with tools such as WWW; emerging standards for internet protocols; Wireless networks; Mobile Computing; emerging computing models such as cloud computing, grid computing; applications of networked systems for remote collaboration and telemedicine, etc. The journal is abstracted and indexed in Scopus, Engineering Index, Web of Science, Science Citation Index Expanded and INSPEC.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信