一种基于q -学习的云雾计算任务前瞻性调度的有效方法

IF 8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Yan Jin
{"title":"一种基于q -学习的云雾计算任务前瞻性调度的有效方法","authors":"Yan Jin","doi":"10.1016/j.engappai.2025.110705","DOIUrl":null,"url":null,"abstract":"<div><div>The increasing energy consumption in cloud computing data centers has become a significant concern due to the expanding scale of computational demands. Efficient task scheduling is crucial to optimizing resource utilization while reducing operational costs and energy consumption. This study proposes a <strong>M</strong>ulti-<strong>A</strong>gent <strong>R</strong>einforcement <strong>L</strong>earning (MARL)-based scheduling framework that enhances system efficiency by dynamically allocating tasks based on environmental variations and workload fluctuations. Unlike conventional methods, MARL allows multiple intelligent agents to collaboratively optimize scheduling decisions, leading to superior adaptability and performance. The proposed approach consists of two steps: first, a centralized task dispatcher assigns incoming tasks to cloud servers using a queuing model. Second, an MARL-based scheduler on each server prioritizes and allocates tasks to virtual machines while continuously updating scheduling policies to maximize efficiency. The framework is evaluated using a CloudSim-based simulation environment to ensure a realistic and controlled assessment. Experimental results demonstrate that the proposed method reduces energy consumption by an average of 51.34 %, improves CPU utilization efficiency, and decreases response time by 44.35 % compared to traditional scheduling techniques, including First In-First Out (FIFO), Greedy, and Queue-based Scheduling (Q-sch). By leveraging MARL, the scheduler effectively minimizes waiting times and optimizes task completion rates, ensuring a balance between energy efficiency and system performance. This work highlights the advantages of reinforcement learning in cloud-fog computing and underscores its potential for intelligent resource management.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"151 ","pages":"Article 110705"},"PeriodicalIF":8.0000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An effective method for prospective scheduling of tasks in cloud-fog computing with an energy consumption management approach based on Q-learning\",\"authors\":\"Yan Jin\",\"doi\":\"10.1016/j.engappai.2025.110705\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The increasing energy consumption in cloud computing data centers has become a significant concern due to the expanding scale of computational demands. Efficient task scheduling is crucial to optimizing resource utilization while reducing operational costs and energy consumption. This study proposes a <strong>M</strong>ulti-<strong>A</strong>gent <strong>R</strong>einforcement <strong>L</strong>earning (MARL)-based scheduling framework that enhances system efficiency by dynamically allocating tasks based on environmental variations and workload fluctuations. Unlike conventional methods, MARL allows multiple intelligent agents to collaboratively optimize scheduling decisions, leading to superior adaptability and performance. The proposed approach consists of two steps: first, a centralized task dispatcher assigns incoming tasks to cloud servers using a queuing model. Second, an MARL-based scheduler on each server prioritizes and allocates tasks to virtual machines while continuously updating scheduling policies to maximize efficiency. The framework is evaluated using a CloudSim-based simulation environment to ensure a realistic and controlled assessment. Experimental results demonstrate that the proposed method reduces energy consumption by an average of 51.34 %, improves CPU utilization efficiency, and decreases response time by 44.35 % compared to traditional scheduling techniques, including First In-First Out (FIFO), Greedy, and Queue-based Scheduling (Q-sch). By leveraging MARL, the scheduler effectively minimizes waiting times and optimizes task completion rates, ensuring a balance between energy efficiency and system performance. This work highlights the advantages of reinforcement learning in cloud-fog computing and underscores its potential for intelligent resource management.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"151 \",\"pages\":\"Article 110705\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625007055\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625007055","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

随着计算需求规模的不断扩大,云计算数据中心日益增加的能源消耗已经成为一个值得关注的问题。高效的任务调度对于优化资源利用,同时降低运营成本和能源消耗至关重要。本研究提出了一种基于多智能体强化学习(MARL)的调度框架,通过根据环境变化和工作负载波动动态分配任务来提高系统效率。与传统方法不同,MARL允许多个智能代理协作优化调度决策,从而实现卓越的适应性和性能。提出的方法包括两个步骤:首先,集中式任务调度程序使用排队模型将传入的任务分配给云服务器。其次,每个服务器上基于marl的调度器对任务进行优先级排序并将其分配给虚拟机,同时不断更新调度策略以最大化效率。该框架使用基于cloudsim的仿真环境进行评估,以确保进行真实和可控的评估。实验结果表明,与先进先出(FIFO)、贪婪调度(Greedy -based scheduling, Q-sch)等传统调度技术相比,该方法平均降低了51.34%的能耗,提高了CPU利用率,缩短了44.35%的响应时间。通过利用MARL,调度程序有效地减少了等待时间并优化了任务完成率,确保了能源效率和系统性能之间的平衡。这项工作强调了强化学习在云雾计算中的优势,并强调了其在智能资源管理方面的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An effective method for prospective scheduling of tasks in cloud-fog computing with an energy consumption management approach based on Q-learning
The increasing energy consumption in cloud computing data centers has become a significant concern due to the expanding scale of computational demands. Efficient task scheduling is crucial to optimizing resource utilization while reducing operational costs and energy consumption. This study proposes a Multi-Agent Reinforcement Learning (MARL)-based scheduling framework that enhances system efficiency by dynamically allocating tasks based on environmental variations and workload fluctuations. Unlike conventional methods, MARL allows multiple intelligent agents to collaboratively optimize scheduling decisions, leading to superior adaptability and performance. The proposed approach consists of two steps: first, a centralized task dispatcher assigns incoming tasks to cloud servers using a queuing model. Second, an MARL-based scheduler on each server prioritizes and allocates tasks to virtual machines while continuously updating scheduling policies to maximize efficiency. The framework is evaluated using a CloudSim-based simulation environment to ensure a realistic and controlled assessment. Experimental results demonstrate that the proposed method reduces energy consumption by an average of 51.34 %, improves CPU utilization efficiency, and decreases response time by 44.35 % compared to traditional scheduling techniques, including First In-First Out (FIFO), Greedy, and Queue-based Scheduling (Q-sch). By leveraging MARL, the scheduler effectively minimizes waiting times and optimizes task completion rates, ensuring a balance between energy efficiency and system performance. This work highlights the advantages of reinforcement learning in cloud-fog computing and underscores its potential for intelligent resource management.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信