AI-driven job scheduling in cloud computing: a comprehensive review

Abstract

The demand for efficient job scheduling in cloud computing has grown significantly with the rise of dynamic and heterogeneous cloud environments. While effective in simpler systems, traditional scheduling algorithms fail to meet the complex requirements of modern cloud infrastructures. These limitations motivate the need for AI-driven solutions that offer adaptability, scalability, and energy efficiency. This paper comprehensively reviews AI-based job scheduling techniques, addressing several key research gaps in current approaches. The existing methods face challenges such as resource heterogeneity, energy consumption, and real-time adaptability in multi-cloud systems. Accordingly, the support of AI-based job scheduling in cloud computing is summarized here toward machine learning, optimization techniques, heuristic techniques, and hybrid AI models. This paper pointedly underlines the strengths and weaknesses of various approaches through deep comparative analysis and focuses on how AI will overcome traditional algorithm shortcomings. Is worth noticing that several important improvements this kind of AI-driven model provides, for example, in resource allocation, cost efficiency, energy consumption, and complex dependencies between jobs and system faults. In the end, AI-driven job scheduling seems to be a promising avenue toward effectively responding to the booming demands of cloud infrastructures. Future research should concentrate on three major outlooks: scalability, better integration of AI with traditional scheduling methods, and the use of other emerging technologies like edge computing and blockchain for better optimization of cloud-based job scheduling. The paper underscores the need for more adaptive, secure, and energy-efficient scheduling frameworks to meet the evolving challenges of cloud environments.