Coordinated and Hindsight Resources Allocation in Distributed Computing

Abstract

In this work, we consider heuristic algorithms for parallel jobs execution and efficient resources allocation in heterogeneous computing environments. Existing modern job-flow execution features and realities impose many restrictions for the resources allocation procedures. Emerging virtual organizations and incorporated economic scheduling models allow users and resource owners to compete for suitable allocations based on market principles and fair scheduling policies. Subject to these features a special dynamic programming scheme is proposed to select resources depending on how they fit a particular job execution duration. Hindsight approach makes it possible to select between several different scenarios obtained with the same base scheduling procedure. Based on a conservative backfilling scheduling procedure we study how different resources allocation heuristics affect integral job-flow scheduling characteristics in a dedicated simulation environment.