Job Scheduling Strategies for Parallel Processing最新文献

RARE: Renewable Energy Aware Resource Management in Datacenters 稀有:数据中心的可再生能源意识资源管理

Job Scheduling Strategies for Parallel Processing Pub Date : 2022-11-10 DOI: 10.48550/arXiv.2211.05346

V. Venkataswamy, J. Grigsby, A. Grimshaw, Yanjun Qi

{"title":"RARE: Renewable Energy Aware Resource Management in Datacenters","authors":"V. Venkataswamy, J. Grigsby, A. Grimshaw, Yanjun Qi","doi":"10.48550/arXiv.2211.05346","DOIUrl":"https://doi.org/10.48550/arXiv.2211.05346","url":null,"abstract":"The exponential growth in demand for digital services drives massive datacenter energy consumption and negative environmental impacts. Promoting sustainable solutions to pressing energy and digital infrastructure challenges is crucial. Several hyperscale cloud providers have announced plans to power their datacenters using renewable energy. However, integrating renewables to power the datacenters is challenging because the power generation is intermittent, necessitating approaches to tackle power supply variability. Hand engineering domain-specific heuristics-based schedulers to meet specific objective functions in such complex dynamic green datacenter environments is time-consuming, expensive, and requires extensive tuning by domain experts. The green datacenters need smart systems and system software to employ multiple renewable energy sources (wind and solar) by intelligently adapting computing to renewable energy generation. We present RARE (Renewable energy Aware REsource management), a Deep Reinforcement Learning (DRL) job scheduler that automatically learns effective job scheduling policies while continually adapting to datacenters' complex dynamic environment. The resulting DRL scheduler performs better than heuristic scheduling policies with different workloads and adapts to the intermittent power supply from renewables. We demonstrate DRL scheduler system design parameters that, when tuned correctly, produce better performance. Finally, we demonstrate that the DRL scheduler can learn from and improve upon existing heuristic policies using Offline Learning.","PeriodicalId":229341,"journal":{"name":"Job Scheduling Strategies for Parallel Processing","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134376074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Improving Resource Isolation of Critical Tasks in a Workload 提高工作负载中关键任务的资源隔离

Job Scheduling Strategies for Parallel Processing Pub Date : 2020-05-22 DOI: 10.1007/978-3-030-63171-0_3

Meghana Thiyyakat, Subramaniam Kalambur, D. Sitaram

引用次数: 5

PDAWL: Profile-Based Iterative Dynamic Adaptive WorkLoad Balance on Heterogeneous Architectures 异构架构上基于概要文件的迭代动态自适应工作负载平衡

Job Scheduling Strategies for Parallel Processing Pub Date : 2020-05-22 DOI: 10.1007/978-3-030-63171-0_8

Tongsheng Geng, Marcos Amarís, Stéphane Zuckerman, A. Goldman, G. Gao, J. Gaudiot

引用次数: 5

Analysis of Job Metadata for Enhanced Wall Time Prediction 增强壁时预测的作业元数据分析

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_1

Mehmet Soysal, M. Berghoff, A. Streit

引用次数: 10

Stochastic Programming Approach for Resource Selection Under Demand Uncertainty 需求不确定性下资源选择的随机规划方法

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_6

T. H. Bhuiyan, M. Halappanavar, Ryan D. Friese, Hugh R. Medal, L. D. L. Torre, A. Sathanur, Nathan R. Tallent

引用次数: 1

Evaluating the Impact of Soft Walltimes on Job Scheduling Performance 评估软挂时间对作业调度性能的影响

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_2

D. Klusácek, Václav Chlumský

引用次数: 13

Reducing the Human-in-the-Loop Component of the Scheduling of Large HTC Workloads 减少大型HTC工作负载调度中的人在环组件

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_3

Frédéric Azevedo, Lucas Gombert, F. Suter

引用次数: 2

Approaching Actor-Level Resource Control for Akka 接近行动者级别的Akka资源控制

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_7

A. Abdelmoamen, Dezhong Wang, Nadeem Jamali

引用次数: 9

Adaptive Simultaneous Multi-tenancy for GPUs gpu自适应同步多租户

Job Scheduling Strategies for Parallel Processing Pub Date : 2018-05-25 DOI: 10.1007/978-3-030-10632-4_5

Ramin Bashizade, Yuxuan Li, A. Lebeck

引用次数: 1

Experience and Practice of Batch Scheduling on Leadership Supercomputers at Argonne 阿贡领导超级计算机批量调度的经验与实践

Job Scheduling Strategies for Parallel Processing Pub Date : 2017-06-02 DOI: 10.1007/978-3-319-77398-8_1

W. Allcock, P. Rich, Yuping Fan, Z. Lan

引用次数: 24