MPICH-G-DM: An Enhanced MPICH-G with Supporting Dynamic Job Migration

2009 Fourth ChinaGrid Annual Conference Pub Date : 2009-08-21 DOI:10.1109/ChinaGrid.2009.9

Xiaohui Wei, Hongliang Li, Dexiong Li

{"title":"MPICH-G-DM: An Enhanced MPICH-G with Supporting Dynamic Job Migration","authors":"Xiaohui Wei, Hongliang Li, Dexiong Li","doi":"10.1109/ChinaGrid.2009.9","DOIUrl":null,"url":null,"abstract":"Grid is attracting more and more attentions by its massive computational capacity. Tools like Globus Toolkit and MPICH-G2 have been developed to help scientists to facilitate their researches. As a Grid-enabled implementation of MPI, MPICH-G2 helps developers to port parallel applications to cross-domain environment. Since the current computationally-intensive parallel applications, especially long-running tasks, require high availability as well as high performance computing platform, dynamic job migration in Grid environment has became an essential issue. In this study, we present a dynamic job migration enabled MPICH-G2 version, MPICH-G-DM. We use Virtual Job Model (VJM) to reserve resources for the migrating jobs in advance to improve the efficiency of the system. An Asynchronous Migration Protocol (AMP) is proposed to enable the migrating sub jobs to checkpoint/restart and update their new addresses concurrently without a global synchronization. In order to reduce the communicating overhead of job migration, MPICH-G-DM minimized the number of control messages among domains to O(N). Experiment results show that MPICH-G-DM is effective and reliable.","PeriodicalId":212445,"journal":{"name":"2009 Fourth ChinaGrid Annual Conference","volume":"64 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2009-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2009 Fourth ChinaGrid Annual Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ChinaGrid.2009.9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 3

Abstract

Grid is attracting more and more attentions by its massive computational capacity. Tools like Globus Toolkit and MPICH-G2 have been developed to help scientists to facilitate their researches. As a Grid-enabled implementation of MPI, MPICH-G2 helps developers to port parallel applications to cross-domain environment. Since the current computationally-intensive parallel applications, especially long-running tasks, require high availability as well as high performance computing platform, dynamic job migration in Grid environment has became an essential issue. In this study, we present a dynamic job migration enabled MPICH-G2 version, MPICH-G-DM. We use Virtual Job Model (VJM) to reserve resources for the migrating jobs in advance to improve the efficiency of the system. An Asynchronous Migration Protocol (AMP) is proposed to enable the migrating sub jobs to checkpoint/restart and update their new addresses concurrently without a global synchronization. In order to reduce the communicating overhead of job migration, MPICH-G-DM minimized the number of control messages among domains to O(N). Experiment results show that MPICH-G-DM is effective and reliable.

查看原文本刊更多论文

MPICH-G- dm:支持动态任务迁移的增强型MPICH-G

网格以其巨大的计算能力受到越来越多的关注。像Globus Toolkit和MPICH-G2这样的工具已经被开发出来，以帮助科学家促进他们的研究。作为一种支持网格的MPI实现，MPICH-G2帮助开发人员将并行应用程序移植到跨域环境中。由于当前计算密集型的并行应用程序，特别是长时间运行的任务，需要高可用性和高性能的计算平台，网格环境下的动态作业迁移已经成为一个必不可少的问题。在这项研究中，我们提出了一个支持动态作业迁移的MPICH-G2版本，即MPICH-G-DM。利用虚拟作业模型(Virtual Job Model, VJM)为迁移作业提前预留资源，提高系统的运行效率。提出了一种异步迁移协议(AMP)，使迁移子作业能够同时进行检查点/重新启动并更新其新地址，而无需全局同步。为了减少作业迁移的通信开销，MPICH-G-DM将域间控制消息的数量减至0 (N)。实验结果表明，MPICH-G-DM算法是有效可靠的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

2009 Fourth ChinaGrid Annual Conference

自引率

0.00%

发文量