超越WLCG网格上的批处理计算

2011 IEEE/ACM 12th International Conference on Grid Computing Pub Date : 2011-09-21 DOI:10.1109/Grid.2011.34

M. Meoni

{"title":"超越WLCG网格上的批处理计算","authors":"M. Meoni","doi":"10.1109/Grid.2011.34","DOIUrl":null,"url":null,"abstract":"The traditional use of Grid computing consists in submitting batch jobs and waiting for results to be produced, without any prediction of the time at which a job will be effectively started at a selected site. This paper aims at widening the use of Grid technology for enabling a private virtual cluster on the WLCG Grid and running one's favorite software. We term such a system iGrid, interactive Grid, since a user can then \"interact\" with Grid nodes right away. In addition, the Fairy CPU fairs hare mechanism allows users to get their fair iGrid machine share over a long period. We highlight important principles for introducing interactive capability to the Grid. We present a functioning prototype of iGrid running PROOF - a software for data intensive parallel computing - on top of it. Our prototype implementation scales to all 400 nodes we were granted. The experiment shows the performance of PROOF on iGrid sites and challenges many aspect of dynamic resource allocation and remote data processing. We identify bottlenecks that inhibit interactivity and outline opportunities and limitations for running interactive Grid-distributed HEP applications on the Grid.","PeriodicalId":308086,"journal":{"name":"2011 IEEE/ACM 12th International Conference on Grid Computing","volume":"74 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Beyond Batch Computing on the WLCG Grid\",\"authors\":\"M. Meoni\",\"doi\":\"10.1109/Grid.2011.34\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The traditional use of Grid computing consists in submitting batch jobs and waiting for results to be produced, without any prediction of the time at which a job will be effectively started at a selected site. This paper aims at widening the use of Grid technology for enabling a private virtual cluster on the WLCG Grid and running one's favorite software. We term such a system iGrid, interactive Grid, since a user can then \\\"interact\\\" with Grid nodes right away. In addition, the Fairy CPU fairs hare mechanism allows users to get their fair iGrid machine share over a long period. We highlight important principles for introducing interactive capability to the Grid. We present a functioning prototype of iGrid running PROOF - a software for data intensive parallel computing - on top of it. Our prototype implementation scales to all 400 nodes we were granted. The experiment shows the performance of PROOF on iGrid sites and challenges many aspect of dynamic resource allocation and remote data processing. We identify bottlenecks that inhibit interactivity and outline opportunities and limitations for running interactive Grid-distributed HEP applications on the Grid.\",\"PeriodicalId\":308086,\"journal\":{\"name\":\"2011 IEEE/ACM 12th International Conference on Grid Computing\",\"volume\":\"74 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-09-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2011 IEEE/ACM 12th International Conference on Grid Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/Grid.2011.34\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 IEEE/ACM 12th International Conference on Grid Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/Grid.2011.34","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

摘要

网格计算的传统用途包括提交批作业并等待生成结果，而不预测作业在选定站点上有效启动的时间。本文旨在扩大网格技术的使用范围，以便在WLCG网格上启用私有虚拟集群并运行自己喜欢的软件。我们将这样的系统称为网格，交互式网格，因为用户可以立即与网格节点“交互”。此外，Fairy的CPU公平机制允许用户在很长一段时间内获得公平的网格机器共享。我们强调了向网格引入交互能力的重要原则。在此基础上，我们提出了一个运行PROOF(一种数据密集型并行计算软件)的网格功能原型。我们的原型实现扩展到所有400个节点。实验证明了PROOF在网格站点上的性能，并对动态资源分配和远程数据处理等方面提出了挑战。我们确定了抑制交互性的瓶颈，并概述了在网格上运行交互式网格分布式HEP应用程序的机会和限制。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Beyond Batch Computing on the WLCG Grid

The traditional use of Grid computing consists in submitting batch jobs and waiting for results to be produced, without any prediction of the time at which a job will be effectively started at a selected site. This paper aims at widening the use of Grid technology for enabling a private virtual cluster on the WLCG Grid and running one's favorite software. We term such a system iGrid, interactive Grid, since a user can then "interact" with Grid nodes right away. In addition, the Fairy CPU fairs hare mechanism allows users to get their fair iGrid machine share over a long period. We highlight important principles for introducing interactive capability to the Grid. We present a functioning prototype of iGrid running PROOF - a software for data intensive parallel computing - on top of it. Our prototype implementation scales to all 400 nodes we were granted. The experiment shows the performance of PROOF on iGrid sites and challenges many aspect of dynamic resource allocation and remote data processing. We identify bottlenecks that inhibit interactivity and outline opportunities and limitations for running interactive Grid-distributed HEP applications on the Grid.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2011 IEEE/ACM 12th International Conference on Grid Computing

自引率

0.00%

发文量