Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)最新文献_第4页

Exploiting Lustre File Joining for Effective Collective IO 利用光泽文件连接实现有效的集体IO

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.51

Weikuan Yu, J. Vetter, S. Canon, Song Jiang

{"title":"Exploiting Lustre File Joining for Effective Collective IO","authors":"Weikuan Yu, J. Vetter, S. Canon, Song Jiang","doi":"10.1109/CCGRID.2007.51","DOIUrl":"https://doi.org/10.1109/CCGRID.2007.51","url":null,"abstract":"Lustre is a parallel file system that presents high aggregated IO bandwidth by striping file extents across many storage devices. However, our experiments indicate excessively wide striping can cause performance degradation. Lustre supports an innovative file joining feature that joins files in place. To mitigate striping overhead and benefit collective IO, we propose two techniques: split writing and hierarchical striping. In split writing, a file is created as separate subfiles, each of which is striped to only a few storage devices. They are joined as a single file at the file close time. Hierarchical striping builds on top of split writing and orchestrates the span of subfiles in a hierarchical manner to avoid overlapping and achieve the appropriate coverage of storage devices. Together, these techniques can avoid the overhead associated with large stripe width, while still being able to combine bandwidth available from many storage devices. We have prototyped these techniques in the ROMIO implementation of MPI-IO. Experimental results indicate that split writing and hierarchical striping can significantly improve the performance of Lustre collective IO in terms of both data transfer and management operations. On a Lustre file system configured with 46 object storage targets, our implementation improves collective write performance of a 16-process job by as much as 220%.","PeriodicalId":278535,"journal":{"name":"Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114891699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 93

Bridging the High Performance Computing Gap: the OurGrid Experience 弥合高性能计算差距:OurGrid体验

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.28

F. Brasileiro, E. Araújo, W. Voorsluys, Milena P. M. Oliveira, F. Figueiredo

引用次数: 44

Build-and-Test Workloads for Grid Middleware: Problem, Analysis, and Applications 网格中间件的构建和测试工作负载:问题、分析和应用

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.29

A. Iosup, D. Epema

{"title":"Build-and-Test Workloads for Grid Middleware: Problem, Analysis, and Applications","authors":"A. Iosup, D. Epema","doi":"10.1109/CCGRID.2007.29","DOIUrl":"https://doi.org/10.1109/CCGRID.2007.29","url":null,"abstract":"The Grid promise is starting to materialize today: large- scale multi-site infrastructures have grown to assist the work of scientists from all around the world. This tremendous growth can be sustained and continued only through a higher quality of the middleware, in terms of deployability and of correct functionality. A potential solution to this problem is the adoption of industry practices regarding middleware building and testing. However, it is unclear what good build-and-test environments for grid middleware should look like, and how to use them efficiently. In this work we address both these problems. First, we study the characteristics of the NMI build-and-test environment, which handles millions of testing tasks annually, for major Grid middleware such as Condor, Globus, VDT, and gLite. Through the analysis of a system-wide trace covering the past two years we find the main characteristics of the workload, as well as the performance of the system under load. Second, we propose mechanisms for more efficient test management and operation, and for resource provisioning and evaluation. Notably, we propose a generic test optimization technique that reduces the test time by 95%, while achieving 93% of the maximum accuracy, under real conditions.","PeriodicalId":278535,"journal":{"name":"Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127766481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

Workflow Management in a Protein Clustering Application 蛋白质集群应用中的工作流管理

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.122

J. L. Vázquez-Poletti, E. Huedo, R. Montero, I. Llorente

引用次数: 6

Parameter Sweeps for Functional MRI Research in the "Virtual Laboratory for e-Science" Project “电子科学虚拟实验室”项目中功能MRI研究的参数扫描

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.82

S. Olabarriaga, A. Nederveen, B. O. Nualláin

{"title":"Parameter Sweeps for Functional MRI Research in the \"Virtual Laboratory for e-Science\" Project","authors":"S. Olabarriaga, A. Nederveen, B. O. Nualláin","doi":"10.1109/CCGRID.2007.82","DOIUrl":"https://doi.org/10.1109/CCGRID.2007.82","url":null,"abstract":"Image analysis is an important component of neuroscience research. The ICT infrastructure and technical knowledge needed to perform (large scale) neuroimaging studies, however, is often not available to the neuroscientists. The \"virtual laboratory for e-sciences\" project provides an advanced (grid) infrastructure offering data and computing services to researchers from several application domains. In this paper we describe how this infrastructure is used in the context of functional magnetic resonance imaging (MRI) research, which is devoted to the study of brain activity due to stimulation. Our experience in using a generic application (Nimrod, Monash University, Australia) to manage large parameter sweep experiments is presented. These experiments were performed to investigate the effect of one parameter (delay in the hemodynamic response function) in the analysis result, but also to evaluate the available infrastructure (grid resources and experiment management services). Initial results indicate that it is feasible and simple to perform large image analysis experiments using Nimrod once the environment has been properly prepared.","PeriodicalId":278535,"journal":{"name":"Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128436992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

Collective Interfaces for Distributed Components 分布式组件的集合接口

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.32

F. Baude, D. Caromel, L. Henrio, M. Morel

引用次数: 29

Intelligent Scheduling and Replication in Datagrids: a Synergistic Approach 数据网格中的智能调度和复制:一种协同方法

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.65

Ali Elghirani, Riky Subrata, Albert Y. Zomaya

{"title":"Intelligent Scheduling and Replication in Datagrids: a Synergistic Approach","authors":"Ali Elghirani, Riky Subrata, Albert Y. Zomaya","doi":"10.1109/CCGRID.2007.65","DOIUrl":"https://doi.org/10.1109/CCGRID.2007.65","url":null,"abstract":"In large-scale data-intensive applications data plays a pivotal role in the execution of these applications, and data transfer is the primary cause of job execution delay. In environments such as the data grids with the need to execute jobs requiring large amounts of data, a smart collaborative environment between the scheduling and data management services to achieve a synergistic effect on the performance of the grid becomes essential. This paper presents an intelligent data grid framework where job scheduling and data and replica management are coupled to provide an integrated environment for efficient access to data and job scheduling. The data management service predicts and estimates the appropriate locations of replica and proactively replicates the datasets in these locations while the intelligent Tabu Search based scheduler incorporating information about the datasets dispatches the jobs to the sites guaranteeing minimum job execution time and better overall system utilization. Evaluation of the framework shows significant improvement in the performance of the grid and job execution time.","PeriodicalId":278535,"journal":{"name":"Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)","volume":"133 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127307291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 31

Online Analysis and Runtime Steering of Dynamic Workflows in the ASKALON Grid Environment ASKALON网格环境中动态工作流的在线分析和运行时控制

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.76

R. Prodan

引用次数: 6

PACE: Augmenting Personal Mobile Devices with Scalable Computing PACE:用可扩展计算增强个人移动设备

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.81

Xun Luo

引用次数: 4

A Service-Oriented System to Support Data Integration on Data Grids 支持数据网格上数据集成的面向服务系统

Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07) Pub Date : 2007-05-14 DOI: 10.1109/CCGRID.2007.12

A. Gounaris, C. Comito, R. Sakellariou, D. Talia

引用次数: 19