The Parallel Virtual File System for Commodity Clusters

Proceedings. IEEE International Conference on Cluster Computing Pub Date : 2001-10-08 DOI:10.1109/CLUSTER.2001.10006

W. Ligon, R. Ross

{"title":"The Parallel Virtual File System for Commodity Clusters","authors":"W. Ligon, R. Ross","doi":"10.1109/CLUSTER.2001.10006","DOIUrl":null,"url":null,"abstract":"One benefit of cluster computer architectures is the opportunity for large I/O bandwidths. High performance applications that require significant I/O throughput are increasingly of interest to the clustercomputing community. Parallel file systems are critical system software components that allow parallel applications to take advantage of the parallel I/O disk subsystems in a cluster architecture. The Parallel Virtual File System (PVFS) was the first parallel file system developed specifically for cluster architectures and today is a popular choice for fast disk access. This tutorial introduces the basic concepts behind parallel file systems and specific information about PVFS. The emphasis is on using PVFS to implement effective applications that require substantial I/O performance. Topics include fundamental concepts, PVFS specifics, I/O interfaces including MPI-IO, example applications, performance tuning, and the future of PVFS. Dr. Ligon is an Associate Professor in the Holcombe Department of Electrical and Computer Engineering at Clemson University. His research interests are in high performance computing, focusing on parallel file systems, problem solving environments, and reconfigurable computing. Current projects include the Parallel Virtual File System (PVFS), Clemson Environment for Remote Sensing (CERSe), and the Reconfigurable Computing Application Development Environment (RCADE). Dr. Ross is a postdoctoral researcher in the Mathematics and Computer Science Division at Argonne National Laboratory. His research interests are in message passing and storage systems for high performance computing environments, in particular cluster computing environments. Current projects include the Parallel Virtual File System (PVFS), the ROMIO MPI-IO implementation, and the MPICH implementation of the MPI message passing interface. Proceedings of the 2001 IEEE International Conference on Cluster Computing (CLUSTER01) 0-7695-1116-3/02 $17.00 © 2002 IEEE","PeriodicalId":92128,"journal":{"name":"Proceedings. IEEE International Conference on Cluster Computing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2001-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings. IEEE International Conference on Cluster Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CLUSTER.2001.10006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

Abstract

One benefit of cluster computer architectures is the opportunity for large I/O bandwidths. High performance applications that require significant I/O throughput are increasingly of interest to the clustercomputing community. Parallel file systems are critical system software components that allow parallel applications to take advantage of the parallel I/O disk subsystems in a cluster architecture. The Parallel Virtual File System (PVFS) was the first parallel file system developed specifically for cluster architectures and today is a popular choice for fast disk access. This tutorial introduces the basic concepts behind parallel file systems and specific information about PVFS. The emphasis is on using PVFS to implement effective applications that require substantial I/O performance. Topics include fundamental concepts, PVFS specifics, I/O interfaces including MPI-IO, example applications, performance tuning, and the future of PVFS. Dr. Ligon is an Associate Professor in the Holcombe Department of Electrical and Computer Engineering at Clemson University. His research interests are in high performance computing, focusing on parallel file systems, problem solving environments, and reconfigurable computing. Current projects include the Parallel Virtual File System (PVFS), Clemson Environment for Remote Sensing (CERSe), and the Reconfigurable Computing Application Development Environment (RCADE). Dr. Ross is a postdoctoral researcher in the Mathematics and Computer Science Division at Argonne National Laboratory. His research interests are in message passing and storage systems for high performance computing environments, in particular cluster computing environments. Current projects include the Parallel Virtual File System (PVFS), the ROMIO MPI-IO implementation, and the MPICH implementation of the MPI message passing interface. Proceedings of the 2001 IEEE International Conference on Cluster Computing (CLUSTER01) 0-7695-1116-3/02 $17.00 © 2002 IEEE

查看原文本刊更多论文

商品集群的并行虚拟文件系统

集群计算机体系结构的一个好处是有机会获得大的I/O带宽。需要大量I/O吞吐量的高性能应用程序越来越受到集群计算社区的关注。并行文件系统是关键的系统软件组件，它允许并行应用程序利用集群体系结构中的并行I/O磁盘子系统。并行虚拟文件系统(PVFS)是第一个专门为集群架构开发的并行文件系统，目前是快速磁盘访问的流行选择。本教程介绍并行文件系统背后的基本概念和关于PVFS的具体信息。重点是使用PVFS实现需要大量I/O性能的有效应用程序。主题包括基本概念、PVFS细节、I/O接口(包括MPI-IO)、示例应用程序、性能调优以及PVFS的未来。他是克莱姆森大学霍尔库姆电气和计算机工程系的副教授。他的研究兴趣是高性能计算，主要关注并行文件系统、问题解决环境和可重构计算。目前的项目包括并行虚拟文件系统(PVFS)、克莱姆森遥感环境(CERSe)和可重构计算应用开发环境(RCADE)。罗斯博士是美国阿贡国家实验室数学与计算机科学部的博士后研究员。他的研究兴趣是高性能计算环境的消息传递和存储系统，特别是集群计算环境。当前的项目包括并行虚拟文件系统(PVFS)、ROMIO MPI- io实现和MPI消息传递接口的MPICH实现。2001 IEEE国际集群计算会议论文集(Cluster ' 01) 0-7695-1116-3/02 $17.00©2002 IEEE

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings. IEEE International Conference on Cluster Computing

自引率

0.00%

发文量