International Workshop on Storage Network Architecture and Parallel I/Os最新文献_第2页

A stochastic approach to file access prediction 文件存取预测的随机方法

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162623

Jehan-Francois Pâris, A. Amer, D. Long

引用次数: 17

Design, implementation and performance evaluation of a cost-effective, fault-tolerant parallel virtual file system 一个具有成本效益、容错的并行虚拟文件系统的设计、实现和性能评估

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162625

Yifeng Zhu, Hong Jiang, X. Qin, D. Feng, D. Swanson

{"title":"Design, implementation and performance evaluation of a cost-effective, fault-tolerant parallel virtual file system","authors":"Yifeng Zhu, Hong Jiang, X. Qin, D. Feng, D. Swanson","doi":"10.1145/1162618.1162625","DOIUrl":"https://doi.org/10.1145/1162618.1162625","url":null,"abstract":"Fault tolerance is one of the most important issues for parallel file systems. This paper presents the design, implementation and performance evaluation of a cost-effective, fault-tolerant parallel virtual file system (CEFT-PVFS) that provides parallel I/O service without requiring any additional hardware by utilizing existing commodity disks on cluster nodes and incorporates fault tolerance in the form of disk mirroring. While mirroring is a straightforward idea, we have implemented this open source system and conducted extensive experiments to evaluate the feasibility, efficiency and scalability of this fault tolerant approach on one of the current largest clusters, where the issues of data consistency and recovery are also investigated. Four mirroring protocols are proposed, reflecting whether the fault-tolerant operations are client driven or server driven; synchronous or asynchronous. Their relative merits are assessed by comparing their write performances, measured in the real systems, and their reliability and availability measures, obtained through analytical modeling. The results indicate that, in cluster environments, mirroring can improve the reliability by a factor of over 40 (4000%) while sacrificing the peak write performance by 33--58% when both systems are of identical sizes (i.e., counting the 50% mirroring disks in the mirrored system). In addition, protocols with higher peak write performance are less reliable than those with lower peak write performance, with the latter achieving a higher reliability and availability at the expense of some write bandwidth. A hybrid protocol is proposed to optimize this tradeoff.","PeriodicalId":447113,"journal":{"name":"International Workshop on Storage Network Architecture and Parallel I/Os","volume":"103 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2003-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127625860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 22

Performance evaluation of distributed iSCSI RAID 分布式iSCSI RAID性能评估

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162620

Xubin He, Praveen Beedanagari, Dan Zhou

引用次数: 21

Data consistent up- and downstreaming in a distributed storage system 分布式存储系统中数据上下流一致

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162621

P. Sobe

引用次数: 15

Meta-data snapshotting: a simple mechanism for file system consistency 元数据快照:一种简单的文件系统一致性机制

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162624

Livio Baldini Soares, O. Krieger, Dilma Da Silva

{"title":"Meta-data snapshotting: a simple mechanism for file system consistency","authors":"Livio Baldini Soares, O. Krieger, Dilma Da Silva","doi":"10.1145/1162618.1162624","DOIUrl":"https://doi.org/10.1145/1162618.1162624","url":null,"abstract":"File system consistency frequently involves a choice between raw performance and integrity guarantees. A few software-based solutions for this problem have appeared and are currently being used on some commercial operating systems; these include log-structured file systems, journaling file systems, and soft updates. In this paper, we propose meta-data snapshotting as a low-cost, scalable, and simple mechanism that provides file system integrity. It allows the safe use of write-back caching by making successive snapshots of the meta-data using copy-on-write, and atomically committing the snapshot to stable storage without interrupting file system availability. In the presence of system failures, no file system checker or any other operation is necessary to mount the file system, therefore it greatly improves system availability. This paper describes meta-data snapshotting, and its incorporation into a file system available for the Linux and K42 operating systems. We show that meta-data snapshotting has low overhead: for a microbenchmark, and two macrobenchmarks, the measured overhead is of at most 4%, when compared to a completely asynchronous file system, with no consistency guarantees. Our experiments also show that it induces less overhead then a write-ahead journaling file system, and it scales much better when the number of clients and file system operations grows.Furthermore, this new technique can be easily extended to provide file system snapshotting (versioning) and transaction support for a collection of selected files or directories.","PeriodicalId":447113,"journal":{"name":"International Workshop on Storage Network Architecture and Parallel I/Os","volume":"84 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2003-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122713299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

Performance of optimized software implementation of the iSCSI protocol 优化软件实现iSCSI协议的性能

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162619

Fujita Tomonori, Ogawara Masanori

{"title":"Performance of optimized software implementation of the iSCSI protocol","authors":"Fujita Tomonori, Ogawara Masanori","doi":"10.1145/1162618.1162619","DOIUrl":"https://doi.org/10.1145/1162618.1162619","url":null,"abstract":"The advent of IP-based storage networking has brought specialized network adapters that directly support TCP/IP and storage protocols on the market to get comparable performance that specialized high-performance storage networking architectures provide.This paper describes an efficient software implementation of the iSCSI protocol with a commodity networking infrastructure. Though several studies have compared the performances of specialized network adapters and commodity network adapters, our iSCSI implementation eliminates data copying overhead unlike straightforward iSCSI implementations used in previous studies. To achieve it, we modified a general-purpose operating system by using techniques studied for improving TCP performance in the literature and features that commodity Gigabit Ethernet adapters support. We also quantified their effects.Our microbenchmarks show, compared with a straightforward iSCSI driver that does not use these techniques, the iSCSI driver with these optimizations reduces CPU utilization from 39.4% to 30.8% when writing with an I/O size of 64 KB. However, when reading, any performance gain is negated due to the high cost of operations on the virtual memory system.","PeriodicalId":447113,"journal":{"name":"International Workshop on Storage Network Architecture and Parallel I/Os","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2003-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128118287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

Source level transformations to improve I/O data partitioning 改进I/O数据分区的源级转换

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162622

Yijian Wang, D. Kaeli

引用次数: 10

The Mercury system: exploiting truly fast hardware for data search 水星系统:利用真正快速的硬件进行数据搜索

International Workshop on Storage Network Architecture and Parallel I/Os Pub Date : 2003-09-28 DOI: 10.1145/1162618.1162626

R. Chamberlain, R. Cytron, M. Franklin, R. Indeck

引用次数: 48