发布求助
文献互助 智能选刊 最新文献

International Parallel Data Systems Workshop最新文献

筛选
英文 中文
On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems 在基于集群的存储系统中避免TCP吞吐量崩溃的应用程序级方法
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374598
E. Krevat, V. Vasudevan, Amar Phanishayee, D. Andersen, G. Ganger, Garth A. Gibson, S. Seshan
{"title":"On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems","authors":"E. Krevat, V. Vasudevan, Amar Phanishayee, D. Andersen, G. Ganger, Garth A. Gibson, S. Seshan","doi":"10.1145/1374596.1374598","DOIUrl":"https://doi.org/10.1145/1374596.1374598","url":null,"abstract":"TCP Incast plagues scalable cluster-based storage built atop standard TCP/IP-over-Ethernet, often resulting in much lower client read bandwidth than can be provided by the available network links. This paper reviews the Incast problem and discusses potential application-level approaches to avoiding it.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132109925","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 74
A result-data offloading service for HPC centers HPC中心的结果数据卸载服务
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374608
H. M. Monti, A. Butt, Sudharshan S. Vazhkudai
{"title":"A result-data offloading service for HPC centers","authors":"H. M. Monti, A. Butt, Sudharshan S. Vazhkudai","doi":"10.1145/1374596.1374608","DOIUrl":"https://doi.org/10.1145/1374596.1374608","url":null,"abstract":"Modern High-Performance Computing applications are consuming and producing an exponentially increasing amount of data. This increase has lead to a significant number of resources being dedicated to data staging in and out of Supercomputing Centers. The typical approach to staging is a direct transfer of application data between the center and the application submission site. Such a direct data transfer approach becomes problematic, especially for staging-out, as (i) the data transfer time increases with the size of data, and may exceed the time allowed by the center's purge policies; and (ii) the submission site may not be online to receive the data, thus further increasing the chances for output data to be purged. In this paper, we argue for a systematic data staging-out approach that utilizes intermediary data-holding nodes to quickly offload data from the center to the intermediaries, thus avoiding the peril of a purge and addressing the two issues mentioned above. The intermediary nodes provide temporary data storage for the staged-out data and maximize the offload bandwidth by providing multiple dataflow paths from the center to the submission site. Our initial investigation shows such a technique to be effective in addressing the above two issues and providing better QOS guarantees for data retrieval.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"226 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115743225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
End-to-end performance management for scalable distributed storage 可扩展分布式存储的端到端性能管理
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374605
David O. Bigelow, S. Iyer, T. Kaldewey, R. Pineiro, A. Povzner, S. Brandt, Richard A. Golding, T. Wong, C. Maltzahn
{"title":"End-to-end performance management for scalable distributed storage","authors":"David O. Bigelow, S. Iyer, T. Kaldewey, R. Pineiro, A. Povzner, S. Brandt, Richard A. Golding, T. Wong, C. Maltzahn","doi":"10.1145/1374596.1374605","DOIUrl":"https://doi.org/10.1145/1374596.1374605","url":null,"abstract":"Many applications---for example, scientific simulation, real-time data acquisition, and distributed reservation systems---have I/O performance requirements, yet most large, distributed storage systems lack the ability to guarantee I/O performance. We are working on end-to-end performance management in scalable, distributed storage systems. The kinds of storage systems we are targeting include large high-performance computing (HPC) clusters, which require both large data volumes and high I/O rates, as well as large-scale general-purpose storage systems.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132610470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
A data placement service for petascale applications 用于千万亿级应用程序的数据放置服务
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374611
A. Chervenak, R. Schuler
{"title":"A data placement service for petascale applications","authors":"A. Chervenak, R. Schuler","doi":"10.1145/1374596.1374611","DOIUrl":"https://doi.org/10.1145/1374596.1374611","url":null,"abstract":"We examine the use of policy-driven data placement services to improve the performance of data-intensive, petascale applications in high performance distributed computing environments. In particular, we are interested in using an asynchronous data placement service to stage data in and out of application workflows efficiently as well as to distribute and replicate data according to Virtual Organization policies. We propose a data placement service architecture and describe our implementation of one layer of this architecture, which provides efficient, priority-based bulk data transfers.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122096281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
RADOS: a scalable, reliable storage service for petabyte-scale storage clusters RADOS:用于pb级存储集群的可扩展、可靠的存储服务
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374606
S. Weil, A. Leung, S. Brandt, C. Maltzahn
{"title":"RADOS: a scalable, reliable storage service for petabyte-scale storage clusters","authors":"S. Weil, A. Leung, S. Brandt, C. Maltzahn","doi":"10.1145/1374596.1374606","DOIUrl":"https://doi.org/10.1145/1374596.1374606","url":null,"abstract":"Brick and object-based storage architectures have emerged as a means of improving the scalability of storage clusters. However, existing systems continue to treat storage nodes as passive devices, despite their ability to exhibit significant intelligence and autonomy. We present the design and implementation of RADOS, a reliable object storage service that can scales to many thousands of devices by leveraging the intelligence present in individual storage nodes. RADOS preserves consistent data access and strong safety semantics while allowing nodes to act semi-autonomously to self-manage replication, failure detection, and failure recovery through the use of a small cluster map. Our implementation offers excellent performance, reliability, and scalability while providing clients with the illusion of a single logical object store.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"5 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116793180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 195
Integrated system models for reliable petascale storage systems 可靠千万亿级存储系统的集成系统模型
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374600
B. Welch
{"title":"Integrated system models for reliable petascale storage systems","authors":"B. Welch","doi":"10.1145/1374596.1374600","DOIUrl":"https://doi.org/10.1145/1374596.1374600","url":null,"abstract":"The big challenges facing petascale storage systems are not actually those of performanc or traditional fault tolerance schemes, but instead the challenges stem from the inherent complexity of large distributed systems. The best way to address these problems is to build a system model into the system itself, and have the system continuously monitor its current state as compared with the desired state according to the model. Change is applied to the model first, and then the system strives to achieve the new model. The hard part is defining a good model, building good support for introspection, and exploiting these features in the system design. This paper describes this problem in more detail, explains some of the techniques we have used in building the Panasas distributed storage system, and concludes with a summary of the open problems with building petascale storage systems.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"166 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134245987","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Towards an I/O tracing framework taxonomy I/O跟踪框架分类法
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374610
A. Konwinski, John Bent, J. Nunez, Meghan Quist
{"title":"Towards an I/O tracing framework taxonomy","authors":"A. Konwinski, John Bent, J. Nunez, Meghan Quist","doi":"10.1145/1374596.1374610","DOIUrl":"https://doi.org/10.1145/1374596.1374610","url":null,"abstract":"There is high demand for I/O tracing in High Performance Computing (HPC). It enables in-depth analysis of distributed applications and file system performance tuning. It also aids distributed application debugging. Finally, it facilitates collaboration within and between government, industrial, and academic institutions by enabling the generation of replayable I/O traces, which can be easily distributed and anonymized as necessary to protect confidential or sensitive information. As a response to this demand for tracing tools, various means of I/O trace generation exist. We first survey the I/O Tracing Framework landscape, exploring three popular such frameworks: LANL-Trace [3], Tracefs [1], and//TRACE [2].\u0000 We next develop an I/O Tracing Framework taxonomy. The purpose of this taxonomy is to assist I/O Tracing Framework users in formalizing their tracing requirements, and to provide the developers of I/O Tracing Frameworks a language to categorize the functionality and performance of them. The taxonomy categorizes I/O Tracing Framework features such as the type of data captured, trace replayability, and anonymization. The taxonomy also considers elapsed-time overhead and performance overhead. Finally, we provide a case study in the use of our new taxonomy, revisiting all three I/O Tracing Frameworks explored in our survey, to formally classify the features of each.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"16 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114114104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
GIGA+: scalable directories for shared file systems GIGA+:用于共享文件系统的可伸缩目录
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374604
Swapnil Patil, Garth A. Gibson, S. Lang, Milo Polte
{"title":"GIGA+: scalable directories for shared file systems","authors":"Swapnil Patil, Garth A. Gibson, S. Lang, Milo Polte","doi":"10.1145/1374596.1374604","DOIUrl":"https://doi.org/10.1145/1374596.1374604","url":null,"abstract":"There is an increasing use of high-performance computing (HPC) clusters with thousands of compute nodes that, with the advent of multi-core CPUs, will impose a significant challenge for storage systems: The ability to scale to handle I/O generated by applications executing in parallel in tens of thousands of threads. One such challenge is building scalable directories for cluster storage - i.e., directories that can store billions to trillions of entries and handle hundreds of thousands of operations per second.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125768623","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 62
Searching and navigating petabyte-scale file systems based on facets 基于面搜索和导航 PB 级文件系统
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374603
J. Koren, A. Leung, Yi Zhang, C. Maltzahn, S. Ames, E. L. Miller
{"title":"Searching and navigating petabyte-scale file systems based on facets","authors":"J. Koren, A. Leung, Yi Zhang, C. Maltzahn, S. Ames, E. L. Miller","doi":"10.1145/1374596.1374603","DOIUrl":"https://doi.org/10.1145/1374596.1374603","url":null,"abstract":"As users interact with file systems of ever increasing size, it is becoming more difficult for them to familiarize themselves with the entire contents of the file system. In petabyte-scale systems, users must navigate a pool of billions of shared files in order to find the information they are looking for. One way to help alleviate this problem is to integrate navigation and search into a common framework.\u0000 One such method is faceted search. This method originated within the information retrieval community, and has proved popular for navigating large repositories, such as those in e-commerce sites and digital libraries. This paper introduces faceted search and outlines several current research directions in adapting faceted search techniques to petabyte-scale file systems.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127479212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Characterizing the I/O behavior of scientific applications on the Cray XT 表征Cray XT上科学应用程序的I/O行为
International Parallel Data Systems Workshop Pub Date : 2007-11-11 DOI: 10.1145/1374596.1374609
P. Roth
{"title":"Characterizing the I/O behavior of scientific applications on the Cray XT","authors":"P. Roth","doi":"10.1145/1374596.1374609","DOIUrl":"https://doi.org/10.1145/1374596.1374609","url":null,"abstract":"Scientific applications use input/output (I/O) for obtaining initial conditions and execution parameters, as a persistent way of saving program output, and for safeguarding against system unreliability. Although system sizes are expected to continue increasing, I/O performance is not expected to keep pace with system computation and communication performance. Understanding application I/O demands and system I/O capabilities is the first step toward bridging this gap between them. In this paper, we present our approach for characterizing the I/O demands of applications on the Cray XT. We also present preliminary case studies showing the use of our I/O characterization infrastructure with climate studies and combustion simulation programs.","PeriodicalId":218652,"journal":{"name":"International Parallel Data Systems Workshop","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127363876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 39
首页 上一页
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整，为了账户安全，请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们：info@booksci.cn Book学术提供免费学术资源搜索服务，方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号：604180095
Book学术官方微信
小红书