HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005.最新文献_第2页

Cost-based scheduling for data-intensive applications on global grids 基于成本的全球网格数据密集型应用调度

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520989

S. Venugopal, R. Buyya

引用次数: 4

Dynamic load balancing for distributed search 分布式搜索的动态负载平衡

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520953

Larry Huston, Alex Nizhner, P. Pillai, R. Sukthankar, P. Steenkiste, Jiaying Zhang

{"title":"Dynamic load balancing for distributed search","authors":"Larry Huston, Alex Nizhner, P. Pillai, R. Sukthankar, P. Steenkiste, Jiaying Zhang","doi":"10.1109/HPDC.2005.1520953","DOIUrl":"https://doi.org/10.1109/HPDC.2005.1520953","url":null,"abstract":"This paper examines how computation can be mapped across the nodes of a distributed search system to effectively utilize available resources. We specifically address computationally intensive search of complex data, such as content-based retrieval of digital images or sounds, where sophisticated algorithms must be evaluated on the objects of interest. Since these problems require significant computation, we distribute the search over a collection of compute nodes, such as active storage devices, intermediate processors and host computers. A key challenge with mapping the desired computation to the available resources is that the most efficient distribution depends on several factors: relative power and number of compute nodes; network bandwidth between the compute nodes; the cost of evaluating query predicates; and the selectivity of the given query. This wide range of variables renders manual partitioning of the computation infeasible, particularly since some of the parameters (e.g., available network bandwidth) can change during the course of a search. This paper proposes several techniques for dynamic partitioning of computation, and demonstrates that they can significantly improve efficiency for distributed search applications.","PeriodicalId":120564,"journal":{"name":"HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005.","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134299870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Recording and using provenance in a protein compressibility experiment 蛋白质可压缩性实验中来源的记录与利用

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520960

Paul T. Groth, S. Miles, W. Fang, Sylvia C. Wong, K. Zauner, L. Moreau

{"title":"Recording and using provenance in a protein compressibility experiment","authors":"Paul T. Groth, S. Miles, W. Fang, Sylvia C. Wong, K. Zauner, L. Moreau","doi":"10.1109/HPDC.2005.1520960","DOIUrl":"https://doi.org/10.1109/HPDC.2005.1520960","url":null,"abstract":"Very large scale computations are now becoming routinely used as a methodology to undertake scientific research. In this context, 'provenance systems' are regarded as the equivalent of the scientist's logbook for in silico experimentation: provenance captures the documentation of the process that led to some result. Using a protein compressibility analysis application, we derive a set of generic use cases for a provenance system. In order to support these, we address the following fundamental questions: what is provenance? How to record it? What is the performance impact for grid execution? What is the performance of reasoning? In doing so, we define a technology-independent notion of provenance that captures interactions between components, internal component information and grouping of interactions, so as to allow us to analyze and reason about the execution of scientific processes. In order to support persistent provenance in heterogeneous applications, we introduce a separate provenance store, in which provenance documentation can be stored, archived and queried independently of the technology used to run the application. Through a series of practical tests, we evaluate the performance impact of such a provenance system. In summary, we demonstrate that provenance recording overhead of our prototype system remains under 10% of execution time, and we show that the recorded information successfully supports our use cases in a performant manner.","PeriodicalId":120564,"journal":{"name":"HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005.","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128572798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 91

Autonomic runtime manager for adaptive distributed applications 用于自适应分布式应用程序的自主运行时管理器

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520937

Jingmei Yang, Huoping Chen, S. Hariri, M. Parashar

引用次数: 6

A new metric for robustness with application to job scheduling 应用于作业调度的鲁棒性新度量

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520948

D. England, J. Weissman, Jayashree Sadagopan

{"title":"A new metric for robustness with application to job scheduling","authors":"D. England, J. Weissman, Jayashree Sadagopan","doi":"10.1109/HPDC.2005.1520948","DOIUrl":"https://doi.org/10.1109/HPDC.2005.1520948","url":null,"abstract":"Scheduling strategies for parallel and distributed computing have mostly been oriented toward performance, while striving to achieve some notion of fairness. With the increase in size, complexity, and heterogeneity of today's computing environments, we argue that, in addition to performance metrics, scheduling algorithms should be designed for robustness. That is, they should have the ability to maintain performance under a wide variety of operating conditions. Although robustness is easy to define, there are no widely used metrics for this property. To this end, we present a methodology for characterizing and measuring the robustness of a system to a specific disturbance. The methodology is easily applied to many types of computing systems and it does not require sophisticated mathematical models. To illustrate its use, we show three applications of our technique to job scheduling; one supporting a previous result with respect to backfilling, one examining overload control in a streaming video server, and one comparing two different scheduling strategies for a distributed network service. The last example also demonstrates how consideration of robustness leads to better system design as we were able to devise a new and effective scheduling heuristic.","PeriodicalId":120564,"journal":{"name":"HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005.","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134432962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 43

Scheduling strategies for mapping application workflows onto the grid 将应用程序工作流映射到网格的调度策略

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520947

A. Mandal, K. Kennedy, C. Koelbel, G. Marin, J. Mellor-Crummey, Bo Liu, Lennart Johnsson

引用次数: 204

In-VIGO virtual networks and virtual application services: automated grid-enabling and deployment of applications In-VIGO虚拟网络和虚拟应用服务:自动化网格启用和应用程序部署

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520990

Maurício O. Tsugawa, Andréa M. Matsunaga, Liping Zhu, Vivekananthan Sanjeepan, H. Lam, R. Figueiredo, J. Fortes

引用次数: 3

The resource oriented authorization manager (ROAM) 面向资源的授权管理器(ROAM)

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520988

J. Burruss

引用次数: 1

The University of Bristol grid, a production campus grid 布里斯托尔大学的网格，一个生产校园网格

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520994

D. Wallom, Ian Stewart, John Wakelin

{"title":"The University of Bristol grid, a production campus grid","authors":"D. Wallom, Ian Stewart, John Wakelin","doi":"10.1109/HPDC.2005.1520994","DOIUrl":"https://doi.org/10.1109/HPDC.2005.1520994","url":null,"abstract":"With the increasing cost of providing computing and storage facilities for research capability, it has become important that universities make increasingly efficient use of their existing resources. The strategy developed at the University of Bristol has involved the design and construction of a campus grid. This has enabled better utilization of spare capacity on available systems connected to the grid and also the separation, for the first time, of those applications that require parallel compute resources (i.e. closely coupled systems) and those that require serial resources. The overall implementation of this strategy was driven by two prime considerations. Firstly, the contributing cluster systems are, in the main, very heavily used and connecting them onto the grid must be done in a non-invasive way to ensure currently executing applications don't have to be interrupted or any other cluster operations compromised. Secondly, the grid has been considered by many scientific users to be over hyped. This implied that we needed to get a system up and running quickly however 'simple' it was to prove the concept was viable. It was hoped that involving real users at an early stage of the grid's construction would lead to them evangelising about the system and thus, encourage more users to use the system.","PeriodicalId":120564,"journal":{"name":"HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005.","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131899169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Enabling self-management of component-based high-performance scientific applications 支持基于组件的高性能科学应用程序的自我管理

HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005. Pub Date : 2005-07-24 DOI: 10.1109/HPDC.2005.1520936

Hua Liu, M. Parashar

引用次数: 23