Middleware for Grid Computing最新文献_第2页

vfcBOX: multi-user consistent file sharing vfcBOX:多用户一致性文件共享

Middleware for Grid Computing Pub Date : 2011-12-12 DOI: 10.1145/2089002.2089007

Jean-Pierre Ramos, L. Veiga, P. Ferreira

{"title":"vfcBOX: multi-user consistent file sharing","authors":"Jean-Pierre Ramos, L. Veiga, P. Ferreira","doi":"10.1145/2089002.2089007","DOIUrl":"https://doi.org/10.1145/2089002.2089007","url":null,"abstract":"The emerging of cloud file sharing systems has been motivated by real user needs for data sharing. There are many solutions providing such sharing support all having the common goal of being widely scalable while providing users with consistent shared data. However, offering consistent data is at odds with scalability as it requires many messages and available network bandwith for file transfer.\u0000 Network bandwidth can be minimized using several techniques such as compression, deduplication[10], delta encoding[9], etc. However, these approaches do not take into account that not all files must be fully consistent at all times for all users.\u0000 In this paper we further increase the scalability of a cloud file sharing system, called vfcBOX, by taking into account the notion of users interest. This means that vfcBOX considers users' consistency needs regarding shared files, to avoid sending useless (or unnecessary) data through the network. As a matter of fact, some files do not need to be constantly propagated to all users, because some of them do not require such immediacy given the particular semantics of the shared data.\u0000 vfcBOX uses not only deduplication techniques to minimize network usage but also a consistency model that takes into account the users' interests. The result is a scalable and efficient cloud file sharing system that fulfills users needs regarding data sharing.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117085292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Understanding scheduling implications for scientific applications in clouds 理解云中的科学应用程序的调度含义

Middleware for Grid Computing Pub Date : 2011-12-12 DOI: 10.1145/2089002.2089005

Giacomo V. Mc Evoy, B. Schulze

引用次数: 12

Power-aware virtual machine scheduling on clouds using active cooling control and DVFS 使用主动冷却控制和DVFS的云上的功耗感知虚拟机调度

Middleware for Grid Computing Pub Date : 2011-12-12 DOI: 10.1145/2089002.2089004

Daniel Guimaraes do Lago, E. Madeira, L. Bittencourt

引用次数: 84

A hybrid fault tolerance scheme for EasyGrid MPI applications 一种用于EasyGrid MPI应用的混合容错方案

Middleware for Grid Computing Pub Date : 2011-12-12 DOI: 10.1145/2089002.2089006

J. A. D. Silva, Vinod E. F. Rebello

引用次数: 3

A scheduling model for workflows on grids and clouds 网格和云上工作流的调度模型

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890802

H. Kloh, B. Schulze, A. Mury, R. Pinto

引用次数: 8

CRM-OO-VM: a checkpointing-enabled Java VM for efficient and reliable e-science applications in grids CRM-OO-VM:一个支持检查点的Java VM，用于网格中高效可靠的电子科学应用程序

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890800

Tiago Garrochinho, L. Veiga

{"title":"CRM-OO-VM: a checkpointing-enabled Java VM for efficient and reliable e-science applications in grids","authors":"Tiago Garrochinho, L. Veiga","doi":"10.1145/1890799.1890800","DOIUrl":"https://doi.org/10.1145/1890799.1890800","url":null,"abstract":"Object-oriented programming languages are in current days, the dominant paradigm of application development (mostly Java and .NET languages). Recently, increasingly more Java applications have long (or very long) execution times and manipulate large amounts of data/information, gaining relevance in fields related with e-Science (with Grid and Cloud computing). Significant examples include chemistry, computational biology and bio-informatics, with many available Java-based APIs (e.g., Neobio).\u0000 Often, when the execution of one of those applications is terminated abruptly due to a failure (regardless of it being caused by hardware of software fault, lack of available resources,...), all of its work already carried out is simply lost and, when the application is later re-executed, it has to restart its work from scratch, wasting resources and time, and being prone to another failure, to delay its completion with no deadline guarantees.\u0000 A possible solution to solve these problems, is through mechanisms of checkpoint and migration. This makes applications more robust and flexible by being able to move to other nodes, without intervention from the programmer. This article provides a solution to Java applications with long execution times, by incorporating such mechanisms in a Java VM (JikesRVM).","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114638406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Mooshabaya: mashup generator for XBaya Mooshabaya: XBaya的混搭生成器

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890807

BuddhikaDe Alwis, Supun Malinga, P. Kathiravelu, Denis Weerasiri, S. Perera, V. Nanayakkara

引用次数: 1

Optimizing the pre-processing of scientific visualization techniques using QEF 利用QEF优化科学可视化技术的预处理

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890805

D. Oliveira, F. Porto, G. Giraldi, B. Schulze, R. Pinto

{"title":"Optimizing the pre-processing of scientific visualization techniques using QEF","authors":"D. Oliveira, F. Porto, G. Giraldi, B. Schulze, R. Pinto","doi":"10.1145/1890799.1890805","DOIUrl":"https://doi.org/10.1145/1890799.1890805","url":null,"abstract":"Scientific Visualization is a computer-based field concerned with techniques that allow scientists to create graphical representations from datasets generated by computational simulations or acquisition instruments. To address the computational cost of visualization tasks, specially for large datasets, researchers have explored grid environments as a platform for their parallel evaluation. It is however not trivial to adapt each different visualization technique to run in grid environments. A desirable alternative would separate the specificities of data and process distribution in grids from visualization computation logic. In this work we claim that the QEF (query evaluation framework) leverages scientific visualization computation with the above mentioned characteristics. Visualization computation techniques are modeled as operators in an algebra and integrated with a set of control operators that manage data distribution leading to a parallel QEP (query execution plan). We show the benefits of parallelization for two of those techniques: particle tracing and volume rendering. For these techniques, our experiments demonstrate many positive aspects of the solution presented, as well as opportunities for future work.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123869580","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

The dark energy survey data management system as a data intensive science gateway 暗能量调查数据管理系统作为数据密集型科学的门户

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890808

Kailash Kotwani, J. Myers, Bill Baker, J. Mohr, G. Daues, T. Darnell, Y. D. Cai, M. Gower, S. Desai, B. Armstrong, T. McLaren, D. Petravick, Ankit Chandra, J. Plutchak

{"title":"The dark energy survey data management system as a data intensive science gateway","authors":"Kailash Kotwani, J. Myers, Bill Baker, J. Mohr, G. Daues, T. Darnell, Y. D. Cai, M. Gower, S. Desai, B. Armstrong, T. McLaren, D. Petravick, Ankit Chandra, J. Plutchak","doi":"10.1145/1890799.1890808","DOIUrl":"https://doi.org/10.1145/1890799.1890808","url":null,"abstract":"The Dark Energy Survey (DES) collaboration is a multi-national science effort to understand cosmic acceleration and the nature of 'dark energy' responsible for this phenomenon. Dark Energy Survey Data Management (DESDM) system is a new observational astronomy processing pipeline and data management system that will be used to: process raw images obtained from a survey with the new DES field camera (DECam) covering 5000 sq degree of southern sky; archive intermediate and final co-added images; extract catalogs of celestial objects from every image and deliver data products to the astronomy community through portals and services. DESDM has been designed as a data intensive Science Gateway coupling use of shared computational resources (e.g. Teragrid) with project-owned databases and file systems for storage distributed across three continents. DESDM system over the next six years time will perform over 10 million CPU-hours (SUs) of image processing and serve over 4 Petabytes of images and 14 billion cataloged objects to the international DES collaboration. When delivered for operations in 2011, it will be one of, if not the, most scalable and powerful systems for processing telescope images, creating co-added deep images, and generating detailed star and galaxy catalogs in existence. The project's software components consist of a processing framework, an ensemble of astronomy codes, an integrated archive, a data-access framework and a portal infrastructure. This paper provides an overview of the DESDM scope and highlights, the architectural features developed and planned to be able to support Gateway-style management peta-scale intensive continuous processing and on-demand user queries for analysis.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125070259","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Multi-domain grid/cloud computing through a hierarchical component-based middleware 通过基于分层组件的中间件实现多域网格/云计算

Middleware for Grid Computing Pub Date : 2010-11-29 DOI: 10.1145/1890799.1890801

E. Mathias, F. Baude

{"title":"Multi-domain grid/cloud computing through a hierarchical component-based middleware","authors":"E. Mathias, F. Baude","doi":"10.1145/1890799.1890801","DOIUrl":"https://doi.org/10.1145/1890799.1890801","url":null,"abstract":"Current solutions for hybrid Grid/Cloud computing have been developed to hide from heterogeneity, dynamism and distributed nature of resources. These solutions are however insufficient to support distributed applications with non trivial communication patterns among processes, or that are structured so as to reflect the organization of resources they are deployed onto. In this paper, we present a generic, adaptable and extensible component-based middleware that seamlessly enables a transition of non-trivial applications from traditional Grids to hybrid Grid-Cloud platforms. This middleware goes beyond the resolution of well known technical challenges for multi-domain computing, as it offers mechanisms to exploit the hierarchical, heterogeneous and dynamic nature of platforms. We validate its capabilities and versatility through two use cases: an Internet-wide federation of Distributed Service Buses and a runtime supporting domain-decomposition HPC in heterogeneous computing environments using MPI-like programming. Performance results show the efficiency and usefulness of our middleware, and so contribute to promote research efforts geared towards flexible, on-demand IT solutions.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120887043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4