{"title":"Resource allocation across multiple cloud data centres","authors":"Barnaby Malet, P. Pietzuch","doi":"10.1145/1890799.1890804","DOIUrl":"https://doi.org/10.1145/1890799.1890804","url":null,"abstract":"Web applications with rich AJAX-driven user interfaces make asynchronous server-side calls to switch application state. To provide the best user experience, the response time of these calls must be as low as possible. Since response time is bounded by network delay, it can be minimised by placing application components closest to the network location of the majority of anticipated users. However, with a limited budget for hosting applications, developers need to select data centre locations strategically. In practice, the best choice is difficult to achieve manually due to dynamic client workloads and effects such as flash crowds.\u0000 In this paper, we propose a cloud management middleware that automatically adjusts the placement of web application components across multiple cloud data centres. Based on observations and predictions of client request rates, it migrates application components between data centres. Our evaluation with two data centres and globally distributed clients on PlanetLab shows that our approach can decrease median client response times by 21% for a realistic multi-tier web application.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130216868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A middleware for parallel processing of large graphs","authors":"T. Macambira, D. Guedes","doi":"10.1145/1890799.1890806","DOIUrl":"https://doi.org/10.1145/1890799.1890806","url":null,"abstract":"With the increasing \"data deluge\" scientists face today, the analysis and processing of large datasets of structured data is a daring task. Among such data, large graphs are gaining particular importance with the growing interest on social networks and other complex networks. Given the dimensions considered, parallel processing is essential. However, users are generally not experts in writing parallel code to handle such structures. In this work we present Rendero, a middleware that makes it possible to easily describe graph algorithms in a form adequate for parallel execution. The system is based on the Bulk-Synchronous programming model and offers a vertex-based abstraction. Our current implementation offers good speed-up and scale-up results for large graphs ranging from tens of thousands to millions of vertices and edges in some cases.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124959615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers","authors":"A. Beloglazov, R. Buyya","doi":"10.1145/1890799.1890803","DOIUrl":"https://doi.org/10.1145/1890799.1890803","url":null,"abstract":"The rapid growth in demand for computational power driven by modern service applications combined with the shift to the Cloud computing model have led to the establishment of large-scale virtualized data centers. Such data centers consume enormous amounts of electrical energy resulting in high operating costs and carbon dioxide emissions. Dynamic consolidation of virtual machines (VMs) and switching idle nodes off allow Cloud providers to optimize resource usage and reduce energy consumption. However, the obligation of providing high quality of service to customers leads to the necessity in dealing with the energy-performance trade-off. We propose a novel technique for dynamic consolidation of VMs based on adaptive utilization thresholds, which ensures a high level of meeting the Service Level Agreements (SLA). We validate the high efficiency of the proposed technique across different kinds of workloads using workload traces from more than a thousand PlanetLab servers.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130215840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
D. Eyers, R. Routray, Rui Zhang, Douglas Willcocks, P. Pietzuch
{"title":"Towards a middleware for configuring large-scale storage infrastructures","authors":"D. Eyers, R. Routray, Rui Zhang, Douglas Willcocks, P. Pietzuch","doi":"10.1145/1657120.1657123","DOIUrl":"https://doi.org/10.1145/1657120.1657123","url":null,"abstract":"The rapid proliferation of cloud and service-oriented computing infrastructure is creating an ever increasing thirst for storage within data centers. Ideally management applications in cloud deployments should operate in terms of high-level goals, and not present specific implementation details to administrators. Cloud providers often employ Storage Area Networks (SANs) to gain storage scalability. SAN configurations have a vast parameter space, which makes them one of the most difficult components to configure and manage in a cloud storage offering.\u0000 As a step towards a general cloud storage configuration platform, this paper introduces a SAN configuration middleware that aids management applications in their task of updating and troubleshooting heterogeneous SAN deployments. The middleware acts as a proxy between management applications and a central repository of SAN configurations. The central repository is designed to validate SAN configurations against a knowledge base of best practice rules across cloud deployments. Management applications contribute local SAN configurations to the repository, and also subscribe to proactive notifications for configurations now no longer considered safe.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131630654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Performance and deployment evaluation of a parallel application in an on-premises Cloud environment","authors":"Giacomo V. Mc Evoy, B. Schulze, E. Garcia","doi":"10.1145/1657120.1657122","DOIUrl":"https://doi.org/10.1145/1657120.1657122","url":null,"abstract":"In this paper we present the case study of an application of a parallel simulation optimization deployed in an on-premises Cloud. The compute-intensive application uses a Master/Worker model, supporting communication over both Java RMI and Globus Grid Services between the nodes. The Master deploys Workers over an Eucalyptus Cloud using the Nimbus Context Broker for just-in-time configuration and runtime Worker discovery. The computational performance of the Workers under different communication mechanisms and deployment scenarios is presented in an attempt to evaluate the use of Virtual Machines in a Cloud as a tool to achieve application scaling. The deployment of this particular application was crafted to support on-the-fly addition of working nodes. The case study suggests a deployment pattern that shapes some requirements and considerations of a scalable Globus-driven Platform as a Service Cloud.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114068384","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Enhancing the efficiency of resource usage on opportunistic grids","authors":"R. Gomes, F. Costa, F. Georges","doi":"10.1145/1657120.1657125","DOIUrl":"https://doi.org/10.1145/1657120.1657125","url":null,"abstract":"Opportunistic grid computing middleware has as a main concern the need to guarantee that the performance of local applications running on the machines that donate resources is not affected. This concern, together with the fact that it happens in an extremely dynamic environment, causes the adoption of a treatment based on the best-effort principle for grid applications. This means that efficient application management schemes are usually not employed, which results in less than optimal performance as grid applications often need to be restarted due to (often temporary) resource claims by local user applications. This paper presents a method to improve the performance of grid applications, taking into account resource usage profiles for local applications, trying to identify when such resource claims are temporary and avoiding actions such as the migration of grid tasks. The proposed approach was implemented as part of the InteGrade middleware and its evaluation shows promising results for the efficient management of grid applications.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"772 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134341062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Power-aware provisioning of Cloud resources for real-time services","authors":"K. Kim, A. Beloglazov, R. Buyya","doi":"10.1145/1657120.1657121","DOIUrl":"https://doi.org/10.1145/1657120.1657121","url":null,"abstract":"Reducing energy consumption has been an essential technique for Cloud resources or datacenters, not only for operational cost, but also for system reliability. As Cloud computing becomes emergent for Anything as a Service (XaaS) paradigm, modern real-time Cloud services are also available throughout Cloud computing. In this work, we investigate power-aware provisioning of virtual machines for real-time services. Our approach is (i) to model a real-time service as a real-time virtual machine request; and (ii) to provision virtual machines of datacenters using DVFS (Dynamic Voltage Frequency Scaling) schemes. We propose several schemes to reduce power consumption and show their performance throughout simulation results.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122198323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards an adaptive middleware for opportunistic environment: a mobile agent approach","authors":"Vinicius Pinheiro, Fabio Kon, A. Goldman","doi":"10.1145/1657120.1657126","DOIUrl":"https://doi.org/10.1145/1657120.1657126","url":null,"abstract":"The mobile agent paradigm has emerged as a promising alternative to overcome the construction challenges of opportunistic grid environments. This model can be used to implement mechanisms that enable application execution progress even in the presence of failures, such as those presented by the MAG middleware (Mobile Agents for Grids). MAG includes retrying, replication, and checkpointing as fault-tolerance techniques; they operate independently from each other and are not capable of detecting changes on resource availability. In this paper, we describe a MAG extension that is capable of migrating agents when nodes fail, that optimizes application progress by keeping only the most advanced checkpoint, and that migrates slow replicas.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121942142","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A novel multi-objective optimization scheme for grid resource allocation","authors":"Alexander v. d. Kuijl, M. Emmerich, Hui Li","doi":"10.1145/1462704.1462711","DOIUrl":"https://doi.org/10.1145/1462704.1462711","url":null,"abstract":"Grid computing emerges as an infrastructure for large-scale data processing, resource sharing, and scientific computing. Job scheduling at the Grid level is challenging in that Grid schedulers do not have control over the computing resources across multiple domains. This makes many traditional algorithms developed on parallel systems not suitable in the Grid case. In this paper we propose a Grid scheduling algorithm using multi-attribute utility theory and multiobjective optimization. It attempts to make optimal decisions based on the available set of objectives. By comparing to a deadline-and-budget algorithm with three objectives, we show that the proposed Multi-Objective Optimization (MOO) scheduling algorithm is capable of obtaining a broader set of non-dominated solutions, and can obtain solutions of higher quality, that is proximity to the Pareto front of optimal solutions.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123254502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. P. Nascimento, Cristina Boeres, Vinod E. F. Rebello
{"title":"Dynamic self-scheduling for parallel applications with task dependencies","authors":"A. P. Nascimento, Cristina Boeres, Vinod E. F. Rebello","doi":"10.1145/1462704.1462705","DOIUrl":"https://doi.org/10.1145/1462704.1462705","url":null,"abstract":"As grids are in essence heterogeneous, dynamic, shared and distributed environments, managing these kinds of platforms efficiently is extremely complex. Few transparent grid management systems have been developed to cope with these characteristics simultaneously and therefore both new and existing applications must be modified to execute efficiently. A promising scalable approach to deal with these intricacies is the design of self-managing or autonomic applications. Autonomic applications adapt their execution accordingly by considering knowledge about their own behaviour and environmental conditions. This paper focuses on the dynamic scheduling that provides the self-optimizing ability in autonomic applications. Being distributed, collaborative and pro-active, the proposed hierarchical scheduling infrastructure addresses important issues to enable an efficient execution in a computational grid. Unlike other approaches, the cooperative, hybrid and application-specific strategy deals effectively with task dependencies. Several experiments have been analyzed in real grid environments highlighting the efficiency and scalability of the proposed infrastructure. This paper presents an intra-site dynamic scheduling heuristic for tightly coupled parallel applications represented by DAGs.","PeriodicalId":313448,"journal":{"name":"Middleware for Grid Computing","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126327476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}