T. Genez, L. Bittencourt, R. Sakellariou, E. Madeira
{"title":"A Flexible Scheduler for Workflow Ensembles","authors":"T. Genez, L. Bittencourt, R. Sakellariou, E. Madeira","doi":"10.1145/2996890.2996910","DOIUrl":"https://doi.org/10.1145/2996890.2996910","url":null,"abstract":"In this paper, we propose a flexible workflow scheduler that facilitates the replacement of the objective function according to the user's needs. The possibility of replacing the objective function extends the usability of the scheduler for a variety of objectives. The proposed flexible scheduler uses Particle Swarm Optimization (PSO) to assist the production of schedules on cloud resources. We perform the evaluation via simulation using a set of scientific workflows grouped into ensembles. Three conflicting objective functions were evaluated: minimization of the overall makespan, maximization of fairness, and minimization of monetary costs. Simulation results show that the flexibility of the proposed scheduler has been achieved since each function could produce schedules that satisfied its corresponding objective.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121236023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Víctor Medel Gracia, O. Rana, J. A. Bañares, U. Arronategui
{"title":"Modelling Performance & Resource Management in Kubernetes","authors":"Víctor Medel Gracia, O. Rana, J. A. Bañares, U. Arronategui","doi":"10.1145/2996890.3007869","DOIUrl":"https://doi.org/10.1145/2996890.3007869","url":null,"abstract":"Containers are rapidly replacing Virtual Machines (VMs) as the compute instance of choice in cloud-based deployments. The significantly lower overhead of deploying containers (compared to VMs) has often been cited as one reason for this. We analyse performance of the Kubernetes system and develop a Reference net-based model of resource management within this system. Our model is characterised using real data from a Kubernetes deployment, and can be used as a basis to design scalable applications that make use of Kubernetes.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116884032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Service Topic Model with Probability Distance","authors":"Yu Lei, Philip S. Yu","doi":"10.1145/2996890.3007863","DOIUrl":"https://doi.org/10.1145/2996890.3007863","url":null,"abstract":"The number of Web services are growing rapidly on the Internet. Topics of services are becoming various. Semantic-based keyword search is used to retrieve proper services for service consumers. According to the semantic information implied in service database, we build a topic model to cluster and management related services. Our service recommendation approach can extract service patterns from correlated topics in semantic service descriptions. We use Latent Dirichlet Allocation to obtain the service patterns, and use Concept lattice to model the correlation between the extracted topics. Higher precision results are obtained in the experiments.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115239491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"QuARAM Service Recommender: A Platform for IaaS Service Selection","authors":"S. Soltani, Khalid Elgazzar, Patrick Martin","doi":"10.1145/2996890.3007887","DOIUrl":"https://doi.org/10.1145/2996890.3007887","url":null,"abstract":"Cloud computing provides on-demand resources with no constraints of physical locations. It allows customers to save upfront infrastructure costs and focus on features that discriminate their core businesses. The increasing number of offered services makes manual selection of the most suitable service for an application deployment time-consuming and challenging. It also requires a high level of user expertise to make proper decisions. In this paper, we present QuARAM Service Recommender platform, a self-adaptive Infrastructure-as-a-Service (IaaS) service selection system that recommends a list of suitable services for cloud application deployment based on application requirements and customer preferences. The process begins with automatic extraction of the application's features, requirements and customer preferences and provides a list of potential services for the application deployment (i.e., resource allocation in our context). Initial experiments show promising results for up to 90% precision of recommended services.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131505212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Víctor Medel Gracia, O. Rana, J. A. Bañares, U. Arronategui
{"title":"Adaptive Application Scheduling under Interference in Kubernetes","authors":"Víctor Medel Gracia, O. Rana, J. A. Bañares, U. Arronategui","doi":"10.1145/2996890.3007889","DOIUrl":"https://doi.org/10.1145/2996890.3007889","url":null,"abstract":"Containers are rapidly replacing Virtual Machines (VMs) as the compute instance in cloud-based deployments. The significantly lower overhead of deploying containers (compared to VMs) has often been cited as one reason for this. However, interference caused by the limited isolation in shared resources can impact into the performance of hosted applications. We develop a Reference Net-based model of resource management within Kubernetes, primarily to better characterise such performance issues. Our model makes use of data obtained from a Kubernetes deployment, and can be used as a basis to design scalable (and potentially interference tolerant) applications that make use of Kubernetes.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131359613","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data-Driven Monitoring for Cloud Compute Systems","authors":"Daniel Gehberger, P. Mátray, G. Németh","doi":"10.1145/2996890.2996893","DOIUrl":"https://doi.org/10.1145/2996890.2996893","url":null,"abstract":"The end-to-end monitoring of inter-dependent applications in the cloud is challenging. Difficulties arise from the complexity of computations and the highly distributed nature of the deployment. Due to the lack of a comprehensive observability solution, it is very difficult to apply autonomous mechanisms to ensure service guarantees in the cloud. To tackle the problem, we propose the method of data-driven monitoring, that provides a detailed, live view on how data is flowing through a possibly complex compute system. The method is based on the tracing of individual input events and the collection of resource usage metrics along the paths. By reconstructing causal and temporal relationships, we can detect degradations in performance, pinpoint root causes and apply corrective actions before end-to-end requirements are endangered. To demonstrate the potential of the concept, we created a prototype implementation in a big data compute platform, and also developed two automated optimization algorithms.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128863646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predicting Cloud Resource Utilization","authors":"M. Borkowski, Stefan Schulte, C. Hochreiner","doi":"10.1145/2996890.2996907","DOIUrl":"https://doi.org/10.1145/2996890.2996907","url":null,"abstract":"A major challenge in Cloud computing is resource provisioning for computational tasks. Not surprisingly, previous work has established a number of solutions to provide Cloud resources in an efficient manner. However, in order to realize a holistic resource provisioning model, a prediction of the future resource consumption of upcoming computational tasks is necessary. Nevertheless, the topic of prediction of Cloud resource utilization is still in its infancy stage. In this paper, we present an approach for predicting Cloud resource utilization on a per-task and per-resource level. For this, we apply machine learning-based prediction models. Based on extensive evaluation, we show that we can reduce the prediction error by 20% in a typical case, and improvements above 89% are among the best cases.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134043484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimizing Back-and-Forth Live Migration","authors":"Kuan-Hsin Lee, I-Cheng Lai, Che-Rung Lee","doi":"10.1145/2996890.2996909","DOIUrl":"https://doi.org/10.1145/2996890.2996909","url":null,"abstract":"Back-and-forth live migration, which means a running VM migrates between two physical machines back and forth, has several important applications. Traditional methods treat each migration as a single event, so the VM releases its system resources on the source site after migration. However, many resources can be kept to mitigate the cost of the next migration back to the machine. This paper presents performance optimization methods for back-and-forth live migration. Different from previous work, our approach can keep the data center resiliency. We leverage the technique of snapshot and the bitmap model, which are available in most existing VM management systems. Using the snapshot, a VM can be immediately restarted from the saved state. The bitmaps model is used to avoid redundant data transmission to decrease the costs of migration. We implemented the bank-and-forth live migration optimization methods in QEMU-KVM 2.0. The experiments show that the proposed methods can significantly reduce the overhead of migrations. The total migration time can be saved up to 99% for some applications.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130531135","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Garraghan, Yaser Al-Anii, J. Summers, H. Thompson, N. Kapur, K. Djemame
{"title":"A Unified Model for Holistic Power Usage in Cloud Datacenter Servers","authors":"P. Garraghan, Yaser Al-Anii, J. Summers, H. Thompson, N. Kapur, K. Djemame","doi":"10.1145/2996890.2996896","DOIUrl":"https://doi.org/10.1145/2996890.2996896","url":null,"abstract":"Cloud datacenters are compute facilities formed by hundreds and thousands of heterogeneous servers requiring significant power requirements to operate effectively. Servers are composed by multiple interacting sub-systems including applications, microelectronic processors, and cooling which reflect their respective power profiles via different parameters. What is presently unknown is how to accurately model the holistic power usage of the entire server when including all these sub-systems together. This becomes increasingly challenging when considering diverse utilization patterns, server hardware characteristics, air and liquid cooling techniques, and importantly quantifying the non-electrical energy cost imposed by cooling operation. Such a challenge arises due to the need for multi-disciplinary expertise required to study server operation holistically. This work provides a unified model for capturing holistic power usage within Cloud datacenter servers. Constructed through controlled laboratory experiments, the model captures the relationship of server power usage between software, hardware, and cooling agnostic of architecture and cooling type (air and liquid). An exciting prospect is the ability to quantify the amount of non-electrical power consumed through cooling, allowing for more realistic and accurate server power profiles. This work represents the first empirically supported analysis and modeling of holistic power usage for Cloud datacenter servers, and bridges a significant gap between computer science and mechanical engineering research. Model validation through experiments demonstrates an average standard error of 3% for server power usage within both air and liquid cooled environments.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"158 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116908528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Modelling and Managing Deployment Costs of Microservice-Based Cloud Applications","authors":"P. Leitner, Jürgen Cito, Emanuel Stöckli","doi":"10.1145/2996890.2996901","DOIUrl":"https://doi.org/10.1145/2996890.2996901","url":null,"abstract":"We present an approach to model the deployment costs, including compute and IO costs, of Microservice-based applications deployed to a public cloud. Our model, which we dubbed CostHat, supports both, Microservices deployed on traditional IaaS or PaaS clouds, and services that make use of novel cloud programming paradigms, such as AWS Lambda. CostHat is based on a network model, and allows for what-if and cost sensitivity analysis. Further, we have used this model to implement tooling that warns cloud developers directly in the Integrated Development Environment (IDE) about certain classes of potentially costly code changes. We illustrate our work based on a case study, and evaluate the CostHat model using a standalone Python implementation. We show that, once instantiated, cost calculation in CostHat is computationally inexpensive on standard hardware (below 1 ms even for applications consisting of thousand services and endpoints). This enables its use in real-time for developer tooling which continually re-evaluates the costs of an application in the background, while the developer is working on the code.","PeriodicalId":350701,"journal":{"name":"2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117021075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}