{"title":"Leveraging on High-Performance Computing and Cloud Technologies in Digital Libraries: A Case Study","authors":"P. Wittek, Sándor Darányi","doi":"10.1109/CloudCom.2011.93","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.93","url":null,"abstract":"With the emergence of high-performance computing instances in the cloud, massive scale computations have become available to technically every organization. Digital libraries typically employ a data-intensive infrastructure, but given the resources, advanced services based on data and text mining could be developed. A fundamental issue is the ease of development and integration of such services. We demonstrate the feasibility by providing a case study on a visual machine learning algorithm with MapReduce running in the cloud in a small cluster.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124935241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"EQS: An Elastic and Scalable Message Queue for the Cloud","authors":"Nam-Luc Tran, S. Skhiri, E. Zimányi","doi":"10.1109/CloudCom.2011.59","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.59","url":null,"abstract":"With the emergence of cloud computing, on-demand resources usage is made possible. This allows applications to elastically scale out according to the load. One design pattern that suits this paradigm is the event-driven architecture (EDA) in which messages are sent asynchronously between distributed application instances using message queues. However, existing message queues are only able to scale for a certain number of clients and are not able to scale out elastically. We present the Elastic Queue Service (EQS), an elastic message queue architecture and a scaling algorithm which can be adapted to any message queue in order to make it scale elastically. EQS architecture is layered onto multiple distributed components and its management components can be integrated with the cloud infrastructure management. We have implemented a prototype of EQS and deployed it on a cloud infrastructure. A series of load testings have validated our elastic scaling algorithm and show that EQS is able to scale out in order to adapt to an applied load. We then discuss about the elastic scaling of the management layers of EQS and their possible integration with the cloud infrastructure management.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"361 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113998348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jesús Omana Iglesias, James Thorburn, T. Parsons, John Murphy, P. O'Sullivan
{"title":"Scoring System Utilization through Business Profiles","authors":"Jesús Omana Iglesias, James Thorburn, T. Parsons, John Murphy, P. O'Sullivan","doi":"10.1109/CloudCom.2011.71","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.71","url":null,"abstract":"Understanding system utilization is currently a difficult challenge for industry. Current monitoring tools tend to focus on monitoring critical servers and databases within a narrow technical context, and have not been designed to to manage extremely heterogeneous IT infrastructure such as desktops, laptops, and servers, where the number of devices can be in the order of tens of thousands. This is an issue for many different domains (organizations with large IT infrastructures, cloud computing providers, or software as a service providers) where an understanding of how computer hardware is being utilized is essential for understanding business cost, workload migrations and future investment requirements. Furthermore, organizations find it difficult to understand the raw metrics collected by current monitoring tools, in particular when trying to understand to what degree their systems are being utilized in the context of different business purposes. This paper presents different techniques for the extraction of meaningful resource utilization information from raw monitoring data, a utilization scoring algorithm, and then subsequently outlines a profile-based method for tracking the utilization of IT assets (systems) in large heterogeneous IT environments. We intend to determine how efficiently system resources are utilized considering their business use. We will provide to the end-user an assessment of the system utilization together with additional information to perform remedial action.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"98 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122608120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fast n-point Correlation Function Approximation with Recursive Convolution for Scalar Fields","authors":"Xiang Zhang, Ce Yu","doi":"10.1109/CloudCom.2011.98","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.98","url":null,"abstract":"In astrophysics, n-point Correlation Function (n-PCF) is an important tool for computation and analysis, but its algorithmic complex has long been a notorious problem. In this paper we are going to propose two algorithms that are easy to be parallized to compute the n-PCF problem efficiently. The algorithms are based on the definition of recursive convolution for scalar fields (RCSF), and it can be computed using varous fast Fourier Transform (FFT) algorithms in literature. Compared to traditional ways of dealing with this problem, our method is most efficient, for that it can achieve results with point sets as large as 1 billion in less than 1 minute. Moreover, the algorithms are intrinsically appropriate to be used on parallel computing environments such as computer clusters, multi-CPU/GPU super-computers, MapReduce and etc. Better computing environments can deal with better accuracy and time requirements.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121858221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"QoS-aware Deployment of Network of Virtual Appliances Across Multiple Clouds","authors":"A. V. Dastjerdi, S. Garg, R. Buyya","doi":"10.1109/CloudCom.2011.62","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.62","url":null,"abstract":"Cloud computing paradigm allows on-demand access to computing and storages services over the Internet. To solve the complexity of application deployment in Cloud infrastructure, virtual appliances, pre-configured, ready-to-run applications are emerging as a breakthrough technology. However, an automated approach for deploying network of appliances is required to guarantee minimum deployment cost, low latency, and high reliability. In this paper, we propose and compare two different deployment approaches: Forward-checking-based backtracking (FCBB) and genetic-based. They take into account Quality of Service (QoS) criteria such as reliability, data communication cost, and latency between multiple Clouds to choose the most appropriate combination of virtual machines and appliances. We evaluate our approach using a real case study and different request types. Experimental results show both algorithms reach near optimal solution. Further, we investigate effects of factors such as latency requirements, and data communication between appliances on the performance of the algorithms and placement of appliances across multiple Clouds.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114731422","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An OpenFlow Based Network Virtualization Framework for the Cloud","authors":"J. Matías, E. Jacob, David Sanchez, Y. Demchenko","doi":"10.1109/CloudCom.2011.104","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.104","url":null,"abstract":"The Cloud computing paradigm entails a challenging networking scenario. Due to the economy of scale, the Cloud is mainly supported by Data Center infrastructures. Therefore, virtualized environment manageability, seamless migration of virtual machines, inter-domain communication issues and scalability problems are some of the main concerns that should be addressed. A recently proposed abstract model is used as a reference for the Cloud computing architecture. This paper introduces a network virtualization framework for the Cloud based on this model. Accordingly, a proper abstraction of network elements (vhost, vnode and vlink) is defined in order to virtualize the physical infrastructure. Moreover, a novel Layer 2 network virtualization approach based on a new MAC addressing scheme is presented: we propose to build locally administered MAC addresses that hold context information, such as virtual operator, domain, node and host identifiers. In addition, implementation details are suggested, describing how the Open Flow technology can lead to an implementation of the proposed approach.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124828530","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Economic Energy Trading in Cloud Environments","authors":"Andreas Zinnen, T. Engel","doi":"10.1109/CloudCom.2011.70","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.70","url":null,"abstract":"Especially in times of heavy loads, cloud providers often have to outsource tasks to external clouds to fulfill service level agreements. Nevertheless, a cloud provider maximizes the company's benefit while running as many jobs as possible on the own hardware without going below a specific workload of the running processors. Since cloud providers will have to estimate the required energy in advance due to energy trading, they should aim for estimating maturely the optimal number of necessary processors for a future date and time. This paper presents a method for anticipating the optimal number of active processors and corresponding energy. In particular, this work analyzes the potential of Gaussian processes to estimate future jobs by considering statistical data. Based on the job number estimate, a second Gaussian process approximates the optimal number of processors for a future date allowing for economical energy trading. Finally, the paper optimizes the computing resources in clouds by applying earliest deadline first strategy.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123655515","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Efficiently Synchronizing Virtual Machines in Cloud Computing Environments","authors":"Shuntaro Tonosaki, H. Yamada, K. Kono","doi":"10.1109/CloudCom.2011.30","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.30","url":null,"abstract":"Infrastructure as a Service (IaaS), a form of cloud computing, is gaining attention for its ability to enable efficient server administration in dynamic workload environments. In such environments, however, updating the software stack or content files of virtual machines (VMs) is a time-consuming task, discouraging administrators from frequently enhancing their services and fixing security holes. This is because the administrator has to upload the whole new disk image to the cloud platform via the Internet, which is not yet fast enough that large amounts of data can be transferred smoothly. Although the administrator can apply only incremental updates directly to the running VMs, he or she has to carefully consider the type of update and perform operations on all the running VMs, such as application restarts and operating system reboots. This is a tedious and error-prone task. This paper presents a technique for synchronizing VMs with less time and lower administrative burden. We introduce the Virtual Disk Image Repository, which runs on the cloud platform and automatically updates the virtual disk image and the running VMs with only the incremental update information. We also show a mechanism that performs necessary operations on the running VM such as restarting server processes, based on the types of files that are updated. We implemented a prototype on Linux 2.6.31.14 and Amazon Elastic Compute Cloud. The experimental results show that our technique can synchronize VMs in an order-of-magnitude shorter time than the conventional disk-image-based VM cloning method. Although our system imposes about 30% overhead on the developer's environment, it imposes no observable overhead on public servers and correctly performs necessary operations to put updates into effect.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121952794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Orna Agmon Ben-Yehuda, Muli Ben-Yehuda, A. Schuster, Dan Tsafrir
{"title":"Deconstructing Amazon EC2 Spot Instance Pricing","authors":"Orna Agmon Ben-Yehuda, Muli Ben-Yehuda, A. Schuster, Dan Tsafrir","doi":"10.1145/2509413.2509416","DOIUrl":"https://doi.org/10.1145/2509413.2509416","url":null,"abstract":"Cloud providers possessing large quantities of spare capacity must either incentivize clients to purchase it or suffer losses. Amazon is the first cloud provider to address this challenge, by allowing clients to bid on spare capacity and by granting resources to bidders while their bids exceed a periodically changing spot price. Amazon publicizes the spot price but does not disclose how it is determined. By analyzing the spot price histories of Amazon's EC2 cloud, we reverse engineer how prices are set and construct a model that generates prices consistent with existing price traces. We find that prices are usually not market-driven as sometimes previously assumed. Rather, they are typically generated at random from within a tight price interval via a dynamic hidden reserve price. Our model could help clients make informed bids, cloud providers design profitable systems, and researchers design pricing algorithms.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130009667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Snow White Clouds and the Seven Dwarfs","authors":"S. Phillips, Vegard Engen, J. Papay","doi":"10.1109/CloudCom.2011.114","DOIUrl":"https://doi.org/10.1109/CloudCom.2011.114","url":null,"abstract":"With increasing availability of Cloud computing services, this paper addresses the challenge consumers of Infrastructure-as-a-Service (IaaS) have in determining which IaaS provider and resources are best suited to run an application that may have specific Quality of Service (QoS) requirements. Utilising application modelling to predict performance is an attractive concept, but is very difficult with the limited information IaaS providers typically provide about the computing resources. This paper reports on an initial investigation into using Dwarf benchmarks to measure the performance of virtualised hardware, conducting experiments on BonFIRE and Amazon EC2. The results we obtain demonstrate that labels such as 'small', 'medium', 'large' or a number of ECUs are not sufficiently informative to predict application performance, as one might expect. Furthermore, knowing the CPU speed, cache size or RAM size is not necessarily sufficient either as other complex factors can lead to significant performance differences. We show that different hardware is better suited for different types of computations and, thus, the relative performance of applications varies across hardware. This is reflected well by Dwarf benchmarks and we show how different applications correlate more strongly with different Dwarfs, leading to the possibility of using Dwarf benchmark scores as parameters in application models.","PeriodicalId":427190,"journal":{"name":"2011 IEEE Third International Conference on Cloud Computing Technology and Science","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121609048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}