Takahiro Hirofuchi, H. Nakada, S. Itoh, S. Sekiguchi
{"title":"Reactive consolidation of virtual machines enabled by postcopy live migration","authors":"Takahiro Hirofuchi, H. Nakada, S. Itoh, S. Sekiguchi","doi":"10.1145/1996121.1996125","DOIUrl":"https://doi.org/10.1145/1996121.1996125","url":null,"abstract":"Dynamic consolidation of virtual machines (VMs) through live migration is a promising technology for IaaS datacenters. VMs are dynamically packed onto fewer server nodes, thereby eliminating excessive power consumption. Existing studies on VM consolidation, however, are based on precopy live migration, which requires dozens of seconds to switch the execution hosts of VMs. It is difficult to optimize VM locations quickly on sudden load changes, resulting in serious violations of VM performance criteria. In this paper, we propose an advanced VM consolidation system exploiting postcopy live migration, which greatly alleviates performance degradation. VM locations are reactively optimized in response to ever-changing resource usage. Sudden overloading of server nodes are promptly resolved by quickly switching the execution hosts of VMs. We have developed a prototype of our consolidation system and evaluated its feasibility through experiments. Our results show that our consolidation system achieved a higher degree of performance assurance than using precopy migration. Performance degradation is 12% or less, even for memory-intensive workloads, which is less than half the level using precopy migration.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134386955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Challenges in supporting virtual infrastructures in the cloud","authors":"Dongyan Xu","doi":"10.1145/1996121.1996127","DOIUrl":"https://doi.org/10.1145/1996121.1996127","url":null,"abstract":"Infrastructure-as-a-Service (IaaS) is one of the main paradigms of cloud computing, where virtual infrastructures -- individual virtual machines (VMs) or mutually isolated networks of VMs -- are created in datacenters for cloud users. In this talk, I will discuss a number of research challenges in supporting virtual infrastructures in the cloud, in the aspects of performance, reliability, and security. I will then report our recent efforts in (1) optimizing VM network transport performance and (2) supporting virtual networked infrastructure reliability in datacenters. In the first effort, we propose and instantiate the methodology of protocol responsibility offloading to mitigate the impact of VM consolidation on VM TCP transport throughput. In the second effort, we develop a technique that takes live, distributed snapshots of virtual networked infrastructures for future recovery or replay. I will present both network-level and application-level evaluation results to demonstrate the effectiveness of our solutions.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114367506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Merritt, Vishakha Gupta, Abhishek Verma, Ada Gavrilovska, K. Schwan
{"title":"Shadowfax: scaling in heterogeneous cluster systems via GPGPU assemblies","authors":"A. Merritt, Vishakha Gupta, Abhishek Verma, Ada Gavrilovska, K. Schwan","doi":"10.1145/1996121.1996124","DOIUrl":"https://doi.org/10.1145/1996121.1996124","url":null,"abstract":"Systems with specialized processors such as those used for accel- erating computations (like NVIDIA's graphics processors or IBM's Cell) have proven their utility in terms of higher performance and lower power consumption. They have also been shown to outperform general purpose processors in case of graphics intensive or high performance applications and for enterprise applications like modern financial codes or web hosts that require scalable image processing. These facts are causing tremendous growth in accelerator-based platforms in the high performance domain with systems like Keeneland, supercomputers like Tianhe-1, RoadRunner and even in data center systems like Amazon's EC2.\u0000 The physical hardware in these systems, once purchased and assembled, is not reconfigurable and is expensive to modify or upgrade. This can eventually limit applications' performance and scalability unless they are rewritten to match specific versions of hardware and compositions of components, both for single nodes and for clusters of machines. To address this problem and to support increased flexibility in usage models for CUDA-based GPGPU applications, our research proposes GPGPU assemblies, where each assembly combines a desired number of CPUs and CUDA-supported GPGPUs to form a 'virtual execution platform' for an application. System-level software, then, creates and manages assemblies, including mapping them seamlessly to the actual cluster- and node- level hardware resources present in the system. Experimental evaluations of the initial implementation of GPGPU assemblies demonstrates their feasibility and advantages derived from their use.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"164 ","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113987576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
André Bögelsack, M. Homann, Holger Wittges, H. Krcmar
{"title":"Performance of SAP ERP with memory virtualization using IBM active memory expansion as an example","authors":"André Bögelsack, M. Homann, Holger Wittges, H. Krcmar","doi":"10.1145/1996121.1996128","DOIUrl":"https://doi.org/10.1145/1996121.1996128","url":null,"abstract":"Main memory virtualization is used to expand the effective main memory capacity meaning that more virtual main memory is represented to guest operating systems than physical memory is actually available. This is done by compressing and uncompressing memory pages. Obviously the price for main memory virtualization is a higher CPU utilization, especially when dealing with high workloads. SAP ERP systems represent the backbone of today's enterprises and have a very high resource demand. The combination of main memory virtualization and SAP ERP system is of great importance but has not yet been thoroughly researched. This paper is the first approach to a quantitative research for evaluating the performance impact of memory virtualization on SAP ERP systems. We utilize a synthetic main memory benchmark, called Zachmanntest, to evaluate the performance impact of main memory virtualization on a SAP ERP system. As an exemplary main memory virtualization implementation IBM's Active Memory Expansion is used, where a so called expansion factor can be used to specify the size of the virtual main memory. Performance results show that the greater the expansion factor, the greater the performance impact. Regarding the peak performance, throughput of SAP ERP systems may be decreased till -17%, whereas the overall throughput of such systems may experience a decrease up to -42% when dealing with a very high compression factor.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134465912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Toward dependency-aware live virtual machine migration","authors":"Anthony E. Nocentino, P. Ruth","doi":"10.1145/1555336.1555347","DOIUrl":"https://doi.org/10.1145/1555336.1555347","url":null,"abstract":"The most powerful characteristic of any machine virtualization technology is its ability to adapt to both its underlying infrastructure and the applications it supports. Possibly the most dynamic feature of machine virtualization is the ability to migrate live virtual machines between physical hosts in order to optimize performance or avoid catastrophic events. Unfortunately, the need for live migration increases during times when resources are most scarce. For example, load-balancing is only necessary when load is significantly unbalanced and impending downtime often causes many virtual machines to seek new hosts simultaneously. It is imperative that live migration mechanisms be as fast and efficient as possible in order for virtualization to provide dynamic load balancing, zero-downtime scheduled maintenance, and automatic failover during unscheduled downtime.\u0000 This paper proposes a novel dependency-aware approach to live virtual machine migration and presents the results of the initial investigation into its ability to reduce migration latency and overhead. The approach uses a tainting mechanism originally developed as an intrusion detection mechanism. Dependency information is used to distinguish processes that create direct or indirect external dependencies during live migration. It is shown that the live migration process can be significantly streamlined by selectively applying a more efficient protocol when migrating processes that do not create external dependencies during migration.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127696094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Juan C. Martinez, Lixi Wang, Ming Zhao, S. Masoud Sadjadi
{"title":"Experimental study of large-scale computing on virtualized resources","authors":"Juan C. Martinez, Lixi Wang, Ming Zhao, S. Masoud Sadjadi","doi":"10.1145/1555336.1555343","DOIUrl":"https://doi.org/10.1145/1555336.1555343","url":null,"abstract":"Parallel applications have a pressing need for the utilization of more and more resources to meet user's performance expectations. Unfortunately, these resources are not necessarily available within one single domain. Grid computing provides a solution to scaling out from a single domain; however, it also brings another problem for some applications: resource heterogeneity. Since some applications require having homogeneous resources for their execution, virtualizing the resources is a noble and viable solution.\u0000 In this paper, we present two parallel applications, namely WRF and mpiBLAST and report the results of different runs scaling them out from 2 to 128 virtual nodes. Later, we analyze the effects of scaling out based on the application's communication behavior.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131041927","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Takahiro Hirofuchi, H. Nakada, Hirotaka Ogawa, S. Itoh, S. Sekiguchi
{"title":"A live storage migration mechanism over wan and its performance evaluation","authors":"Takahiro Hirofuchi, H. Nakada, Hirotaka Ogawa, S. Itoh, S. Sekiguchi","doi":"10.1145/1555336.1555348","DOIUrl":"https://doi.org/10.1145/1555336.1555348","url":null,"abstract":"Live migration of virtual machines is a key technology for the next generation of IaaS cloud services, contributing to dynamic portability and mobility of VM-based services among datacenters. The practical use of live migration, however, is still limited inside a single datacenter. In WAN environments, network latencies cause inevitable I/O performance degradation of remotely-shared storage between source and destination sites; which is required to continue disk access of VMs before/after live migration. In our previous work, we proposed a transparent, relocatable I/O mechanism for VM migration, which enables VM disk images to be completely migrated to remote nodes without any modification of virtual machine monitors. In this paper, we present detailed performance evaluation of the proposed system, emulating a realistic WAN environment between remote datacenters. Experiments showed the proposed system achieved feasible I/O performance for various workloads including I/O intensive applications. Its background copy mechanism efficiently prefetches not-yet-cached blocks by exploiting the available bandwidth of WAN, thereby minimizing temporary performance degradation of the migrating VM system.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124766972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards a uniform self-configuring virtual private network for workstations and clusters in grid computing","authors":"D. Wolinsky, Yonggang Liu, R. Figueiredo","doi":"10.1145/1555336.1555340","DOIUrl":"https://doi.org/10.1145/1555336.1555340","url":null,"abstract":"The rising popularity of grid computing makes the issues of growth, security, and access critical in deploying and maintaining well-functioning grid systems. Overlay networks (ON)provide a framework to deal with these issues, but current techniques impose limitations and administrative burdens such as manual configuration for each new system in the grid, installation and configuration of software. Additionally, current approaches lack methods of effectively merging clusters with individual workstations, usually focusing on either the grouping of distributed clusters or a desktop/workstation Grid. The main difference between the two scenarios is that in a cluster environment all machines share a common ON router, whereas in a workstation environment each machine has ON software.\u0000 This paper presents a novel approach of self-configuring IP-based Virtual Private Networks (VPNs)1 overlays that support dynamic, seamless addition of new resources to the grid for both cluster and workstation platforms. The approach allows for bridging physical and virtual networking in clusters, in a manner that allows dynamic configuration of IP addresses while avoiding overlay routing among nodes within the same layer 2 network. To enable these features, the ON runs on top of a Peer-To-Peer (P2P) network that provides supports a distributed data store. IP addresses are dynamically allocated by a virtual DHCP server controlled by the ON router through atomic operations on the distributed data store. This atomic operation creates a mapping of an IP address to a P2P address that can later be used by the VPN and router to determine the host of an IP address. We have prototyped this approach, demonstrating the ability to seamlessly mix both workstation and cluster based approaches into a wide-area Condor pool.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122150677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Konstantinou, T. Eilam, M. Kalantar, Alexander Totok, William C. Arnold, E. Snible
{"title":"An architecture for virtual solution composition and deployment in infrastructure clouds","authors":"A. Konstantinou, T. Eilam, M. Kalantar, Alexander Totok, William C. Arnold, E. Snible","doi":"10.1145/1555336.1555339","DOIUrl":"https://doi.org/10.1145/1555336.1555339","url":null,"abstract":"The combination of virtual server technology and the Infrastructure-as-a-Service (IaaS) approach to utility computing promises to revolutionize the way in which distributed software services are deployed. Server virtualization technology can be used to capture complete reusable software stacks, shifting the complexity of middleware installation and configuration from deployment to packaging. IaaS clouds provide a set of interfaces for controlling virtual machines and configuring their hardware and network environment, substantially reducing the complexity of service provisioning. In this paper we identify and tackle a few of the remaining challenges in fulfilling the promise of radical simplification of distributed software service composition and deployment. We propose an approach and architecture for composition and deployment of virtual software services in cloud environments. We introduce a virtual appliance model which treats virtual images as building blocks for composite solutions. Virtual appliances use a port abstraction to negotiate their communication parameters. A solution architect creates a virtual solution model by composing virtual appliances and defining requirements on the environment in a cloud-independent manner. The virtual solution model is transformed to a cloud-specific virtual solution deployment model used to generate a parameterized deployment plan that can be executed by an unskilled user. We validated our approach through a prototype implementation demonstrating flexible composition and automated deployment in our local lab virtualization infrastructure and in Amazon EC2.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"206 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128225018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving the live migration process of large enterprise applications","authors":"S. Hacking, B. Hudzia","doi":"10.1145/1555336.1555346","DOIUrl":"https://doi.org/10.1145/1555336.1555346","url":null,"abstract":"Recent developments in virtualisation technology have resulted in its proliferation of usage across datacentres. Ultimately, the goal of this technology is to more efficiently utilise server resources to reduce Total Cost of Ownership (TCO) by abstracting hardware and consolidating servers. This results in lower equipment costs and less electrical consumption for server power and cooling. However, the TCO benefits of holistic virtualisation extend beyond server assets. One of these aspects relates to the ability of being able to migrate Virtual Machines (VM) across distinct physical hosts over a network. However, limitations of the current migration technology start to appear when they are applied on larger application systems such as SAP ERP or SAP ByDesign. Such systems consume a large amount of memory and cannot be transferred as seamlessly as smaller ones, creating service interruption. Limiting the impact and optimising migration becomes even more important with the generalisation of Service Level Agreement (SLA). In this document we present our design and evaluation of a system that enables live migration of VMs running large enterprise applications without severely disrupting their live services, even across the Internet. By combining well-known techniques and innovative ones we can reduce system down-time and resource impact for migrating live, large Virtual Execution Environments.","PeriodicalId":176127,"journal":{"name":"Virtualization Technologies in Distributed Computing","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124711358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}