Yongen Yu, Hongbo Zou, Wei Tang, Liwei Liu, Fei Teng
{"title":"Flex Tuner: A Flexible Container-Based Tuning System for Cloud Applications","authors":"Yongen Yu, Hongbo Zou, Wei Tang, Liwei Liu, Fei Teng","doi":"10.1109/IC2E.2015.24","DOIUrl":"https://doi.org/10.1109/IC2E.2015.24","url":null,"abstract":"With the rapid growth of dataset, more and more traditional applications turn into big data applications running on cloud platforms. This trend has continued, and even accelerated. Compared with traditional applications, big data applications spend lots of time to transfer data among computing nodes. Hence, the communication optimization is a must for big data applications. Network topology and routing algorithm of the underlying system are two major factors in determining the communication performance of big data applications. Once the system is deployed, the network topology is fixed and static or dynamic routing protocols are preinstalled. Users cannot change them. Therefore, it is hard for application developers to identify the optimal network configuration for their applications with distinct communication patterns. In this study, we design a flexible container-based tuning system (Flex Tuner) allowing users to create a farm of lightweight virtual machines (containers) on host machines. In addition, we use software-defined networking (SDN) technique to connect and direct the network traffic among these containers. Users can soft-tune the network topology and network traffic of the Flex Tuner, thereby enabling application developers to analyze their applications on the same system with different network configuration. The preliminary experimental results have shown that Flex Tuner can represent application performance variations caused by network topology and routing algorithm. Case studies through both synthetic big data programs and benchmarks have indicated that Flex Tuner enables researchers to analyze the communication cost of their big data applications and to find the suitable network topology and routing algorithm.","PeriodicalId":395715,"journal":{"name":"2015 IEEE International Conference on Cloud Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131180904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
I. Jimenez, C. Maltzahn, A. Moody, K. Mohror, J. Lofstead, Remzi H. Arpaci-Dusseau, A. Arpaci-Dusseau
{"title":"The Role of Container Technology in Reproducible Computer Systems Research","authors":"I. Jimenez, C. Maltzahn, A. Moody, K. Mohror, J. Lofstead, Remzi H. Arpaci-Dusseau, A. Arpaci-Dusseau","doi":"10.1109/IC2E.2015.75","DOIUrl":"https://doi.org/10.1109/IC2E.2015.75","url":null,"abstract":"Evaluating experimental results in the field of computer systems is a challenging task, mainly due to the many changes in software and hardware that computational environments go through. In this position paper, we analyze salient features of container technology that, if leveraged correctly, can help reduce the complexity of reproducing experiments in systems research. We present a use case in the area of distributed storage systems to illustrate the extensions that we envision, mainly in terms of container management infrastructure. We also discuss the benefits and limitations of using containers as a way of reproducing research in other areas of experimental systems research.","PeriodicalId":395715,"journal":{"name":"2015 IEEE International Conference on Cloud Engineering","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126803187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Smart Packet: Re-distributing the Routing Intelligence among Network Components in SDNs","authors":"R. F. Moghaddam, M. Cheriet","doi":"10.1109/IC2E.2015.44","DOIUrl":"https://doi.org/10.1109/IC2E.2015.44","url":null,"abstract":"In this work, a new region-based, multipath-enabled packet routing is presented and called Smart Packet Routing. The proposed approach provides several opportunities to re-distribute the smartness and decision making among various elements of a network including the packets themselves toward providing a decentralized solution for SDNs. This would bring efficiency and scalability, and therefore also lower environmental footprint for the ever-growing networks. In particular, a region-based representation of the network topology is proposed which is then used to describe the routing actions along the possible paths for a packet flow. In addition to a region stack that expresses a partial or full regional path of a packet, QoS requirements of the packet (or its associated flow) is considered in the packet header in order to enable possible QoS-aware routing at region level without requiring a centralized controller.","PeriodicalId":395715,"journal":{"name":"2015 IEEE International Conference on Cloud Engineering","volume":"115 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133793667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"How to Enhance Cloud Architectures to Enable Cross-Federation: Towards Interoperable Storage Providers","authors":"M. Fazio, A. Celesti, M. Villari, A. Puliafito","doi":"10.1109/IC2E.2015.80","DOIUrl":"https://doi.org/10.1109/IC2E.2015.80","url":null,"abstract":"Small/medium cloud storage providers can hardly compete with the biggest cloud players such as Google, Amazon, Dropbox, etc. As a consequence, the cloud storage market depends on such mega-providers and each small/medium provider cannot face alone the challenge of Big Data storage. A possible solution consists in establishing stronger partnerships among small-medium providers where they can borrow/lend resources each other, according to the rules of the federated cloud ecosystem they belong to. According to such an approach, the challenge consists in creating federated cloud ecosystems able to compete with mega-provides and one of the major problems for the achievement of such an ecosystem is the management of inter-domain communications. In this paper, we propose an architecture addressing such an issue. In particular, we present and test a solution integrating the CLEVER Message Oriented Middleware (MOM) with the Hadoop Distribute File System (HDFS), i.e., one of the major massive storage solutions currently available on the market.","PeriodicalId":395715,"journal":{"name":"2015 IEEE International Conference on Cloud Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129252230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}