2012 Seventh ChinaGrid Annual Conference最新文献

An Efficient Massive Data Processing Model in the Cloud -- A Preliminary Report 一种高效的云端海量数据处理模型——初步报告

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.21

Guigang Zhang, C. Li, Yong Zhang, Chunxiao Xing, Jijiang Yang

引用次数: 4

Energy-Aware Genetic Algorithms for Task Scheduling in Cloud Computing 云计算中任务调度的能量感知遗传算法

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/CHINAGRID.2012.15

Ying Chang-tian, Yu Jiong

引用次数: 32

A Consistent Backup Mechanism for Disaster Recovery that Using Container Based Virtualization 基于容器的虚拟化容灾一致性备份机制

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.10

Yida Xu, Hongliang Yu, Weimin Zheng

{"title":"A Consistent Backup Mechanism for Disaster Recovery that Using Container Based Virtualization","authors":"Yida Xu, Hongliang Yu, Weimin Zheng","doi":"10.1109/ChinaGrid.2012.10","DOIUrl":"https://doi.org/10.1109/ChinaGrid.2012.10","url":null,"abstract":"Today's businesses have relied much on system backup and disaster recovery, of which there are more and more products that based on various virtualization platforms, as the virtualization technologies kept developing. Container based virtualization, which is a kind of high efficiency virtualization technology, has great potential to support building more flexible backup and disaster recovery system on its platform. In this paper, we introduce a consistent backup mechanism for disaster recovery that using container based virtualization. First, we proposed the concept of consistent checkpoint which contains both memory and disk image at the backup point in time. Then, for backing up disk image, we use incremental backup method and a two-step aggressive backup process, in which production system and data backup can run at the same time, to deal with it. At last, we combine our disk backup method and the memory checkpoint function of virtualization platform together to accomplish the whole consistent checkpoint's backup. A prototype of our system, in which a non-volatile local buffer is introduced for both speed and reliability purpose, is implemented. And the experimental testing result shows that our system's running overhead to production system is sensible, especially the overhead can drop to only 0.5% when backup is done. Also by using our system, backup frequency of production system has the potential to reach over fifteen times per minute. All these can prove that our consistent backup mechanism is suitable for disaster recovery purpose in container based virtualization platform.","PeriodicalId":371382,"journal":{"name":"2012 Seventh ChinaGrid Annual Conference","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2012-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114835114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Web Service to Deliver Filtered RSS Items to a Mobile Application 将过滤后的RSS项目传递到移动应用程序的Web服务

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.8

Atul Sajjanhar, Ying Zhao

引用次数: 2

Sampling-Based Partitioning in MapReduce for Skewed Data MapReduce中基于抽样的倾斜数据分区

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.18

Yujie Xu, Peng Zou, W. Qu, Zhiyang Li, Keqiu Li, Xiaoli Cui

{"title":"Sampling-Based Partitioning in MapReduce for Skewed Data","authors":"Yujie Xu, Peng Zou, W. Qu, Zhiyang Li, Keqiu Li, Xiaoli Cui","doi":"10.1109/ChinaGrid.2012.18","DOIUrl":"https://doi.org/10.1109/ChinaGrid.2012.18","url":null,"abstract":"MapReduce, as a popular tool for distributed and scalable processing of voluminous data, has been used in many areas. However, it is not efficient when handing skewed data, since it only considers the key and adopts a uniform hash method to distribute the workload to each reducer, while ignores the key's distribution. This can lead to load imbalance, increase the processing time, generate the \"straggler\" and the final result is the performance degradation. The current approach to solve this problem usually adopts the asynchronous Map and Reduce to gather the distribution of keys' frequencies and make a partition scheme in advance, but it will cost too much waiting time. In this paper, we address the problem of how to efficiently and effectively partition the intermediate key to balance the load of each reducer when skewed data exists. We use a sampling MapReduce job to gather the distribution of keys'frequencies, estimate the overall distribution and make a partition scheme in advance. Then, we apply it to the map phase of the expected MapReduce job. This design not only provides a load-balanced partition scheme, but also keeps the high performance of synchronous mode in MapReduce. We also propose two partition schemes based on the sampling results in this paper: cluster combination optimization and cluster partition combination. The experimental results show that the first partition scheme is suitable for the data set that has a lighter skew, while cluster partition combination has a greater time and load balancing advantage when the data skew is heavier.","PeriodicalId":371382,"journal":{"name":"2012 Seventh ChinaGrid Annual Conference","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2012-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129835855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 32

Behavioral Compatibility Analysis for Context-independent Service Substitution 上下文无关的服务替换的行为兼容性分析

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.33

Jun Jin, Jingjing Hu, Yuanda Cao, Jingxia Wang

引用次数: 3

An Improved Web Service Recommendation and Consumption Approach 改进的Web服务推荐和使用方法

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.31

Yueming Zhu, Ruisheng Zhang, Rongjing Hu, Zhili Zhao, Jiazao Lin, Shuyi Zhang

引用次数: 0

Applying Multi-cell MD Method to Shared-Memory Multi-core Systems 多单元MD方法在共享内存多核系统中的应用

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.34

Myongchan Kim, Shucai Yao, Gwang-Ung Go

引用次数: 0

Parallelization Mechanisms of Neighbor-Joining for CUDA Enabled Devices 支持CUDA设备的邻居连接并行化机制

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.32

Ran Zheng, Qiongyao Zhang, Hai Jin, Zhiyuan Shao, Xiaowen Feng

引用次数: 3

Multiple DAGs Scheduling Based on Lowest Transportation and Completion Time Algorithm on the Cloud 云环境下基于最低运输和完成时间算法的多dag调度

2012 Seventh ChinaGrid Annual Conference Pub Date : 2012-09-20 DOI: 10.1109/ChinaGrid.2012.7

Fengbo Ren, Jiong Yu

引用次数: 4