A Dynamic Migration Method for Big Data in Cloud

Big data applications store data sets through sharing data center under the Cloud computing environment, but the need of data set in big data applications is dynamic change over time. In face of multiple data centers, such applications meet new challenges in data migration which mainly include how to how to reduce the number of network access, how to reduce the overall time consumption, and how to improve the efficiency by the time of balancing the global load in the migration process. Facing these challenges, we first build the problem model and descript the dynamic migration method, then solve the global time consumption of data migration, the number of network access and global load balancing these three parameters. Finally, do the cloud computing simulation experiment under the Cloudsim experiment platform. The result shows that the proposed method makes the task completion time reduced by 10% and the data transmission time accounts for the roportion of the total time is reduced. When the amount of data sets is increase, the proportion can reduces to 50% or less. Network access number lower than Zipf and reached stable, in global load, the variance of the node's store space closed to zero.