{"title":"MapReduce在云计算中的应用","authors":"Gaizhen Yang","doi":"10.1109/IPTC.2011.46","DOIUrl":null,"url":null,"abstract":"Hadoop provides a sophisticated framework for cloud platform programmers, which, MapReduce is a programming model for large-scale data sets of parallel computing. By MapReduce distributed processing framework, we are not only capable of handling large-scale data, and can hide a lot of tedious details, scalability is also wonderful. This paper analyzes the Hadoop architecture and MapReduce Working principle, described how to perform a MapReduce job in the cloud platform, how to write Mapper and Reducer classes, and how to use the object, proposed a program based on the MapReduce framework that enables distributed programming, Comparison results show that use of MapReduce architecture simplifies distributed programming.","PeriodicalId":388589,"journal":{"name":"2011 2nd International Symposium on Intelligence Information Processing and Trusted Computing","volume":"45 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"27","resultStr":"{\"title\":\"The Application of MapReduce in the Cloud Computing\",\"authors\":\"Gaizhen Yang\",\"doi\":\"10.1109/IPTC.2011.46\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Hadoop provides a sophisticated framework for cloud platform programmers, which, MapReduce is a programming model for large-scale data sets of parallel computing. By MapReduce distributed processing framework, we are not only capable of handling large-scale data, and can hide a lot of tedious details, scalability is also wonderful. This paper analyzes the Hadoop architecture and MapReduce Working principle, described how to perform a MapReduce job in the cloud platform, how to write Mapper and Reducer classes, and how to use the object, proposed a program based on the MapReduce framework that enables distributed programming, Comparison results show that use of MapReduce architecture simplifies distributed programming.\",\"PeriodicalId\":388589,\"journal\":{\"name\":\"2011 2nd International Symposium on Intelligence Information Processing and Trusted Computing\",\"volume\":\"45 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-10-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"27\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2011 2nd International Symposium on Intelligence Information Processing and Trusted Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IPTC.2011.46\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 2nd International Symposium on Intelligence Information Processing and Trusted Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IPTC.2011.46","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The Application of MapReduce in the Cloud Computing
Hadoop provides a sophisticated framework for cloud platform programmers, which, MapReduce is a programming model for large-scale data sets of parallel computing. By MapReduce distributed processing framework, we are not only capable of handling large-scale data, and can hide a lot of tedious details, scalability is also wonderful. This paper analyzes the Hadoop architecture and MapReduce Working principle, described how to perform a MapReduce job in the cloud platform, how to write Mapper and Reducer classes, and how to use the object, proposed a program based on the MapReduce framework that enables distributed programming, Comparison results show that use of MapReduce architecture simplifies distributed programming.