Jongyeop Kim, Abhilash Kancharla, Jongho Seol, Indy Park, N. Park
{"title":"基于大数据平台多标杆应用的公共参数集提取框架优化","authors":"Jongyeop Kim, Abhilash Kancharla, Jongho Seol, Indy Park, N. Park","doi":"10.2991/IJNDC.2018.4.6.1","DOIUrl":null,"url":null,"abstract":"The Apache Hadoop Distributed File System (HDFS) [1] is one of the prominent engines as a big data processing framework [2] with its distributed processing capabilities over a cluster that composed of multiple nodes [3]. The core technology of this open source is called map and reduce, which is accomplished by appropriately splitting a big task into each node and merging it through inter process communication.","PeriodicalId":318936,"journal":{"name":"Int. J. Networked Distributed Comput.","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2018-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Optimized Common Parameter Set Extraction Framework by Multiple Benchmarking Applications on a Big Data Platform\",\"authors\":\"Jongyeop Kim, Abhilash Kancharla, Jongho Seol, Indy Park, N. Park\",\"doi\":\"10.2991/IJNDC.2018.4.6.1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The Apache Hadoop Distributed File System (HDFS) [1] is one of the prominent engines as a big data processing framework [2] with its distributed processing capabilities over a cluster that composed of multiple nodes [3]. The core technology of this open source is called map and reduce, which is accomplished by appropriately splitting a big task into each node and merging it through inter process communication.\",\"PeriodicalId\":318936,\"journal\":{\"name\":\"Int. J. Networked Distributed Comput.\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-09-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Int. J. Networked Distributed Comput.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2991/IJNDC.2018.4.6.1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Int. J. Networked Distributed Comput.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2991/IJNDC.2018.4.6.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
Apache Hadoop分布式文件系统(Hadoop Distributed File System, HDFS)[1]作为大数据处理框架的突出引擎之一[2],其在由多个节点组成的集群上具有分布式处理能力[3]。这个开放源代码的核心技术称为map and reduce,它通过将一个大任务适当地拆分到每个节点,并通过进程间通信将其合并来实现。
Optimized Common Parameter Set Extraction Framework by Multiple Benchmarking Applications on a Big Data Platform
The Apache Hadoop Distributed File System (HDFS) [1] is one of the prominent engines as a big data processing framework [2] with its distributed processing capabilities over a cluster that composed of multiple nodes [3]. The core technology of this open source is called map and reduce, which is accomplished by appropriately splitting a big task into each node and merging it through inter process communication.