{"title":"增强Hadoop over cloud环境下NameNode的容错能力","authors":"Lino Abraham Varghese, V. Sreejith, S. Bose","doi":"10.1109/ICOAC.2014.7229751","DOIUrl":null,"url":null,"abstract":"Risks on user applications has significantly changed in the cloud computing infrastructure because of the failures such as server overload, network congestion, hardware faults, etc. Hadoop uses a single metadata server namely NameNode (NN) which keeps the whole file system metadata in primary memory. In Hadoop, the I/O operations associated with those credential metadata makes NameNode a Single Point of Failure. The system achieves fault tolerance by using an Observer Tool, which will continuously monitor the NN. It proactively calculates chances of any crash and in such a case system will run using the secondary NN.","PeriodicalId":325520,"journal":{"name":"2014 Sixth International Conference on Advanced Computing (ICoAC)","volume":"12 6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Enhancing NameNode fault tolerance in Hadoop over cloud environment\",\"authors\":\"Lino Abraham Varghese, V. Sreejith, S. Bose\",\"doi\":\"10.1109/ICOAC.2014.7229751\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Risks on user applications has significantly changed in the cloud computing infrastructure because of the failures such as server overload, network congestion, hardware faults, etc. Hadoop uses a single metadata server namely NameNode (NN) which keeps the whole file system metadata in primary memory. In Hadoop, the I/O operations associated with those credential metadata makes NameNode a Single Point of Failure. The system achieves fault tolerance by using an Observer Tool, which will continuously monitor the NN. It proactively calculates chances of any crash and in such a case system will run using the secondary NN.\",\"PeriodicalId\":325520,\"journal\":{\"name\":\"2014 Sixth International Conference on Advanced Computing (ICoAC)\",\"volume\":\"12 6 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2014 Sixth International Conference on Advanced Computing (ICoAC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICOAC.2014.7229751\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 Sixth International Conference on Advanced Computing (ICoAC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICOAC.2014.7229751","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Enhancing NameNode fault tolerance in Hadoop over cloud environment
Risks on user applications has significantly changed in the cloud computing infrastructure because of the failures such as server overload, network congestion, hardware faults, etc. Hadoop uses a single metadata server namely NameNode (NN) which keeps the whole file system metadata in primary memory. In Hadoop, the I/O operations associated with those credential metadata makes NameNode a Single Point of Failure. The system achieves fault tolerance by using an Observer Tool, which will continuously monitor the NN. It proactively calculates chances of any crash and in such a case system will run using the secondary NN.