并行文件系统中的小文件问题

2011 International Conference on Network Computing and Information Security Pub Date : 2011-05-14 DOI:10.1109/NCIS.2011.143

Xiuqiao Li, Bin Dong, Limin Xiao, Li Ruan, Yi Ding

{"title":"并行文件系统中的小文件问题","authors":"Xiuqiao Li, Bin Dong, Limin Xiao, Li Ruan, Yi Ding","doi":"10.1109/NCIS.2011.143","DOIUrl":null,"url":null,"abstract":"Parallel file systems suffer performance degradation of small files generated by many workloads. We provide the systematic analysis of the small files problem from aspects of both parallel file system architecture and workload characteristics. Based on the analysis, we discuss the deficiencies of current optimizations and propose several open questions and possible research directions to address the problem.","PeriodicalId":215517,"journal":{"name":"2011 International Conference on Network Computing and Information Security","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":"{\"title\":\"Small Files Problem in Parallel File System\",\"authors\":\"Xiuqiao Li, Bin Dong, Limin Xiao, Li Ruan, Yi Ding\",\"doi\":\"10.1109/NCIS.2011.143\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Parallel file systems suffer performance degradation of small files generated by many workloads. We provide the systematic analysis of the small files problem from aspects of both parallel file system architecture and workload characteristics. Based on the analysis, we discuss the deficiencies of current optimizations and propose several open questions and possible research directions to address the problem.\",\"PeriodicalId\":215517,\"journal\":{\"name\":\"2011 International Conference on Network Computing and Information Security\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2011-05-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"10\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2011 International Conference on Network Computing and Information Security\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NCIS.2011.143\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 International Conference on Network Computing and Information Security","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NCIS.2011.143","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 10

摘要

并行文件系统会因许多工作负载生成的小文件而导致性能下降。本文从并行文件系统架构和工作负载特性两个方面对小文件问题进行了系统分析。在此基础上，我们讨论了当前优化的不足之处，并提出了几个有待解决的问题和可能的研究方向。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Small Files Problem in Parallel File System

Parallel file systems suffer performance degradation of small files generated by many workloads. We provide the systematic analysis of the small files problem from aspects of both parallel file system architecture and workload characteristics. Based on the analysis, we discuss the deficiencies of current optimizations and propose several open questions and possible research directions to address the problem.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2011 International Conference on Network Computing and Information Security

自引率

0.00%

发文量