{"title":"块级增量备份与Brotli压缩","authors":"Sminu Paul, Sumayya K.A, J. P. Abraham","doi":"10.1109/ICCSDET.2018.8821114","DOIUrl":null,"url":null,"abstract":"Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.","PeriodicalId":157362,"journal":{"name":"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)","volume":"2008 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Block Level Incremental Backup With Brotli Compression\",\"authors\":\"Sminu Paul, Sumayya K.A, J. P. Abraham\",\"doi\":\"10.1109/ICCSDET.2018.8821114\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.\",\"PeriodicalId\":157362,\"journal\":{\"name\":\"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)\",\"volume\":\"2008 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCSDET.2018.8821114\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCSDET.2018.8821114","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Block Level Incremental Backup With Brotli Compression
Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.