块级增量备份与Brotli压缩

Sminu Paul, Sumayya K.A, J. P. Abraham
{"title":"块级增量备份与Brotli压缩","authors":"Sminu Paul, Sumayya K.A, J. P. Abraham","doi":"10.1109/ICCSDET.2018.8821114","DOIUrl":null,"url":null,"abstract":"Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.","PeriodicalId":157362,"journal":{"name":"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)","volume":"2008 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Block Level Incremental Backup With Brotli Compression\",\"authors\":\"Sminu Paul, Sumayya K.A, J. P. Abraham\",\"doi\":\"10.1109/ICCSDET.2018.8821114\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.\",\"PeriodicalId\":157362,\"journal\":{\"name\":\"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)\",\"volume\":\"2008 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCSDET.2018.8821114\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCSDET.2018.8821114","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

块级增量备份是一种数据的连续副本只包含自上次备份以来已更改的部分的备份。它只备份文件中已更改的块。现有的备份系统大多采用文件级备份,占用大量的存储空间。现有的块级增量备份算法包括' rsync '与MD5哈希函数一起工作。哈希函数计算困难,并且占用存储哈希表的内存。该方法使用位映射来识别被修改的块。位映射比哈希表占用的空间更小,而且不需要过多的计算。此外,可以使用“brotli”压缩来重用为每个备份占用的存储空间。Brotli是一种数据格式规范,用于使用通用LZ77无损压缩算法和霍夫曼编码的特定组合压缩数据流。Brotli与CPU类型、操作系统、文件系统和字符集无关。与gzip、LZMA等现有的压缩技术相比,它具有更高的压缩比和更快的解压缩速度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Block Level Incremental Backup With Brotli Compression
Block level incremental backup is one in which successive copies of the data contain only the portion that has been changed since the preceding backup. It backs up only the blocks within the file that was changed. Most of the existing backup system perform file level backup which takes up lot of storage space. Existing block level incremental backup algorithm including ‘rsync’ works with MD5 hash function. Hash functions are difficult to calculate and also take memory for storing hash table. The proposed method uses bit map to identify block that was modified. Bit map takes less space than that of hash table moreover it does not need excessive computation. Furthermore ‘brotli’ compression can be used to reuse the storage space taken for each backup. Brotli is a data format specification for data streams compressed with a specific combination of the general-purpose LZ77 lossless compression algorithm and Huffman coding. Brotli is independent of CPU type, operating system, file system, and character set. It has higher compression ratio and decompresses quickly when com-pared with other existing compression techniques like gzip, LZMA, etc.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信