一种用于LZW数据压缩硬件实现的新的压缩比预测算法

Alireza Yazdanpanah, M. Hashemi
{"title":"一种用于LZW数据压缩硬件实现的新的压缩比预测算法","authors":"Alireza Yazdanpanah, M. Hashemi","doi":"10.1109/CADS.2010.5623592","DOIUrl":null,"url":null,"abstract":"As the demand for more data storage space continues to grow at an unprecedented pace, the need for real time data compression systems becomes more prominent. One of the well-known methods among lossless data compression algorithms is LZW. In this paper, a new prediction algorithm has been introduced that is able to predict whether or not a data block is compressible with the LZW method. Furthermore, the prediction algorithm provides a reasonably good estimation of the final compression ratio, hence helping the storage system decide early on whether or not to continue with the compression. Simulation results performed on several data compression corpuses indicate that the proposed prediction method is able to reduce run time by 17.79%, in average for a flash sector size of 8 KB. This is achieved at the expense of an average 1.59% decrease in compression performance. The difference between the predicted and actual compression ratio is 11.16% in average, in terms of mean absolute error. Considering the low computational complexity of the proposed method, it can be implemented with a relatively simple hardware hence making it suitable for real time, low-cost, and low-power hardware implementations.","PeriodicalId":145317,"journal":{"name":"2010 15th CSI International Symposium on Computer Architecture and Digital Systems","volume":"74 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2010-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"13","resultStr":"{\"title\":\"A new compression ratio prediction algorithm for hardware implementations of LZW data compression\",\"authors\":\"Alireza Yazdanpanah, M. Hashemi\",\"doi\":\"10.1109/CADS.2010.5623592\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the demand for more data storage space continues to grow at an unprecedented pace, the need for real time data compression systems becomes more prominent. One of the well-known methods among lossless data compression algorithms is LZW. In this paper, a new prediction algorithm has been introduced that is able to predict whether or not a data block is compressible with the LZW method. Furthermore, the prediction algorithm provides a reasonably good estimation of the final compression ratio, hence helping the storage system decide early on whether or not to continue with the compression. Simulation results performed on several data compression corpuses indicate that the proposed prediction method is able to reduce run time by 17.79%, in average for a flash sector size of 8 KB. This is achieved at the expense of an average 1.59% decrease in compression performance. The difference between the predicted and actual compression ratio is 11.16% in average, in terms of mean absolute error. Considering the low computational complexity of the proposed method, it can be implemented with a relatively simple hardware hence making it suitable for real time, low-cost, and low-power hardware implementations.\",\"PeriodicalId\":145317,\"journal\":{\"name\":\"2010 15th CSI International Symposium on Computer Architecture and Digital Systems\",\"volume\":\"74 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2010-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"13\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2010 15th CSI International Symposium on Computer Architecture and Digital Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CADS.2010.5623592\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2010 15th CSI International Symposium on Computer Architecture and Digital Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CADS.2010.5623592","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 13

摘要

随着对更多数据存储空间的需求以前所未有的速度持续增长,对实时数据压缩系统的需求变得更加突出。LZW是无损数据压缩算法中比较有名的一种方法。本文提出了一种新的预测算法,利用LZW方法预测数据块是否可压缩。此外,预测算法对最终压缩比提供了一个合理的估计,从而帮助存储系统及早决定是否继续压缩。在多个数据压缩语料库上进行的仿真结果表明,在flash扇区大小为8 KB的情况下,该预测方法平均可减少17.79%的运行时间。这是以压缩性能平均下降1.59%为代价的。在平均绝对误差方面,预测值与实际值的差值平均为11.16%。考虑到该方法的计算复杂度较低,因此可以使用相对简单的硬件实现,从而使其适合实时,低成本和低功耗的硬件实现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A new compression ratio prediction algorithm for hardware implementations of LZW data compression
As the demand for more data storage space continues to grow at an unprecedented pace, the need for real time data compression systems becomes more prominent. One of the well-known methods among lossless data compression algorithms is LZW. In this paper, a new prediction algorithm has been introduced that is able to predict whether or not a data block is compressible with the LZW method. Furthermore, the prediction algorithm provides a reasonably good estimation of the final compression ratio, hence helping the storage system decide early on whether or not to continue with the compression. Simulation results performed on several data compression corpuses indicate that the proposed prediction method is able to reduce run time by 17.79%, in average for a flash sector size of 8 KB. This is achieved at the expense of an average 1.59% decrease in compression performance. The difference between the predicted and actual compression ratio is 11.16% in average, in terms of mean absolute error. Considering the low computational complexity of the proposed method, it can be implemented with a relatively simple hardware hence making it suitable for real time, low-cost, and low-power hardware implementations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信