分布式存储系统中的高速柯西编解码器算法

Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering Pub Date : 2020-01-14 DOI:10.1145/3424311.3424313

Ruizhen Wu, Lin Wang, Yan Wu

{"title":"分布式存储系统中的高速柯西编解码器算法","authors":"Ruizhen Wu, Lin Wang, Yan Wu","doi":"10.1145/3424311.3424313","DOIUrl":null,"url":null,"abstract":"The erasure codes such as Reed-Solomon (RS) code and Cauchy Reed-Solomon (CRS) code have been widely used in distributed storage system. Though all the erasure codes are able to help recover the storage data successfully when errors happening, the computation cost of different Cauchy CODEC implementation makes a great impact to the performance of its practical application especially due to its complexity of generating the decoding matrix. This paper introduces a new high-speed Cauchy algorithm to construct an encoding algorithm based on the hardware implementation mechanism of decoding. In comparison to Gauss LU, GS-Cauchy, GS-direct-Cauchy for both decoding matrix generation and CODEC all through, the proposed algorithm requires much less complexities to gain the same performance of CRS.","PeriodicalId":330920,"journal":{"name":"Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering","volume":"163 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"A High-Speed Cauchy CODEC Algorithm for Distributed Storage System\",\"authors\":\"Ruizhen Wu, Lin Wang, Yan Wu\",\"doi\":\"10.1145/3424311.3424313\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The erasure codes such as Reed-Solomon (RS) code and Cauchy Reed-Solomon (CRS) code have been widely used in distributed storage system. Though all the erasure codes are able to help recover the storage data successfully when errors happening, the computation cost of different Cauchy CODEC implementation makes a great impact to the performance of its practical application especially due to its complexity of generating the decoding matrix. This paper introduces a new high-speed Cauchy algorithm to construct an encoding algorithm based on the hardware implementation mechanism of decoding. In comparison to Gauss LU, GS-Cauchy, GS-direct-Cauchy for both decoding matrix generation and CODEC all through, the proposed algorithm requires much less complexities to gain the same performance of CRS.\",\"PeriodicalId\":330920,\"journal\":{\"name\":\"Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering\",\"volume\":\"163 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-01-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3424311.3424313\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3424311.3424313","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 4

摘要

RS (Reed-Solomon)码和CRS (Cauchy Reed-Solomon)码等擦除码在分布式存储系统中得到了广泛的应用。虽然所有的纠删码都能在发生错误时成功地恢复存储数据，但不同的柯西编解码器实现的计算成本对其实际应用的性能影响很大，特别是由于其解码矩阵生成的复杂性。本文介绍了一种新的高速柯西算法，构建了一种基于解码硬件实现机制的编码算法。与高斯LU、GS-Cauchy、GS-direct-Cauchy的译码矩阵生成和编解码器相比，该算法在获得相同CRS性能的同时，复杂度大大降低。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

A High-Speed Cauchy CODEC Algorithm for Distributed Storage System

The erasure codes such as Reed-Solomon (RS) code and Cauchy Reed-Solomon (CRS) code have been widely used in distributed storage system. Though all the erasure codes are able to help recover the storage data successfully when errors happening, the computation cost of different Cauchy CODEC implementation makes a great impact to the performance of its practical application especially due to its complexity of generating the decoding matrix. This paper introduces a new high-speed Cauchy algorithm to construct an encoding algorithm based on the hardware implementation mechanism of decoding. In comparison to Gauss LU, GS-Cauchy, GS-direct-Cauchy for both decoding matrix generation and CODEC all through, the proposed algorithm requires much less complexities to gain the same performance of CRS.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Proceedings of the 2020 International Conference on Internet Computing for Science and Engineering

自引率

0.00%

发文量