MSR Codes With Linear Field Size and Smallest Sub-Packetization for Any Number of Helper Nodes

Abstract

An $(n, k, \ell)$ array code has k information coordinates and $r = n - k$ parity coordinates, where each coordinate is a vector in $\mathbb {F}_{q}^{\ell }$ for some finite field $\mathbb {F}_{q}$ . An $(n, k, \ell)$ MDS array code has the additional property that any k out of n coordinates suffice to recover the whole codeword. Dimakis et al. considered the problem of repairing the erasure of a single coordinate and proved a lower bound on the amount of data transmission that is needed for the repair. A minimum storage regenerating (MSR) code with repair degree d is an MDS array code that achieves this lower bound for the repair of any single erased coordinate from any d out of $n-1$ remaining coordinates. An MSR code has the optimal access property if the amount of accessed data is the same as the amount of transmitted data in the repair procedure. The sub-packetization $\ell $ and the field size q are of paramount importance in MSR code constructions. For optimal-access MSR codes, Balaji et al. proved that $\ell \geq s^{\left \lceil {{ n/s }}\right \rceil }$ , where $s = d-k+1$ . Rawat et al. showed that this lower bound is attainable for all admissible values of d when the field size is exponential in n. After that, tremendous efforts have been devoted to reducing the field size. However, so far, reduction to a linear field size is only available for $d\in \{k+1,k+2,k+3\}$ and $d=n-1$ . In this paper, we construct the first class of explicit optimal-access MSR codes with the smallest sub-packetization $\ell = s^{\left \lceil {{ n/s }}\right \rceil }$ for all d between $k+1$ and $n-1$ , resolving an open problem in the survey (Ramkumar et al., Foundations and Trends in Communications and Information Theory: Vol. 19: No. 4). We further propose another class of explicit MSR code constructions (not optimal-access) with an even smaller sub-packetization $s^{\left \lceil {{ n/(s+1)}}\right \rceil }$ for all admissible values of d, making significant progress on another open problem in the survey. Previously, MSR codes with $\ell =s^{\left \lceil {{ n/(s+1)}}\right \rceil }$ and $q=O(n)$ were only known for $d=k+1$ and $d=n-1$ . The key insight that enables a linear field size in our construction is to reduce $\binom {n}{r}$ global constraints of non-vanishing determinants to $O_{s}(n)$ local ones, which is achieved by carefully designing the parity check matrices.