A linear-time algorithm that avoids inverses and computes Jackknife (leave-one-out) products like convolutions or other operators in commutative semigroups.

Abstract

Background: Data about herpesvirus microRNA motifs on human circular RNAs suggested the following statistical question. Consider independent random counts, not necessarily identically distributed. Conditioned on the sum, decide whether one of the counts is unusually large. Exact computation of the p-value leads to a specific algorithmic problem. Given $n$ elements $g_0,g_1,\dots ,g_{n-1}$ in a set $G$ with the closure and associative properties and a commutative product without inverses, compute the jackknife (leave-one-out) products ${\overline{g}}_j=g_0{g}_1\cdots g_{j-1}{g}_{j+1}\cdots g_{n-1}$ ( $0\le j<n$ ).

Results: This article gives a linear-time Jackknife Product algorithm. Its upward phase constructs a standard segment tree for computing segment products like $g_{\left(i,j\right)}=g_i{g}_{i+1}\cdots g_{j-1}$ ; its novel downward phase mirrors the upward phase while exploiting the symmetry of $g_j$ and its complement ${\overline{g}}_j$ . The algorithm requires storage for $2n$ elements of $G$ and only about $3n$ products. In contrast, the standard segment tree algorithms require about $n$ products for construction and ${log}_{2}n$ products for calculating each ${\overline{g}}_j$ , i.e., about $n{log}_{2}n$ products in total; and a naïve quadratic algorithm using $n-2$ element-by-element products to compute each ${\overline{g}}_j$ requires $n\left(n-2\right)$ products.

Conclusions: In the herpesvirus application, the Jackknife Product algorithm required 15 min; standard segment tree algorithms would have taken an estimated 3 h; and the quadratic algorithm, an estimated 1 month. The Jackknife Product algorithm has many possible uses in bioinformatics and statistics.