Adaptive parametric vector quantization by natural type selection

Abstract

We present a new adaptive mechanism for empirical "on-line" design of a vector quantizer codebook. The proposed scheme is based on the principle of "natural type selection" (NTS) (Zamir and Rose, 2001). The NTS principle implies that backward adaptation, i.e., adaptation directed by the past reconstruction rather than by the uncoded source sequence converges to an optimum rate-distortion codebook. We incorporate the NTS iteration step into a parametric encoder. We demonstrate that the codebook converges to an optimum rate-distortion solution within the associated parametric class. This new scheme does not suffer from the severe complexity at high dimensions of nonparametric solutions like the generalized Lloyd algorithm (GLA). Moreover, unlike existing parametric adaptive schemes (e.g., code-excited linear prediction (CELP)), this scheme is optimal even for low coding rates.