Bounds on achievable convergence rates of parameter estimators via universal coding

Abstract

Lower bounds on achievable convergence rates of parameter estimators towards the true parameter, are derived via universal coding considerations. It is shown that for a parametric class of sources, if there exists a universal lossless code whose redundancy decays sufficiently rapidly, then it induces a limitation on the fastest achievable convergence rate of any parameter estimator, at any value of the true parameter, with a possible exception of a vanishingly small subset of parameter values.<>