Nonlinear Equalization for Optical Communications Based on Entropy-Regularized Mean Square Error

Abstract

An entropy-regularized mean square error (MSE-X) cost function is proposed for nonlinear equalization of short-reach optical channels. For a coherent optical transmission experiment, MSE-X achieves the same bit error rate as the standard MSE cost function and a significantly higher achievable information rate.