Finding minimax codes for discrete and continuous classes of sources

Abstract

This paper suggests a signal processing method for finding the minimax codes which minimize the maximum redundancies over a class of sources with either a discrete or a continuous alphabet, and where relative entropy (cross entropy; discrimination information) is a criterion to measure the redundancy. A complexity analysis and numerical studies demonstrate the efficiency of the method.