Behaviors of transform domain backpropagation (BP) algorithm

Several discrete orthogonal transforms have been used to study the behaviors of transform-domain backpropagation (BP) algorithms. Two examples of computer simulation show that, on selecting the appropriate parameters and the suitable structures of a neural network, the performance of the transform-domain BP algorithm is somewhat better than that of the original time-domain BP algorithm, regardless of which discrete orthogonal transform is applied. Among the transforms that have been used, the behaviors of the discrete cosine transform (DCT) and an alternative version of it are believed to be the best.<>