A Fast Learning Strategy for Multilayer Feedforward Neural Networks

This paper proposes a new training algorithm called bi-phases weights' adjusting (BPWA) for feedforward neural networks. Unlike BP learning algorithm, BPWA can adjust the weights during both forward phase and backward phase. The algorithm computes the minimum norm square solution as the weights between the hidden layer and output layer in the forward pass, while the backward pass, on the other hand, adjusts other weights in the network according to error gradient descent method. The experimental results based on function approximation and classification tasks show that new algorithm is able to achieve faster converging speed with good generalization performance when compared with the BP and Levenberg-Marquardt BP algorithm