A New MNN's Training Method with Empirical Study

Abstract

Based on the thought of “to be expert in one aspect and good at many”, a new training method of modular neural network (MNN) is presented. The key point of this method is a subnet learns the neighbor data sets while fulfiling its main task : learning the objective data set. Both methodology and empirical study of this new method are presented. Two examples (static approximation and nonlinear dynamic system prediction) are tested to show the new method's effectiveness: average testing error is dramatically decreased compared to original algorithm..