Implementing a self-development neural network using doubly linked lists

Abstract

A novel algorithm for dynamically adapting the size of neural networks is proposed. According to the measures to be defined, a neuron in the network will generate a new neuron when the variation of its weight vector is high (i.e. when it is not learned) and will be annihilated if it is not active for a long time. This algorithm is tested on a simple but popular neural network model, Self Organization Feature Map (SOFM), and implemented in software using a double linked list. Using this algorithm, one can initially put a set of seed neurons in the network and then let the network grow according to the training patterns. It is observed from the simulation results that the network will eventually grow to a configuration suitable to the class of problems characterized by the training patterns, i.e. the neural network synthesizes itself to fit the problem space.<>