Each Role of Short-term and Long-term Memory in Neural Networks

Abstract

Based on known functions of neuroscience the neural network that performs serial parallel conversion and its inverse transformation is presented. By hierarchy connecting the neural networks, the upper neural network that can process general time sequence data is constructed. The activity of the upper neural networks changes in response to the context structure inherent in the time series data and have both function of accepting and generating of general time series data. Eating behavior in animals in the early stages of evolution is also processing time series data, and it is possible to predict behavior although be limited short term by learning the contextual structure inherent in time series data. This function is the behavior of so-called short-term memory. Transition of the activation portion in this type of operation is illustrated. Although status of nervous system of the animal change according to the recognition by sensory organ and to the manipulation of the object by muscle in the vicinity of the animal itself, the evolved animals have in addition another nervous system so-called long-term memory or episodic memory being involved experience and prediction. The nervous system of long-term memory behaves freely but keeping consistency of the change in the environment. By the workings of long-term memory, lot of information are exchanged between fellows, and lot of time series data are conserved by characters in human society. In this paper, the model of the transfer of data between different nervous systems is shown using the concept of category theory.