Hiding communication latencies in message-passing multiprocessors: a case study based on neural network simulation

Abstract

An application package which allows the user to explore the possibility of hiding communication latencies in message-passing multiprocessors is examined. The package is a neural network simulator for transputer-based machines. Simply by modifying few high-level directives in a configuration file, heuristic strategies for fully overlapping communication delays with internal computation, can be easily explored. The neural network model and the software architecture are described. An example is discussed.<>