Back propagation in realistic parallel environment

Abstract

Various ways of parallelizing the back propagation algorithm (BP) are studied on the bulk-synchronous parallel machine (BSP) like parallel model. Optimal number of processors and criteria for choosing the right task decomposition are presented. Theoretical results are verified in the parallel virtual machine (PVM) environment on a cluster of workstations.