Fault tolerance features of a new multi-SPMD programming/execution environment

Abstract

Supercomputers in the exascale era would consist of a huge number of nodes arranged in a multi-level hierarchy. There are many important challenges to exploit such systems such as scalability, programmability, reliability and energy efficiency. In the previous work, we had focused on the scalability and programmability. We had proposed FP2C (Framework for Post-Petascale Computing), which is a development and execution environment based on workflow and PGAS (Partitioned Global Address Space) programming models for parallel programming. In this paper, we focus on the reliability. We extend FP2C by adding a fault detection capability to the middleware of FP2C and by incorporating fault resilience scheduling policy into the workflow scheduler. Using the extended FP2C, fault tolerance can be achieved without modifying applications.