Simulation process support for climate data analysis

Abstract

According to data volumes in scientific applications have grown exponentially, new scientific methods to analyze and organize the data are required. Especially these methods need to support effective infrastructure composed of computing resources that are used for pre-processing and post-processing of scientific data. In this paper, we describe the design of a framework to support data transformation and reduction, in which is an essential phase to handling a large scale of data in a climate simulation. In order for efficient data movement in the designed framework we use the pushpull framework provided by Apache OODT.