A method for modelling and organazing ETL processes

Abstract

In Data warehouse (DW) environment, Extraction-Transformation-Loading (ETL) processes constitute the integration layer which aims to pull data from data sources to targets, via a set of transformations. ETL is responsible for the extraction of data, their cleaning, conforming and loading into the target. At the beginning of DW project, one of the most important tasks is to construct conceptual design of ETL processes. Several solutions have been proposed to support ETL designer in this task. Nevertheless few methods have accompanied these proposals. In this paper, we present a method for modeling and organizing ETL processes based on our experience in real world. The proposed approach takes four inputs and produces a conceptual model of ETL processes using a graphical notation of our framework KANTARA.