A Deployment System for Highly Heterogeneous and Dynamic Environments

Abstract

In this paper we introduce the scientific issues related to deploying, in a multi-Cloud architecture, an infrastructure using the publish-subscribe paradigm for orchestrating the components of a framework that execute scientific workflows in highly heterogeneous and dynamic environments. More specifically we are in search of the adequate approaches to build deployment systems for heterogeneous and highly dynamic environments. As the use case for this paper, we focus on the deployment of the RedisDG workflow engine. This insight serves to make concrete our ideas, and we propose an architecture for the deployment system as well as different scenarios and demonstrations of this scientific workflow engine, deployed 'as a Service'. This paper can be considered as the first return from our experience in deploying, automatically, an IaaS (Infrastructure as a Service) for executing scientific workflows, on-demand for heterogeneous and dynamic environments.