EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

Dynamic Deployment of Scientific Workflows in the Cloud using Container Virtualization -

Scientific workflows are increasingly being migrated to the Cloud. However, workflow developers face the problem of which Cloud to choose and, more importantly, how to avoid vendor lock-in. This is because there are a range of Cloud platforms, each with different functionality and interfaces. In this paper authors propose a solution system that allows workflows to be portable across a range of Clouds.This portability is achieved through a new framework for building, dynamically deploying and enacting workflows. It combines the TOSCA specification language and container-based virtualization. TOSCA is used to build a reusable and portable description of a workflow which can be automatically deployed and enacted using Docker containers.The paper describe a working implementation of our framework and evaluate it using a set of existing scientific workflows that illustrate the flexibility of the proposed approach.

The work covered in the paper was partially suppoted by previous EU - Brazil collaboration efforts under the EU-Brazil Cloud Connect project and is also leveraged upon by the EUBra-BIGSEA project. 

Read the full paper here 

Author(s):     Qasha R, Cala J, Watson P
Series Title:  School of Computing Science Technical Report Series
Year: 2016
 

Date: 
9 months 3 weeks ago

Comments