EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

Deliverable 3.1 - QoS Monitoring System Architecture

The Quality of Service (QoS) architecture is the computational core of the EUBra-BIGSEA platform. The performance of data analytics applications running on the EUBRra-BIGSEA platform are profiled in advance, so a QoS guarantee is defined based on the performance requirements. 

This document describes the QoS Monitoring System Architecture as well as the software architecture of other cloud-service related components and their interactions. The purpose of this report on the QoS Monitoring System Architecture is to define the software components that will collect the execution data from the cloud architecture, as well as the main components that intervene in the full process of deployment, configuration, contextualization and execution. Each component is described in terms of its external interfaces and dependencies on other components.

The project identifies three types of workloads: (i) persistent, (ii) periodic batch and (iii) interactive jobs, which will be served by different schedulers. Persistent jobs will be served by the Marathon scheduler, periodic jobs by means of Chronos scheduler, and interactive jobs through interactive shells (e.g. spark shells). Those schedulers will deploy frameworks that will embed the executable services and negotiate the resources with Mesos.

Categories: