In this paper we present the approach proposed by EU H2020 INDIGO-DataCloud project to orchestrate dynamic workflows over a cloud environment. The main focus of the project is on the development of open source Platform as a Service solutions targeted at scientific communities, deployable on multiple hardware platforms, and provisioned over hybrid e-Infrastructures. The project is addressing many challenging gaps in current cloud solutions, responding to specific requirements coming from scientific communities including Life Sciences, Physical Sciences and Astronomy, Social Sciences and Humanities, and Environmental Sciences. We are presenting the ongoing work on implementing the whole software chain on the Infrastructure as a Service, PaaS and Software as a Service layers, focusing on the scenarios involving scientific workflows and big data analytics frameworks. INDIGO module for Kepler worflow system has been introduced along with the INDIGO underlying services exploited by the workflow components. A climate change data analytics experiment use case regarding the precipitation trend analysis on CMIP5 data is described, that makes use of Kepler and big data analytics services.
Two-level dynamic workflow orchestration in the INDIGO DataCloud for large-scale, climate change data analytics experiments / Plociennik, M.; Fiore, S.; Donvito, G.; Owsiak, M.; Fargetta, M.; Barbera, R.; Bruno, R.; Giorgio, E.; Williams, D. N.; Aloisio, G.. - In: PROCEDIA COMPUTER SCIENCE. - ISSN 1877-0509. - 80:(2016), pp. 722-733. (Intervento presentato al convegno International Conference on Computational Science, ICCS 2016 tenutosi a Catamaran Resort Hotel and Spa, usa nel 2016) [10.1016/j.procs.2016.05.359].
Two-level dynamic workflow orchestration in the INDIGO DataCloud for large-scale, climate change data analytics experiments
Fiore S.;
2016-01-01
Abstract
In this paper we present the approach proposed by EU H2020 INDIGO-DataCloud project to orchestrate dynamic workflows over a cloud environment. The main focus of the project is on the development of open source Platform as a Service solutions targeted at scientific communities, deployable on multiple hardware platforms, and provisioned over hybrid e-Infrastructures. The project is addressing many challenging gaps in current cloud solutions, responding to specific requirements coming from scientific communities including Life Sciences, Physical Sciences and Astronomy, Social Sciences and Humanities, and Environmental Sciences. We are presenting the ongoing work on implementing the whole software chain on the Infrastructure as a Service, PaaS and Software as a Service layers, focusing on the scenarios involving scientific workflows and big data analytics frameworks. INDIGO module for Kepler worflow system has been introduced along with the INDIGO underlying services exploited by the workflow components. A climate change data analytics experiment use case regarding the precipitation trend analysis on CMIP5 data is described, that makes use of Kepler and big data analytics services.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione
