Bringing together a number of cutting-edge technologies that range from storing extremely large volumes of data all the way to developing scalable machine learning and deep learning algorithms in a distributed manner and having them operate over the same infrastructure poses unprecedented challenges. One of these challenges is the integration of European Space Agency (ESA)'s Thematic Exploitation Platforms (TEPs) and data information access service platforms with a data platform, namely Hopsworks, which enables scalable data processing, machine learning, and deep learning on Copernicus data, and development of very large training datasets for deep learning architectures targeting the classification of Sentinel images. In this article, we present the software architecture of ExtremeEarth that aims at the development of scalable deep learning and geospatial analytics techniques for processing and analyzing petabytes of Copernicus data. The ExtremeEarth software infrastructure seamlessly integrates existing and novel software platforms and tools for storing, accessing, processing, analyzing, and visualizing large amounts of Copernicus data. New techniques in the areas of remote sensing and artificial intelligence with an emphasis on deep learning are developed. These techniques and corresponding software presented in this article are to be integrated with and used in two ESA TEPs, namely Polar and Food Security TEPs. Furthermore, we present the integration of Hopsworks with the Polar and Food Security use cases and the flow of events for the products offered through the TEPs.

ExtremeEarth Meets Satellite Data From Space / Hagos, Desta Haileselassie; Kakantousis, Theofilos; Vlassov, Vladimir; Sheikholeslami, Sina; Wang, Tianze; Dowling, Jim; Paris, Claudia; Marinelli, Daniele; Weikmann, Giulio; Bruzzone, Lorenzo; Khaleghian, Salman; Kraemer, Thomas; Eltoft, Torbjørn; Marinoni, Andrea; Pantazi, Despina-Athanasia; Stamoulis, Georgios; Bilidas, Dimitris; Papadakis, George; Mandilaras, George; Koubarakis, Manolis; Troumpoukis, Antonis; Konstantopoulos, Stasinos; Muerth, Markus; Appel, Florian; Fleming, Andrew H; Cziferszky, Andreas. - In: IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING. - ISSN 1939-1404. - 2021, 14:(2021), pp. 9038-9063. [10.1109/JSTARS.2021.3107982]

ExtremeEarth Meets Satellite Data From Space

Paris, Claudia;Marinelli, Daniele;Weikmann, Giulio;Bruzzone, Lorenzo;
2021-01-01

Abstract

Bringing together a number of cutting-edge technologies that range from storing extremely large volumes of data all the way to developing scalable machine learning and deep learning algorithms in a distributed manner and having them operate over the same infrastructure poses unprecedented challenges. One of these challenges is the integration of European Space Agency (ESA)'s Thematic Exploitation Platforms (TEPs) and data information access service platforms with a data platform, namely Hopsworks, which enables scalable data processing, machine learning, and deep learning on Copernicus data, and development of very large training datasets for deep learning architectures targeting the classification of Sentinel images. In this article, we present the software architecture of ExtremeEarth that aims at the development of scalable deep learning and geospatial analytics techniques for processing and analyzing petabytes of Copernicus data. The ExtremeEarth software infrastructure seamlessly integrates existing and novel software platforms and tools for storing, accessing, processing, analyzing, and visualizing large amounts of Copernicus data. New techniques in the areas of remote sensing and artificial intelligence with an emphasis on deep learning are developed. These techniques and corresponding software presented in this article are to be integrated with and used in two ESA TEPs, namely Polar and Food Security TEPs. Furthermore, we present the integration of Hopsworks with the Polar and Food Security use cases and the flow of events for the products offered through the TEPs.
2021
Hagos, Desta Haileselassie; Kakantousis, Theofilos; Vlassov, Vladimir; Sheikholeslami, Sina; Wang, Tianze; Dowling, Jim; Paris, Claudia; Marinelli, Daniele; Weikmann, Giulio; Bruzzone, Lorenzo; Khaleghian, Salman; Kraemer, Thomas; Eltoft, Torbjørn; Marinoni, Andrea; Pantazi, Despina-Athanasia; Stamoulis, Georgios; Bilidas, Dimitris; Papadakis, George; Mandilaras, George; Koubarakis, Manolis; Troumpoukis, Antonis; Konstantopoulos, Stasinos; Muerth, Markus; Appel, Florian; Fleming, Andrew H; Cziferszky, Andreas
ExtremeEarth Meets Satellite Data From Space / Hagos, Desta Haileselassie; Kakantousis, Theofilos; Vlassov, Vladimir; Sheikholeslami, Sina; Wang, Tianze; Dowling, Jim; Paris, Claudia; Marinelli, Daniele; Weikmann, Giulio; Bruzzone, Lorenzo; Khaleghian, Salman; Kraemer, Thomas; Eltoft, Torbjørn; Marinoni, Andrea; Pantazi, Despina-Athanasia; Stamoulis, Georgios; Bilidas, Dimitris; Papadakis, George; Mandilaras, George; Koubarakis, Manolis; Troumpoukis, Antonis; Konstantopoulos, Stasinos; Muerth, Markus; Appel, Florian; Fleming, Andrew H; Cziferszky, Andreas. - In: IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING. - ISSN 1939-1404. - 2021, 14:(2021), pp. 9038-9063. [10.1109/JSTARS.2021.3107982]
File in questo prodotto:
File Dimensione Formato  
ExtremeEarth_Meets_Satellite_Data_From_Space(1).pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 6.77 MB
Formato Adobe PDF
6.77 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/315285
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 8
  • ???jsp.display-item.citation.isi??? 5
social impact