This paper introduces a novel framework that integrates Docker and Kubernetes to address well-known challenges in federated learning. Federated learning has gained significant attention as a privacy-preserving and scalable machine learning paradigm. However, existing frameworks often lack portability, scalability, resource efficiency, fault tolerance, standardization, and ecosystem integration. To overcome these limitations, we propose a conceptual framework that combines Tensorflow FL with Docker’s containerization capabilities and Kubernetes’ orchestration capabilities. Our approach fills all the gaps in existing FL frameworks. By leveraging Docker containers, our model achieves efficient resource allocation, maximizing computing resources while maintaining portability and scalability. Kubernetes further enhances resource allocation by orchestrating the deployment of these containers, minimizing resource consumption. Our proposed framework provides opportunities for largescale distributed machine learning applications, enabling the widespread use of federated learning methodologies.

FedEdge: Federated Learning with Docker and Kubernetes for Scalable and Efficient Edge Computing / Hassan, Mir; Leonardo, Lucio; Yildirim, Sinan; Iacca, Giovanni. - (2023), pp. 339-344. (Intervento presentato al convegno The International Conference on Embedded Wireless Systems and Networks (EWSN 2023) tenutosi a Rende, Italy nel 25th -27th September 2023) [10.5555/3639940.3639994].

FedEdge: Federated Learning with Docker and Kubernetes for Scalable and Efficient Edge Computing

Mir, Hassan
Primo
;
Leonardo, Lucio
Secondo
;
Sinan Yildirim
Penultimo
;
Giovanni, Iacca
Ultimo
2023-01-01

Abstract

This paper introduces a novel framework that integrates Docker and Kubernetes to address well-known challenges in federated learning. Federated learning has gained significant attention as a privacy-preserving and scalable machine learning paradigm. However, existing frameworks often lack portability, scalability, resource efficiency, fault tolerance, standardization, and ecosystem integration. To overcome these limitations, we propose a conceptual framework that combines Tensorflow FL with Docker’s containerization capabilities and Kubernetes’ orchestration capabilities. Our approach fills all the gaps in existing FL frameworks. By leveraging Docker containers, our model achieves efficient resource allocation, maximizing computing resources while maintaining portability and scalability. Kubernetes further enhances resource allocation by orchestrating the deployment of these containers, minimizing resource consumption. Our proposed framework provides opportunities for largescale distributed machine learning applications, enabling the widespread use of federated learning methodologies.
2023
EWSN '23: Proceedings of the 2023 International Conference on embedded Wireless Systems and Networks
New York, NY, USA
ACM
Hassan, Mir; Leonardo, Lucio; Yildirim, Sinan; Iacca, Giovanni
FedEdge: Federated Learning with Docker and Kubernetes for Scalable and Efficient Edge Computing / Hassan, Mir; Leonardo, Lucio; Yildirim, Sinan; Iacca, Giovanni. - (2023), pp. 339-344. (Intervento presentato al convegno The International Conference on Embedded Wireless Systems and Networks (EWSN 2023) tenutosi a Rende, Italy nel 25th -27th September 2023) [10.5555/3639940.3639994].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/401106
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact