This paper introduces a novel framework that integrates Docker and Kubernetes to address well-known challenges in federated learning. Federated learning has gained significant attention as a privacy-preserving and scalable machine learning paradigm. However, existing frameworks often lack portability, scalability, resource efficiency, fault tolerance, standardization, and ecosystem integration. To overcome these limitations, we propose a conceptual framework that combines Tensorflow FL with Docker’s containerization capabilities and Kubernetes’ orchestration capabilities. Our approach fills all the gaps in existing FL frameworks. By leveraging Docker containers, our model achieves efficient resource allocation, maximizing computing resources while maintaining portability and scalability. Kubernetes further enhances resource allocation by orchestrating the deployment of these containers, minimizing resource consumption. Our proposed framework provides opportunities for largescale distributed machine learning applications, enabling the widespread use of federated learning methodologies.
FedEdge: Federated Learning with Docker and Kubernetes for Scalable and Efficient Edge Computing / Hassan, Mir; Leonardo, Lucio; Yildirim, Sinan; Iacca, Giovanni. - (2023), pp. 339-344. (Intervento presentato al convegno The International Conference on Embedded Wireless Systems and Networks (EWSN 2023) tenutosi a Rende, Italy nel 25th -27th September 2023) [10.5555/3639940.3639994].
FedEdge: Federated Learning with Docker and Kubernetes for Scalable and Efficient Edge Computing
Mir, HassanPrimo
;Leonardo, LucioSecondo
;Sinan YildirimPenultimo
;Giovanni, Iacca
Ultimo
2023-01-01
Abstract
This paper introduces a novel framework that integrates Docker and Kubernetes to address well-known challenges in federated learning. Federated learning has gained significant attention as a privacy-preserving and scalable machine learning paradigm. However, existing frameworks often lack portability, scalability, resource efficiency, fault tolerance, standardization, and ecosystem integration. To overcome these limitations, we propose a conceptual framework that combines Tensorflow FL with Docker’s containerization capabilities and Kubernetes’ orchestration capabilities. Our approach fills all the gaps in existing FL frameworks. By leveraging Docker containers, our model achieves efficient resource allocation, maximizing computing resources while maintaining portability and scalability. Kubernetes further enhances resource allocation by orchestrating the deployment of these containers, minimizing resource consumption. Our proposed framework provides opportunities for largescale distributed machine learning applications, enabling the widespread use of federated learning methodologies.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione