Machine learning in small-scale unmanned aerial vehicle (UAV) deployment fails to accomplish complex missions of swarm intelligence. Federated learning (FL) tackles it by being able to handle large-scale learning, while keeping data private. The client data distribution involved in FL is often non-independent and identically distributed (Non-IID) and the amount of data is unbalanced. This may seriously affect the model's convergence speed, and may even lead to nonconvergence. To tackle the above problems, we propose a new asynchronous FL scheme that combines adjusting client training. The scheme determines the weight of aggregation based on the staleness of client model parameters and the amount of data owned by the client, and dynamically adjusts the local training of each client using average training loss. Experiments on public datasets verify the effectiveness of our method, which can alleviate the impact of data Non-IID and data imbalance in asynchronous FL and accelerate the training of FL.

Federated learning based on asynchronous and adjusted client training

Kianoush Sanaz;Savazzi Stefano;
2023

Abstract

Machine learning in small-scale unmanned aerial vehicle (UAV) deployment fails to accomplish complex missions of swarm intelligence. Federated learning (FL) tackles it by being able to handle large-scale learning, while keeping data private. The client data distribution involved in FL is often non-independent and identically distributed (Non-IID) and the amount of data is unbalanced. This may seriously affect the model's convergence speed, and may even lead to nonconvergence. To tackle the above problems, we propose a new asynchronous FL scheme that combines adjusting client training. The scheme determines the weight of aggregation based on the staleness of client model parameters and the amount of data owned by the client, and dynamically adjusts the local training of each client using average training loss. Experiments on public datasets verify the effectiveness of our method, which can alleviate the impact of data Non-IID and data imbalance in asynchronous FL and accelerate the training of FL.
2023
Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni - IEIIT
Asynchronous algorithm
Client training adjustment
Federated learning
Imbalance
Non-IID
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/429364
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact