Federated learning is a popular framework that enables harvesting edge resources' computational power to train a machine learning model distributively. However, it is not always feasible or profitable to have a centralized server that controls and synchronizes the training process. In this paper, we consider the problem of training a machine learning model over a network of nodes in a fully decentralized fashion. In particular, we look for empirical evidence on how sensitive is the training process for various network characteristics and communication parameters. We present the outcome of several simulations conducted with different network topologies, datasets, and machine learning models.

Impact of network topology on the convergence of decentralized federated learning systems

Kavalionak H;Carlini E;Dazzi P;Ferrucci L;Mordacchini M;Coppola M
2021

Abstract

Federated learning is a popular framework that enables harvesting edge resources' computational power to train a machine learning model distributively. However, it is not always feasible or profitable to have a centralized server that controls and synchronizes the training process. In this paper, we consider the problem of training a machine learning model over a network of nodes in a fully decentralized fashion. In particular, we look for empirical evidence on how sensitive is the training process for various network characteristics and communication parameters. We present the outcome of several simulations conducted with different network topologies, datasets, and machine learning models.
2021
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
978-1-6654-2745-6
Federated learning
Peer-to-peer
Network topology
File in questo prodotto:
File Dimensione Formato  
prod_455404-doc_175976.pdf

accesso aperto

Descrizione: Preprint - Impact of network topology on the convergence of decentralized federated learning systems
Tipologia: Versione Editoriale (PDF)
Dimensione 542.77 kB
Formato Adobe PDF
542.77 kB Adobe PDF Visualizza/Apri
prod_455404-doc_181605.pdf

solo utenti autorizzati

Descrizione: Impact of network topology on the convergence of decentralized federated learning systems
Tipologia: Versione Editoriale (PDF)
Dimensione 1.18 MB
Formato Adobe PDF
1.18 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/395402
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? ND
social impact