Federated learning is a popular framework that enables harvesting edge resources' computational power to train a machine learning model distributively. However, it is not always feasible or profitable to have a centralized server that controls and synchronizes the training process. In this paper, we consider the problem of training a machine learning model over a network of nodes in a fully decentralized fashion. In particular, we look for empirical evidence on how sensitive is the training process for various network characteristics and communication parameters. We present the outcome of several simulations conducted with different network topologies, datasets, and machine learning models.

Impact of network topology on the convergence of decentralized federated learning systems

Kavalionak H;Carlini E;Dazzi P;Ferrucci L;Mordacchini M;Coppola M
2021

Abstract

Federated learning is a popular framework that enables harvesting edge resources' computational power to train a machine learning model distributively. However, it is not always feasible or profitable to have a centralized server that controls and synchronizes the training process. In this paper, we consider the problem of training a machine learning model over a network of nodes in a fully decentralized fashion. In particular, we look for empirical evidence on how sensitive is the training process for various network characteristics and communication parameters. We present the outcome of several simulations conducted with different network topologies, datasets, and machine learning models.
2021
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
Inglese
2021 IEEE Symposium on Computers and Communications (ISCC) (IEEE ISCC 2021)
ISCC 2021 - 26th IEEE Symposium on Computers and Communications
6
978-1-6654-2745-6
https://ieeexplore.ieee.org/document/9631460
IEEE
New York
STATI UNITI D'AMERICA
Sì, ma tipo non specificato
05-08/09/2021
Athens, Greece
Federated learning
Peer-to-peer
Network topology
Elettronico
6
partially_open
Kavalionak, H; Carlini, E; Dazzi, P; Ferrucci, L; Mordacchini, M; Coppola, M
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
   A computing toolkit for building efficient autonomous applications leveraging humanistic intelligence
   TEACHING
   H2020
   871385
File in questo prodotto:
File Dimensione Formato  
prod_455404-doc_181605.pdf

solo utenti autorizzati

Descrizione: Impact of network topology on the convergence of decentralized federated learning systems
Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 1.18 MB
Formato Adobe PDF
1.18 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Kavalionak_Impact of network topology_AAM.pdf

accesso aperto

Descrizione: Impact of network topology on the convergence of decentralized federated learning systems
Tipologia: Documento in Post-print
Licenza: Nessuna licenza dichiarata (non attribuibile a prodotti successivi al 2023)
Dimensione 543.37 kB
Formato Adobe PDF
543.37 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/395402
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 13
social impact