Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training across devices or silos that simultaneously act as both data producers and learners. Unlike centralized learning (CL) techniques, relying on big-data fusion and analytics located in energy hungry data centers, in FL scenarios devices collaboratively train their models without sharing their private data. This article breaks down and analyzes the main factors that influence the environmental footprint of FL policies compared with classical CL/Big-Data algorithms running in data centers. The proposed analytical framework takes into account both learning and communication energy costs, as well as the incurred greenhouse gas, or carbon equivalent, emissions. The framework is evaluated in an industrial setting assuming a real-world robotized workplace. Results show that FL allows remarkable end-to-end energy savings (30%÷40%) in low-rate/power IoT communications (with limited energy efficiency). On the other hand, FL is slower to converge when local data are unevenly distributed (often 2x slower than CL).

A framework for energy and carbon footprint analysis of distributed and federated edge learning

Savazzi Stefano;Kianoush Sanaz;Rampa Vittorio;
2021

Abstract

Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training across devices or silos that simultaneously act as both data producers and learners. Unlike centralized learning (CL) techniques, relying on big-data fusion and analytics located in energy hungry data centers, in FL scenarios devices collaboratively train their models without sharing their private data. This article breaks down and analyzes the main factors that influence the environmental footprint of FL policies compared with classical CL/Big-Data algorithms running in data centers. The proposed analytical framework takes into account both learning and communication energy costs, as well as the incurred greenhouse gas, or carbon equivalent, emissions. The framework is evaluated in an industrial setting assuming a real-world robotized workplace. Results show that FL allows remarkable end-to-end energy savings (30%÷40%) in low-rate/power IoT communications (with limited energy efficiency). On the other hand, FL is slower to converge when local data are unevenly distributed (often 2x slower than CL).
2021
Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni - IEIIT
Inglese
32nd IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
2021-September
1564
1569
9781728175867
http://www.scopus.com/record/display.url?eid=2-s2.0-85118447509&origin=inward
September 2021
Virtual, Helsinki
Carbon footprint
Federated learning
Machine Learning
Energy Efficiency
4
none
Savazzi, Stefano; Kianoush, Sanaz; Rampa, Vittorio; Bennis, Mehdi
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
   European Coordinated Research on Long-term Challenges in Information and Communication Sciences and Technologies
   CHIST- ERA
   FP7
   248663
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/402847
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 13
  • ???jsp.display-item.citation.isi??? ND
social impact