In this paper we investigate the use of nonlinear embeddings to represent dynamic inputs in surrogate models, used to estimate the outcome of time-consuming simulation tools in feasible time. By encoding the temporal sequences, together with non-dynamic inputs, into a space of static features, we are able to formalize the surrogate modeling problem as a standard supervised learning one. To this purpose, we propose to use the echo state network (ESN) paradigm to generate the embeddings of the dynamic inputs. The main advantage of this approach is that the embedding does not require training, since it is provided by a reservoir of neurons with randomly generated parameters. In order to enhance the robustness of this method based on randomization, we propose to use an ensemble of different ESN embeddings. Within this scheme, we consider a procedure aimed at controlling diversity among the ensemble elements before the simulations are run. Furthermore, in order to improve accuracy, we investigate also nonlinear mappings for the generation of the ESN outputs. The proposed approach is applied to an urban traffic network example, a typical case in which simulation models are generally complex and very time-consuming, and the scenarios to be simulated involve both static inputs and timevarying quantities.

Echo state network ensembles for surrogate models with an application to urban mobility

Cervellera Cristiano
;
Macciò Danilo;Rebora Francesco
2022

Abstract

In this paper we investigate the use of nonlinear embeddings to represent dynamic inputs in surrogate models, used to estimate the outcome of time-consuming simulation tools in feasible time. By encoding the temporal sequences, together with non-dynamic inputs, into a space of static features, we are able to formalize the surrogate modeling problem as a standard supervised learning one. To this purpose, we propose to use the echo state network (ESN) paradigm to generate the embeddings of the dynamic inputs. The main advantage of this approach is that the embedding does not require training, since it is provided by a reservoir of neurons with randomly generated parameters. In order to enhance the robustness of this method based on randomization, we propose to use an ensemble of different ESN embeddings. Within this scheme, we consider a procedure aimed at controlling diversity among the ensemble elements before the simulations are run. Furthermore, in order to improve accuracy, we investigate also nonlinear mappings for the generation of the ESN outputs. The proposed approach is applied to an urban traffic network example, a typical case in which simulation models are generally complex and very time-consuming, and the scenarios to be simulated involve both static inputs and timevarying quantities.
2022
Istituto di iNgegneria del Mare - INM (ex INSEAN) - Sede Secondaria Genova
Echo state networks
surrogate modeling
ensemble models
simulation of urban mobility
File in questo prodotto:
File Dimensione Formato  
paper.pdf

solo utenti autorizzati

Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 1.53 MB
Formato Adobe PDF
1.53 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/445197
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact