Dense associative memories (DAMs) are widely used models in artificial intelligence for pattern recognition tasks; computationally, they have been proven to be robust against adversarial inputs and, theoretically, leveraging their analogy with spin-glass systems, they are usually treated by means of statistical-mechanics tools. Here, we develop analytical methods, based on nonlinear partial differential equations, to investigate their functioning. In particular, we prove differential identities involving DAM's partition function and macroscopic observables useful for a qualitative and quantitative analysis of the system. These results allow for a deeper comprehension of the mechanisms underlying DAMs and provide interdisciplinary tools for their study.

Nonlinear PDEs approach to statistical mechanics of dense associative memories

Marullo C.
2022

Abstract

Dense associative memories (DAMs) are widely used models in artificial intelligence for pattern recognition tasks; computationally, they have been proven to be robust against adversarial inputs and, theoretically, leveraging their analogy with spin-glass systems, they are usually treated by means of statistical-mechanics tools. Here, we develop analytical methods, based on nonlinear partial differential equations, to investigate their functioning. In particular, we prove differential identities involving DAM's partition function and macroscopic observables useful for a qualitative and quantitative analysis of the system. These results allow for a deeper comprehension of the mechanisms underlying DAMs and provide interdisciplinary tools for their study.
2022
Istituto di Calcolo e Reti ad Alte Prestazioni - ICAR
statistical mechanics, Neural network
File in questo prodotto:
File Dimensione Formato  
103304_1_online.pdf

accesso aperto

Licenza: Nessuna licenza dichiarata (non attribuibile a prodotti successivi al 2023)
Dimensione 5.47 MB
Formato Adobe PDF
5.47 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/532829
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 9
  • ???jsp.display-item.citation.isi??? 8
social impact