In the framework of information geometry, we explore the structure of statistical manifold Sn related to the Rényi entropy. Starting from a new family of generalized exponential distributions given by the equilibrium distribution of a canonical system described by the Rényi entropy, we introduce on Sn a dually-flat geometry endowed by a Hessian structure derived from a generalization of Fisher metric and a flat affine connection. This geometrical structure admits a Legendre transform that links the thermodynamic potentials of the underlying statistical mechanics to the dual potentials of the corresponding information geometry. A canonical divergence function à la Bregman is naturally derived in this framework. Further geometric structures, derived from other contrast functions strictly related to the Rényi entropy are explored and their link with the ?*-geometry of Amari is highlighted.

A study of Rényi entropy based on the information geometry formalism

Antonio M Scarfone;
2020

Abstract

In the framework of information geometry, we explore the structure of statistical manifold Sn related to the Rényi entropy. Starting from a new family of generalized exponential distributions given by the equilibrium distribution of a canonical system described by the Rényi entropy, we introduce on Sn a dually-flat geometry endowed by a Hessian structure derived from a generalization of Fisher metric and a flat affine connection. This geometrical structure admits a Legendre transform that links the thermodynamic potentials of the underlying statistical mechanics to the dual potentials of the corresponding information geometry. A canonical divergence function à la Bregman is naturally derived in this framework. Further geometric structures, derived from other contrast functions strictly related to the Rényi entropy are explored and their link with the ?*-geometry of Amari is highlighted.
2020
Istituto dei Sistemi Complessi - ISC
Inglese
53
145003
16
https://iopscience.iop.org/article/10.1088/1751-8121/ab766c
Sì, ma tipo non specificato
Rényi entropy
information geometry
contrast functions
Legendre structure
3
info:eu-repo/semantics/article
262
Scarfone, ANTONIO MARIA; Matsuzoe, Hiroshi; Wada, Tatsuaki
01 Contributo su Rivista::01.01 Articolo in rivista
restricted
File in questo prodotto:
File Dimensione Formato  
prod_418496-doc_147799.pdf

solo utenti autorizzati

Descrizione: A study of Rényi entropy based on the information geometry formalism
Tipologia: Documento in Post-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 227.49 kB
Formato Adobe PDF
227.49 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/368312
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact