This is IT: A Primer on Shannon’s Entropy and Information - Equipe Communications numériques Accéder directement au contenu
Chapitre D'ouvrage Année : 2021

This is IT: A Primer on Shannon’s Entropy and Information

Résumé

What is Shannon’s information theory (IT)? Despite its continued impact on our digital society, Claude Shannon’s life and work is still unknown to numerous people. In this tutorial, we review many aspects of the concept of entropy and information from a historical and mathematical point of view. The text is structured into small, mostly independent sections, each covering a particular topic. For simplicity we restrict our attention to one-dimensional variables and use logarithm and exponential notations log and exp without specifying the base. We culminate with a simple exposition of a recent proof (2017) of the entropy power inequality (EPI), one of the most fascinating inequalities in the theory.
Fichier principal
Vignette du fichier
rioul cropped.pdf (398.81 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03326385 , version 1 (30-08-2021)

Identifiants

  • HAL Id : hal-03326385 , version 1

Citer

Olivier Rioul. This is IT: A Primer on Shannon’s Entropy and Information. Bertrand Duplantier and Vincent Rivasseau. Information Theory Poincaré Seminar 2018, 78, Birkhäuser, Springer Nature, 2021, Progress in Mathematical Physics, 978-3-030-81479-3. ⟨hal-03326385⟩
179 Consultations
431 Téléchargements

Partager

Gmail Facebook X LinkedIn More