Information Theory and Selected Applications

This book focuses on analysing the applications of the Shannon Measure of Information (SMI). The book introduces the concept of frustration and discusses the question of the quantification of this concept within information theory (IT), while it also focuses on the interpretation of the entropy of systems of interacting particles in terms of the SMI and of mutual information. The author examines the question of the possibility of measuring the extent of frustration using mutual information and discusses some classical examples of processes of mixing and assimilation for which the entropy changes are interpreted in terms of SMI. A description of a few binding systems and the interpretation of cooperativity phenomena in terms of mutual information are also presented, along with a detailed discussion on the general method of using maximum SMI in order to find the best-guess probability distribution. This book is a valuable contribution to the field of information theory and will be of great interest to any scientist who is interested in IT and in its potential applications.

Provides new and different applications of Shannon's measure of information Clarifies difficult concepts related to Information Theory Is useful to scientists working in any field of science

Autorentext

Arieh Ben-Naim is a professor emeritus at the Hebrew University of Jerusalem's Department of Physical Chemistry. Most of his research work was focused on the theory of water, aqueous solutions and the role of water in biochemical processes. Recently, the author dedicated his time explaining and clarifying to the general public the most mysterious concept in physics: Entropy. He is the author of many books and articles on Entropy, the Second Law and Information Theory.

Inhalt
Introduction and Caveats.- Intermolecular interactions, correlations, and Mutual Information.- Application of Multivariate Mutual Information to study spin systems.- Entropy of Mixing and Entropy of Assimilation, an Informational Theoretical Approach.- Information transmission between molecules in binding systems.- Calculations of the best-guess probability distribution using Shannon's Measure of Information.