# Information Theory and Statistical Mechanics

@article{Jaynes1957InformationTA, title={Information Theory and Statistical Mechanics}, author={Edwin T. Jaynes}, journal={Physical Review}, year={1957}, volume={106}, pages={620-630} }

Treatment of the predictive aspect of statistical mechanics as a form of statistical inference is extended to the density-matrix formalism and applied to a discussion of the relation between irreversibility and information loss. A principle of "statistical complementarity" is pointed out, according to which the empirically verifiable probabilities of statistical mechanics necessarily correspond to incomplete predictions. A preliminary discussion is given of the second law of thermodynamics and… Expand

#### 10,685 Citations

Irreversibility, Probability and Entropy

- Mathematics
- 1994

There is a single consistent resolution of the reversible microdynamicsirreversible maero dynamics problem, stemming from better understanding of the role of probability in physics: the Bayesian… Expand

Thermodynamics and Information Theory

- 2018

The Laws of Classical Thermodynamics and the fundamental principles of Statistical Mechanics are reviewed with an emphasis on their logical structure. We discuss the universality of equilibrium… Expand

Statistical Mechanics and the Maximum Entropy Method

- Mathematics
- 1994

This course reviews the foundations and methods of statistical mechanics in their relation to the maximum entropy principle. After having introduced the main tools of information theory and of… Expand

The Three Phases of Statistical Mechanics

- Physics
- 1989

The foundations of statistical mechanics are reviewed, based on the principle of maximum entropy, and this principle is shown to underlie the fundamental mechanisms of both equilibrium and… Expand

An identity of Chernoff bounds with an interpretation in statistical physics and applications in information theory

- Mathematics, Computer Science
- 2008 IEEE International Symposium on Information Theory
- 2008

Several information-theoretic application examples are described, where the analysis of this large deviations rate function of the probability a certain rare event naturally arises, which results in several relationships between information theory and statistical physics. Expand

Entropic Formulation of Statistical Mechanics

- Mathematics
- 2002

We present an alternative formulation of Equilibrium Statistical Mechanics which follows the method based on the maximum statistical entropy principle in Information Theory combined with the use of… Expand

Maximum information entropy principle and the interpretation of probabilities in statistical mechanics − a short review

- Mathematics, Physics
- 2016

Abstract
In this paper an alternative approach to statistical mechanics based on the maximum
information entropy principle (MaxEnt) is examined, specifically its close relation with
the Gibbs method… Expand

Foundations of statistical mechanics

- Physics
- 1969

Developments in the foundations of statistical mechanics during the past ten years or so. The author discusses how statistical concepts enter the treatment of deterministic mechanical systems, with… Expand

Foundations of Statistical Mechanics: in and out of Equilibrium

- Physics, Mathematics
- 2005

The first part of the paper is devoted to the foundations, that is the mathematical and physical justification, of equilibrium statistical mechanics. It is a pedagogical attempt, mostly based on… Expand

Statistical thermodynamics from the point of view of statistical theory of estimation

- Mathematics
- 1978

Abstract An essentially statistical theory of thermodynamics is developed on the basis of additivity and conservation laws of fundamental entities of thermodynamics. The theory developed by Dutta… Expand