J. Van Drie

The Principle of Minimum Justified Correlation

It is shown that Shannon entropy, Fisher information, and quantum-mechanical kinetic energy may all be viewed as measures of correlation. We begin with a fundamental correlation-destroying map: a joint probability density $\rho(x,y)$ is replaced by $\rho_x(x)\rho_y(y)$, the product of its marginal distributions. In the...