Skip to content
Open access

Maximum Entropy on the Complex Probability Framework

Sep 2026 · Entropy · 0 citations · 20 references

Abstract

Jaynes’ maximum entropy (MaxEnt) principle selects, from all probability distributions consistent with a set of constraints, the one that maximizes the Shannon entropy. The principle is well-defined for classical, real-valued probabilities, but extending it to complex-valued probability theories requires care. Youssef’s complex probability framework, in which quantum mechanics is reformulated as a Bayesian theory with complex amplitudes and the observable probability is the squared modulus (Born rule), does not admit a natural MaxEnt extension: the L2 normalization of that framework is incompatible with the L1 normalization assumed by Shannon entropy, and the resulting complex-valued entropy functional cannot be maximized without additional structure absent from Youssef’s axioms. The present paper proposes a different extension of Kolmogorov’s axioms to the complex domain, replacing non-negativity with the condition that the real part of every probability be non-negative. This framework, which retains L1 normalization and recovers classical probability when the imaginary part vanishes, admits a natural MaxEnt principle: the real part of the complex Shannon entropy is a well-posed real functional, its Euler–Lagrange equations produce an explicit complex Gibbs distribution with complex Lagrange multipliers, and the classical Gibbs distribution is recovered as the special case of real multipliers. The die problem (Jaynes’ Brandeis dice example) is worked out in detail for both the fair and the loaded cases, illustrating how imaginary constraints redistribute the observable probability mass in a way that has no counterpart in classical MaxEnt.

Read PDF

Similar papers

Preprint Aug 2026

A Structural Characterization of Entropy Functionals

Entropy functionals and their associated divergences underlie many statistical methods, including maximum entropy inference, minimum divergence estimation, and goodness-of-fit testing, yet choosing among Shannon, R\'enyi, Tsallis, and more general entropies is often a matter of convention rather than structural princip...

D. Lazarev · 0 citations
Preprint Aug 2026

The Okinawa Lectures on Entropy

After a historical introduction, the most important classical and quantum entropies are introduced as constructions in classical and quantum probability theory. Classical entropies are studied from large deviation theory, including theorems of Sanov, Cram\'er, G\"artner-Ellis, and Varadhan, and are illustrated in some...

K. Landsman · 0 citations
Preprint Sep 2026

The Principle of Minimum Justified Correlation

It is shown that Shannon entropy, Fisher information, and quantum-mechanical kinetic energy may all be viewed as measures of correlation. We begin with a fundamental correlation-destroying map: a joint probability density $\rho(x,y)$ is replaced by $\rho_x(x)\rho_y(y)$, the product of its marginal distributions. In the...

J. Van Drie · 0 citations
Open access Sep 2026

Entropy metrics of biased multisided dice probability distributions

Entropy is one of the most fundamental concepts in physics and information theory (Claude E. Shannon (1948), \cite{Shannon}), its correct understanding is essential for the study of various physical systems, especially in thermodynamics, statistical mechanics, and in thermal process engineering. This blending of conc...

Sergio Sánchez-Sánchez · 0 citations
Preprint Aug 2026

`It from Bit': is there a second law of quantum complexity?

At a deeper level the principle of least action is interpreted as the law of least entropy increase consistent with Prigogine's principle of minimum entropy production, and the implications of quasistatic information quantization rule (Proc. R. Soc. A 480: 20240024), are explored for the conjectured second law of quant...

S. Davatolhagh, A. Sheykhi, M. H. Zarei · 0 citations
Preprint Aug 2026

Revisiting Shannon's Source Coding Theorem with Distributional Uncertainty under the Nonlinear Expectation Theory

In classical information theory, a source is modeled by a single, precisely known probability distribution. However, in the increasingly complex communication networks full of unanticipated, nonstationary, and heterogeneous random events, the assumption of precise and well-defined probability distributions to describe...

Wenxuan Lang, Shao-Shi Yang, Jianhua Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.