Review
Sep 2026
Dependency, Compression, and Synergy: A Unified Information-Theoretic View of Multimodal Learning
Recent advances in multimodal foundation models have intensified the need to understand how different modalities share, preserve, and complement information. Mutual Information (MI), the Information Bottleneck (IB), and Partial Information Decomposition (PID) provide complementary perspectives, yet existing studies oft...
Liang-Jian Wen, Lin Li, Jiang Duan et al.
· 1 citation