FiGuRO: Intrinsic Dimension Estimation for Multi-Modal Data
Fidelity-Guided Rank Optimization (FiGuRO), a framework for approximating the ID of uni- and multi-modal data under constraints of model capacity and hyperparameters, is introduced and can be applied to modern uni-modal pretrained models, enabling efficient, post-hoc disentanglement of multi-modal representations.