Predictive Closure: A Set-Level Characterization of JEPA's Feature Selection
The predictive closure characterization is proposed, which accounts for the relationships between features and shows that unpredictable features can become better represented when they help predict other features, and that changing one feature's predictive relationships can affect how well others are represented.