Ruo-Di Zhang

Algebraic Consistency Alone Does Not Certify Temporal Structure in Latent Action Models

Latent action models infer a code for the transition between two frames of action-free video. Recent methods regularise this code to compose additively and reverse antisymmetrically, and report order-of-magnitude reductions in the resulting errors as a label-free certificate that the code has captured temporal structur...