Selective activation checkpointing (SAC) decides which activations to save for the backward pass and which to recompute: each choice is a point in the plane of peak memory and recomputation time, and the goal is that plane's Pareto frontier. Current practice falls short of this goal. Hand-tuned policies fix a single po...
Kai-Hui Ren, Yi-Fan Zhao, Ze-Jian Wang et al.· 0 citations
Fully Sharded Data Parallelism (FSDP2) maintains parameters and gradients as per-parameter tensors, whereas its collective path operates on flat, rank-major buffers. Converting between these layouts copies all-gather outputs into parameter storage and packs gradients into full-group fp32 buffers. Layout conversion alon...
Ze-Jian Wang, Yi-Fan Zhao, Kai-Hui Ren et al.· 0 citations
Uni4R is a framework that unifies 4D reconstruction and point tracking by learning continuous velocity fields through the synergy of Optimal Transport (OT) and Ordinary Differential Equation (ODE), and acts as a kinematic prior that mutually benefits both 4D reconstruction and point tracking.
Liying Yang, Hao Mo, Jia-Lun Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.