The Composition Gap in Dataset Distillation
This work asks whether the union of separately distilled sets reproduces training on the union of the real data composability and shows that it can fail even when every source is distilled exactly and the total budget admits an exact joint distillate.
Guang Li, Takahiro Ogawa, Miki Haseyama
· 0 citations