Nam Do-Hoang Le

WHO PAYS FOR THE KNOWLEDGE MODELS COPY? MODEL COLLAPSE AS ROGERS' PARADOX

Generative models trained on the output of earlier models lose knowledge across generations, rare knowledge first. The remedies that work all bring in information from outside the loop – fresh human data, verifiers, curators – and the theory of model collapse treats that supply as given: a fixed archive, drawn from a f...