LeCuration: A Tiny World Model as a Data Curation Multi-Tool
This paper trains LeCuration, a small world model intended to serve as a data curation tool for a separate, larger downstream model, and finds that the embeddings of this model can be used as an anomaly detection signal and as a content-based clustering heuristic, and that auto-regressively predicting the game state wi...
Mayank Sengupta, Nirmit Desai, Eric Song et al.
· 0 citations