A Night at the LLM Zoo: Data Conditioned Flow Matching for Generating Pretrained LLM Weights
A challenge to Weight Space Learning as it expands from task specific and vision models to Large Language Models (LLMs) is the absence of a well curated and analyzed LLM population. To address this, we train such a model zoo for application to Weight Space Generation by systematically varying the data mixture compositi...
Scott Biggs, Bedionita Soro, Saumya Gupta et al.
· 0 citations