Large Language Models (LLMs) have been used for novel discovery of algorithms, theorems, drugs, and other tasks through the use of harnesses that prompt an LLM to iteratively optimize an objective. In this work, we study the relationship between the population of previous iterates and eventual discovery success. We gen...
Mansi Sakarvadia, Marco Ciccone, Colin A. Raffel· 0 citations
Scenario planning for rare, high-impact events often requires massive ensembles to stochastically sample relevant trajectories. Although autoregressive weather emulators can efficiently generate such ensembles, isolating trajectories of interest requires sifting through petabytes of data, a challenge that grows exponen...
Jerry Lin, M. Chien, Mansi Sakarvadia et al.· 1 citation
OmniLens is presented, which applies a single lens family to any model-width activation, whether residual stream, attention, or MLP, and combines two independent scaling techniques, which reproduces key published results at substantially lower cost.
Jordan Pettyjohn, Mansi Sakarvadia, Nathaniel Hudson et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.